2024-04-26T23:09:59.006 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T23:09:59.006 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_rishabh@teuthology --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292 -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/orig.config.yaml 2024-04-26T23:09:59.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:09:59.147 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292 branch: wip-rishabh-testing-20240426.111959 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: null first_in_suite: false job_id: '7675292' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGaH69UcDfuzablpDvkEsJVoPJhBwFxPeT00M2bAFqc5k1GGqU8rE1e7NFisveRm/P3H7boohkJ6EN2BRI23/vs= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGFIYNFT//qXwGsAYPsYXooTHX948SVI5BRrsPf/jY9TGfgE8WDVgCeR3GtArSJ2T56ZhB0opaY5GTRwFZZCFPQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes - tasks.cephfs.test_subvolume.TestSubvolume teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T23:09:59.147 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T23:09:59.147 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T23:09:59.148 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T23:09:59.149 INFO:teuthology.task.internal:Checking packages... 2024-04-26T23:09:59.173 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T23:09:59.173 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T23:09:59.173 INFO:teuthology.packaging:ref: None 2024-04-26T23:09:59.173 INFO:teuthology.packaging:tag: None 2024-04-26T23:09:59.173 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T23:09:59.173 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:09:59.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T23:09:59.387 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:09:59.388 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T23:09:59.395 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T23:09:59.395 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T23:09:59.446 INFO:teuthology.task.internal:Saving configuration 2024-04-26T23:09:59.464 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T23:09:59.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:09:59.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:03:22.954867', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILuvq0xhoKO5dXuj3vGFr9gBSL2nX+BZqf/Cp3DG8VNT'} 2024-04-26T23:09:59.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:03:22.956579', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII/mgHzESCdi7gbOKc3bEYQkB4jtLbA8Z+EfT1DLbMMQ'} 2024-04-26T23:09:59.532 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T23:09:59.538 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T23:09:59.538 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T23:09:59.538 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T23:09:59.608 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff41be264c0>, signals=[15]) 2024-04-26T23:09:59.608 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T23:09:59.616 INFO:teuthology.task.internal:Opening connections... 2024-04-26T23:09:59.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:09:59.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:09:59.703 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:09:59.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:09:59.781 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T23:09:59.788 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-04-26T23:09:59.792 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-04-26T23:09:59.793 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-04-26T23:09:59.837 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:09:59.837 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2024-04-26T23:09:59.837 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2024-04-26T23:09:59.837 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:09:59.838 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:09:59.839 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-04-26T23:09:59.860 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-04-26T23:09:59.865 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-04-26T23:09:59.865 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="22.04" 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=jammy 2024-04-26T23:09:59.911 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:09:59.912 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:09:59.912 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-26T23:09:59.935 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T23:09:59.946 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T23:09:59.951 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T23:09:59.951 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:09:59.954 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:09:59.958 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T23:09:59.964 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T23:09:59.964 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:09:59.999 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:10:00.005 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T23:10:00.058 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T23:10:00.073 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T23:10:00.073 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-26T23:10:00.073 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-26T23:10:00.074 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:10:00.074 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:10:00.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:10:00.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T23:10:00.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:10:00.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T23:10:00.235 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:10:00.235 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:10:00.236 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-26T23:10:00.241 INFO:teuthology.orchestra.run.smithi071.stdout:5.15.0-56-generic 2024-04-26T23:10:00.241 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:10:00.242 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:10:00.242 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-26T23:10:00.242 DEBUG:teuthology.orchestra.run.smithi071:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:10:00.294 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:10:00.327 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:10:00.327 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:10:00.327 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-04-26T23:10:00.333 INFO:teuthology.orchestra.run.smithi039.stdout:5.15.0-56-generic 2024-04-26T23:10:00.333 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:10:00.333 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:10:00.333 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-26T23:10:00.333 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:10:00.396 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:10:00.417 INFO:teuthology.orchestra.run.smithi071.stderr:hint: 2024-04-26T23:10:00.418 INFO:teuthology.orchestra.run.smithi071.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:10:00.418 INFO:teuthology.orchestra.run.smithi071.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:10:00.418 INFO:teuthology.orchestra.run.smithi071.stderr:hint: 2024-04-26T23:10:00.418 INFO:teuthology.orchestra.run.smithi071.stderr:hint: git branch -m 2024-04-26T23:10:00.418 INFO:teuthology.orchestra.run.smithi071.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:10:00.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:10:00.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:10:00.545 DEBUG:teuthology.orchestra.run.smithi071:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2024-04-26T23:10:00.547 INFO:teuthology.orchestra.run.smithi039.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:10:00.548 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:10:00.548 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2024-04-26T23:10:00.548 INFO:teuthology.orchestra.run.smithi039.stderr:hint: git branch -m 2024-04-26T23:10:00.548 INFO:teuthology.orchestra.run.smithi039.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:10:00.550 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:10:00.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:10:00.670 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:10:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:10:58.361 INFO:teuthology.orchestra.run.smithi071.stderr: * [new branch] main -> origin/main 2024-04-26T23:10:58.386 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:10:58.386 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:10:58.386 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:10:58.387 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:10:58.391 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:10:58.392 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:10:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:10:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:10:58.397 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:10:58.397 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:10:58.397 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:10:58.397 INFO:teuthology.orchestra.run.smithi071.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:11:00.628 INFO:teuthology.orchestra.run.smithi039.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:11:00.628 INFO:teuthology.orchestra.run.smithi039.stderr: * [new branch] main -> origin/main 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:11:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:11:00.664 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:11:00.664 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:11:00.664 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:11:00.666 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:11:00.667 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:11:00.667 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:11:00.667 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:11:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:11:00.670 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:11:00.671 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:11:00.672 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:11:02.660 INFO:teuthology.orchestra.run.smithi071.stderr:Updating files: 45% (1538/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2017/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2820/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:11:02.665 INFO:teuthology.orchestra.run.smithi071.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:11:02.687 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-26T23:11:02.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:11:02.841 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:02.842 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:11:02.844 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi071.front.sepia.ceph.com to complete... 2024-04-26T23:11:04.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26 23:11:04 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:11:04.542 INFO:teuthology.orchestra.run.smithi071.stderr:FINISHED --2024-04-26 23:11:04-- 2024-04-26T23:11:04.542 INFO:teuthology.orchestra.run.smithi071.stderr:Total wall clock time: 1.7s 2024-04-26T23:11:04.542 INFO:teuthology.orchestra.run.smithi071.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-04-26T23:11:04.546 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-26T23:11:04.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:11:04.736 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:11:05.152 INFO:teuthology.orchestra.run.smithi039.stderr:Updating files: 44% (1510/3390) Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 58% (1990/3390) Updating files: 59% (2001/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2344/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 82% (2792/3390) Updating files: 83% (2814/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:11:05.158 INFO:teuthology.orchestra.run.smithi039.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:11:05.180 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T23:11:05.180 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:11:05.326 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:05.326 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:11:05.328 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi039.front.sepia.ceph.com to complete... 2024-04-26T23:11:06.764 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:11:06.768 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:11:06.876 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:11:07.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26 23:11:07 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:11:07.027 INFO:teuthology.orchestra.run.smithi039.stderr:FINISHED --2024-04-26 23:11:07-- 2024-04-26T23:11:07.027 INFO:teuthology.orchestra.run.smithi039.stderr:Total wall clock time: 1.7s 2024-04-26T23:11:07.027 INFO:teuthology.orchestra.run.smithi039.stderr:Downloaded: 1 files, 43M in 1.6s (27.5 MB/s) 2024-04-26T23:11:07.031 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T23:11:07.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:11:07.277 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:11:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:11:09.272 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:11:09.401 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:11:10.477 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:11:10.579 INFO:teuthology.orchestra.run.smithi071.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:13.410 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:11:13.517 INFO:teuthology.orchestra.run.smithi039.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:32.022 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:11:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:11:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-04-26T23:11:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:32.354 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:11:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:11:32.714 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:11:32.868 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:11:32.868 INFO:teuthology.orchestra.run.smithi071.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:11:32.868 INFO:teuthology.orchestra.run.smithi071.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:11:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-04-26T23:11:33.067 DEBUG:teuthology.orchestra.run.smithi071:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:11:33.075 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:11:33.075 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:11:33.075 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:11:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:11:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:11:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:11:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:11:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:11:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:11:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:11:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:11:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:11:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:11:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:11:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:11:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:11:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:11:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:11:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:11:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:11:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:11:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:11:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:11:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:11:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:11:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:11:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:11:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:11:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:11:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:11:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:11:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:11:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:11:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:11:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:11:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:11:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:11:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:11:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:11:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:11:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:11:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:11:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:11:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:11:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:11:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:11:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:11:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:11:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:11:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:11:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:11:33.232 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:11:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:11:33.234 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:11:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:11:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:11:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:11:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:11:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:11:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:11:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:11:33.242 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:11:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:11:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:11:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:11:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:11:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:11:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:11:33.249 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:11:33.250 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:11:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:11:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:11:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:11:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:11:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:11:33.256 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:11:33.257 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:11:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:11:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:11:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:11:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:11:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:11:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:11:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:11:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:11:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:11:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:11:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:11:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:11:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:11:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:11:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:11:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:11:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:11:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:11:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:11:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:11:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:11:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:11:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:11:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:11:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:11:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:11:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:11:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:11:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:11:33.364 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:11:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:11:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:11:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:11:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:11:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:11:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:11:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:11:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:11:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:11:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:11:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:11:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:11:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:11:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:11:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:11:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:11:33.381 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:11:33.382 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:11:33.383 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:11:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:11:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:11:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:11:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:11:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:11:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:11:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:11:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:11:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:11:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:11:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:11:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:11:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:11:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:11:33.398 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:11:33.399 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:11:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:11:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:11:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:11:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:11:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:11:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:11:33.406 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:11:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:11:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:11:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:11:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:11:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:11:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:11:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:11:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:11:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:11:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:11:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:11:33.418 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:11:33.419 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:11:33.420 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:11:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:11:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:11:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:11:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:11:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:11:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:11:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:11:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:11:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:11:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:11:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:11:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:11:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:11:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:11:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:11:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:11:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:11:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:11:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:11:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:11:33.481 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:11:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:11:33.483 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:11:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:11:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:11:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:11:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:11:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:11:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:11:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:11:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:11:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:11:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:11:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:11:33.495 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:11:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:11:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:11:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:11:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:11:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:11:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:11:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:11:33.503 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:11:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:11:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:11:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:11:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:11:33.511 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.511 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.512 DEBUG:teuthology.orchestra.run.smithi071:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:11:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:33.521 INFO:teuthology.orchestra.run.smithi071.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:33.521 INFO:teuthology.orchestra.run.smithi071.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:33.521 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:11:33.522 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:33.522 DEBUG:teuthology.orchestra.run.smithi071:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:11:33.564 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi071.front.sepia.ceph.com to complete... 2024-04-26T23:11:33.888 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:11:33.889 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:11:33.919 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-04-26T23:11:34.096 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:34.102 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:11:34.328 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:11:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:11:34.374 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:11:34.505 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:11:34.506 INFO:teuthology.orchestra.run.smithi071.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:11:34.506 INFO:teuthology.orchestra.run.smithi071.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:11:34.518 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-04-26T23:11:36.119 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:11:36.133 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:11:36.157 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-04-26T23:11:36.459 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:36.820 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:11:36.834 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:11:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:11:36.902 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:11:37.054 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:11:37.054 INFO:teuthology.orchestra.run.smithi039.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:11:37.055 INFO:teuthology.orchestra.run.smithi039.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:11:37.090 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-04-26T23:11:37.277 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:11:37.328 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:11:37.328 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:11:37.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.347 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.347 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:37.368 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:11:37.369 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:11:37.369 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:11:37.369 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:11:37.369 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:11:37.371 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:11:37.371 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:11:37.371 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:11:37.372 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:11:37.373 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:11:37.374 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:11:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:11:37.390 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:11:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:11:37.392 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:11:37.393 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:11:37.394 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:11:37.395 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:11:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:11:37.397 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:11:37.398 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:11:37.399 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:11:37.432 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:11:37.432 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:11:37.432 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:11:37.433 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:11:37.434 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:11:37.435 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:11:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:11:37.437 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:11:37.438 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:11:37.439 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:11:37.440 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:11:37.441 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:11:37.442 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:11:37.443 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:11:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:11:37.445 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:11:37.446 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:11:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:11:37.448 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:11:37.449 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:11:37.450 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:11:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:11:37.452 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:11:37.453 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:11:37.454 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:11:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:11:37.456 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:11:37.457 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:11:37.458 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:11:37.459 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:11:37.460 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:11:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:11:37.484 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:11:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:11:37.486 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:11:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:11:37.488 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:11:37.489 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:11:37.490 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:11:37.491 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:11:37.492 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:11:37.493 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:11:37.494 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:11:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:11:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:11:37.497 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:11:37.498 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:11:37.499 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:11:37.500 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:11:37.501 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:11:37.502 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:11:37.503 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:11:37.504 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:11:37.505 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:11:37.506 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:11:37.534 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:11:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:11:37.536 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:11:37.537 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:11:37.538 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:11:37.539 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:11:37.540 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:11:37.541 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:11:37.542 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:11:37.543 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:11:37.544 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:11:37.545 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:11:37.546 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:11:37.547 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:11:37.548 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:11:37.549 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:11:37.550 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:11:37.551 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:11:37.552 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:11:37.553 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:11:37.554 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:11:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:11:37.556 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:11:37.557 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:11:37.558 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:11:37.559 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:11:37.590 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:11:37.591 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:11:37.592 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:11:37.593 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:11:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:11:37.595 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:11:37.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:11:37.597 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:11:37.598 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:11:37.599 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:11:37.600 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:11:37.601 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:11:37.602 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:11:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:11:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:11:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:11:37.606 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:11:37.607 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:11:37.608 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:11:37.609 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:11:37.610 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:11:37.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:11:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:11:37.613 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:11:37.614 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:11:37.615 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:11:37.615 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:11:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:11:37.628 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:11:37.629 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:11:37.630 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:11:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:11:37.632 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:11:37.633 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:11:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:11:37.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:11:37.636 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:11:37.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:11:37.638 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:11:37.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:11:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:11:37.646 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:11:37.647 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:11:37.648 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:11:37.649 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:11:37.650 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:11:37.651 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:11:37.651 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:11:37.651 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:11:37.651 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:11:37.651 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:11:37.652 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:11:37.653 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:11:37.653 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:11:37.653 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:11:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:11:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:11:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:11:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:11:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:11:37.660 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:11:37.661 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:11:37.664 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:11:37.665 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:11:37.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:11:37.668 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:11:37.669 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:11:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:11:37.685 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:11:37.686 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:11:37.687 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:11:37.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:11:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:11:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:11:37.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:11:37.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:11:37.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:11:37.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:11:37.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:11:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:11:37.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:11:37.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:11:37.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:11:37.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:11:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:11:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:11:37.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:11:37.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:11:37.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:11:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:11:37.722 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:11:37.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:11:37.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:11:37.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:11:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:11:37.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:11:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:11:37.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:11:37.734 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.734 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.734 DEBUG:teuthology.orchestra.run.smithi039:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:11:37.763 INFO:teuthology.orchestra.run.smithi039.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:37.763 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:37.763 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:11:37.765 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:11:37.765 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:37.765 DEBUG:teuthology.orchestra.run.smithi039:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:11:37.807 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi039.front.sepia.ceph.com to complete... 2024-04-26T23:11:38.215 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:11:38.216 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:11:38.227 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-04-26T23:11:38.406 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:11:38.653 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:11:38.659 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:11:38.703 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:11:38.708 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:11:38.847 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:11:38.848 INFO:teuthology.orchestra.run.smithi039.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:11:38.848 INFO:teuthology.orchestra.run.smithi039.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:11:38.858 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-04-26T23:12:05.650 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-26T23:12:05.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:12:05.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:12:09.994 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T23:12:09.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:12:09.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:12:40.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-26T23:12:44.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-04-26T23:12:49.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:12:49.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:12:53.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:12:53.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:12:56.638 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-04-26T23:13:07.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-26T23:13:08.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:13:08.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:13:19.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:13:19.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:13:19.628 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-26T23:13:34.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:13:34.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:13:34.850 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-26T23:13:35.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:13:35.466 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:13:35.466 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-26T23:13:35.515 INFO:teuthology.orchestra.run.smithi071.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:13:35.515 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:13:35.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:13:35.515 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:13:36.516 DEBUG:teuthology.parallel:result is None 2024-04-26T23:14:08.643 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T23:14:23.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:14:23.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:14:23.836 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-04-26T23:14:24.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:14:24.753 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:14:24.754 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-04-26T23:14:24.805 INFO:teuthology.orchestra.run.smithi039.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:14:24.805 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:14:24.805 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:14:24.805 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:14:25.806 DEBUG:teuthology.parallel:result is None 2024-04-26T23:14:25.806 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T23:14:25.818 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T23:14:25.818 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:14:25.821 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:14:25.830 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T23:14:25.866 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T23:14:25.872 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T23:14:25.873 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:14:25.876 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:14:25.900 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T23:14:25.910 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T23:14:25.910 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:14:25.936 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:14:26.037 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:14:26.054 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:14:26.056 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:14:26.083 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:14:26.086 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T23:14:26.093 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T23:14:26.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:14:26.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:14:26.116 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T23:14:26.151 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T23:14:26.151 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:14:26.163 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:14:26.171 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:14:26.225 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:14:26.277 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:14:26.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:14:26.347 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:14:26.356 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:14:26.408 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:14:26.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:14:26.490 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-04-26T23:14:26.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-04-26T23:14:26.666 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T23:14:26.674 INFO:teuthology.task.internal:Starting timer... 2024-04-26T23:14:26.674 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T23:14:26.684 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T23:14:26.693 DEBUG:teuthology.task.selinux:Excluding smithi039: OS 'ubuntu' does not support SELinux 2024-04-26T23:14:26.693 DEBUG:teuthology.task.selinux:Excluding smithi071: OS 'ubuntu' does not support SELinux 2024-04-26T23:14:26.694 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T23:14:26.694 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T23:14:26.694 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T23:14:26.694 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T23:14:26.704 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T23:14:26.724 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T23:14:26.730 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:22:17.274 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-04-26T23:22:17.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:22:17.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:22:17.364 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-04-26T23:22:17.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-04-26T23:22:17.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:22:17.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:22:17.589 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-26T23:22:17.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T23:22:17.706 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:22:17.719 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:22:17.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:22:17.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:22:17.723 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:22:17.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Command line: ntpd -gq 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: ---------------------------------------------------- 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:22:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: corporation. Support and training for ntp-4 are 2024-04-26T23:22:17.761 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: available at https://www.nwtime.org/support 2024-04-26T23:22:17.761 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: ---------------------------------------------------- 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: proto: precision = 0.042 usec (-24) 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: basedate set to 2022-02-04 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:22:17.762 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:22:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen normally on 3 ens1f0 172.21.15.39:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen normally on 4 lo [::1]:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1370%4]:123 2024-04-26T23:22:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:17 ntpd[17103]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Command line: ntpd -gq 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: ---------------------------------------------------- 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: corporation. Support and training for ntp-4 are 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: available at https://www.nwtime.org/support 2024-04-26T23:22:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: ---------------------------------------------------- 2024-04-26T23:22:17.789 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: proto: precision = 0.041 usec (-24) 2024-04-26T23:22:17.789 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: basedate set to 2022-02-04 2024-04-26T23:22:17.789 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:22:17.789 INFO:teuthology.orchestra.run.smithi071.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:22:17.790 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:22:17.790 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:22:17.790 INFO:teuthology.orchestra.run.smithi071.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen normally on 3 enp3s0f1 172.21.15.71:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen normally on 4 lo [::1]:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d765%5]:123 2024-04-26T23:22:17.791 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:17 ntpd[17194]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:18 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:18 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:18 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:19.788 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:19.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:19.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:19.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:19.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:19.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:19 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:20.761 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:20 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:20 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:21 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:22 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:22 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:23 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:24.761 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.762 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:24.763 INFO:teuthology.orchestra.run.smithi039.stdout:26 Apr 23:22:24 ntpd[17103]: ntpd: time slew -0.000560 s 2024-04-26T23:22:24.764 INFO:teuthology.orchestra.run.smithi039.stdout:ntpd: time slew -0.000560s 2024-04-26T23:22:24.764 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:22:24.765 INFO:teuthology.orchestra.run.smithi039.stderr:26 Apr 23:22:24 ntpd[17103]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:22:24.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:24 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:24.861 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:22:24.861 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2024-04-26T23:22:24.862 INFO:teuthology.orchestra.run.smithi039.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:24.862 INFO:teuthology.orchestra.run.smithi039.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:24.862 INFO:teuthology.orchestra.run.smithi039.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:24.862 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stdout:26 Apr 23:22:25 ntpd[17194]: ntpd: time slew -0.001216 s 2024-04-26T23:22:25.789 INFO:teuthology.orchestra.run.smithi071.stdout:ntpd: time slew -0.001216s 2024-04-26T23:22:25.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:22:25.790 INFO:teuthology.orchestra.run.smithi071.stderr:26 Apr 23:22:25 ntpd[17194]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:25.883 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:22:25.884 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:22:25.896 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:22:25.897 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:22:25.897 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:22:25.897 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:22:25.903 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:22:25.903 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:22:25.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-key list | grep Ceph 2024-04-26T23:22:25.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-key list | grep Ceph 2024-04-26T23:22:26.013 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:22:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:22:26.066 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:22:26.066 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:22:26.067 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:22:26.067 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:22:26.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:22:26.079 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:22:26.079 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:22:26.080 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:22:26.080 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:22:26.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:22:26.212 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:22:26.212 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:22:26.230 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:22:26.230 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:22:26.347 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:22:26.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:22:26.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-04-26T23:22:26.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:22:26.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:22:26.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2024-04-26T23:22:26.627 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:22:26.643 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:22:26.670 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:22:26.688 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:22:26.729 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:22:26.733 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:22:26.741 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:22:26.754 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:22:26.766 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:22:26.778 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:22:26.805 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:22:26.816 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:22:26.817 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:22:26.834 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:22:26.856 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:22:26.888 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:22:26.899 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:22:26.904 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:22:27.212 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 29.2 kB in 1s (46.7 kB/s) 2024-04-26T23:22:27.251 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 29.2 kB in 1s (48.4 kB/s) 2024-04-26T23:22:28.197 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-26T23:22:28.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:22:28.285 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-26T23:22:28.295 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-04-26T23:22:28.311 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:22:28.389 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-04-26T23:22:28.458 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-04-26T23:22:28.459 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-04-26T23:22:28.568 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-04-26T23:22:28.568 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-04-26T23:22:28.632 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:22:28.632 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:22:28.632 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:22:28.632 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:22:28.633 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:22:28.633 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:22:28.633 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:22:28.634 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-04-26T23:22:28.634 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:22:28.634 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:22:28.634 INFO:teuthology.orchestra.run.smithi071.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:22:28.634 INFO:teuthology.orchestra.run.smithi071.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:22:28.635 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:22:28.635 INFO:teuthology.orchestra.run.smithi071.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:22:28.636 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:22:28.637 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2024-04-26T23:22:28.638 INFO:teuthology.orchestra.run.smithi071.stdout: btrfs-tools 2024-04-26T23:22:28.747 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:22:28.747 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:22:28.747 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:22:28.747 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:22:28.748 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:22:28.748 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:22:28.748 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:22:28.750 INFO:teuthology.orchestra.run.smithi039.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:22:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:22:28.752 INFO:teuthology.orchestra.run.smithi039.stdout:Recommended packages: 2024-04-26T23:22:28.753 INFO:teuthology.orchestra.run.smithi039.stdout: btrfs-tools 2024-04-26T23:22:28.785 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-04-26T23:22:28.785 INFO:teuthology.orchestra.run.smithi071.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:22:28.785 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:22:28.785 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:22:28.785 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:22:28.786 INFO:teuthology.orchestra.run.smithi071.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:22:28.786 INFO:teuthology.orchestra.run.smithi071.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:22:28.786 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:22:28.786 INFO:teuthology.orchestra.run.smithi071.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:22:28.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:22:28.788 INFO:teuthology.orchestra.run.smithi071.stdout: socat unzip xmlstarlet zip 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:22:28.908 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:22:28.909 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:22:28.909 INFO:teuthology.orchestra.run.smithi039.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:22:28.910 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:22:28.911 INFO:teuthology.orchestra.run.smithi039.stdout: socat unzip xmlstarlet zip 2024-04-26T23:22:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:22:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 182 MB of archives. 2024-04-26T23:22:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:22:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:22:28.982 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:22:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:22:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 182 MB of archives. 2024-04-26T23:22:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:22:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:22:29.008 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:22:29.021 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:22:29.065 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:22:29.070 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:22:29.094 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:22:29.098 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:22:29.110 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:22:29.111 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:22:29.160 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:22:29.165 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:22:29.170 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:22:29.171 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:22:29.176 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:22:29.179 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:22:29.179 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:22:29.187 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:22:29.189 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:22:29.191 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:22:29.192 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:22:29.194 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:22:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:22:29.216 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:22:29.217 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:22:29.218 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:22:29.219 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:22:29.219 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:22:29.220 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:22:29.220 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:22:29.221 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:22:29.239 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:22:29.240 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:22:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:22:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:22:29.263 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:22:29.263 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:22:29.264 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:22:29.265 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:22:29.265 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:22:29.265 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:22:29.273 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:22:29.281 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:22:29.282 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:22:29.296 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:22:29.302 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:22:29.307 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:22:29.307 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:22:29.308 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:22:29.309 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:22:29.309 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:22:29.309 INFO:teuthology.orchestra.run.smithi039.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:22:29.309 INFO:teuthology.orchestra.run.smithi039.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:22:29.311 INFO:teuthology.orchestra.run.smithi039.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:22:29.312 INFO:teuthology.orchestra.run.smithi039.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:22:29.314 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:22:29.316 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:22:29.317 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:22:29.322 INFO:teuthology.orchestra.run.smithi039.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:22:29.323 INFO:teuthology.orchestra.run.smithi039.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:22:29.328 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:22:29.345 INFO:teuthology.orchestra.run.smithi039.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:22:29.346 INFO:teuthology.orchestra.run.smithi039.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:22:29.346 INFO:teuthology.orchestra.run.smithi039.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:22:29.347 INFO:teuthology.orchestra.run.smithi039.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:22:29.413 INFO:teuthology.orchestra.run.smithi039.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:22:29.414 INFO:teuthology.orchestra.run.smithi039.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:22:29.415 INFO:teuthology.orchestra.run.smithi039.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:22:29.415 INFO:teuthology.orchestra.run.smithi039.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:22:29.417 INFO:teuthology.orchestra.run.smithi039.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:22:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:22:29.429 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:22:29.445 INFO:teuthology.orchestra.run.smithi039.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:22:29.447 INFO:teuthology.orchestra.run.smithi039.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:22:29.447 INFO:teuthology.orchestra.run.smithi039.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:22:29.474 INFO:teuthology.orchestra.run.smithi039.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:22:29.479 INFO:teuthology.orchestra.run.smithi039.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:22:29.479 INFO:teuthology.orchestra.run.smithi039.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:22:29.480 INFO:teuthology.orchestra.run.smithi039.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:22:29.481 INFO:teuthology.orchestra.run.smithi039.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:22:29.481 INFO:teuthology.orchestra.run.smithi039.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:22:29.482 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:22:29.502 INFO:teuthology.orchestra.run.smithi039.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:22:29.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:22:29.506 INFO:teuthology.orchestra.run.smithi039.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:22:29.508 INFO:teuthology.orchestra.run.smithi039.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:22:29.510 INFO:teuthology.orchestra.run.smithi039.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:22:29.524 INFO:teuthology.orchestra.run.smithi039.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:22:29.528 INFO:teuthology.orchestra.run.smithi039.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:22:29.532 INFO:teuthology.orchestra.run.smithi039.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:22:29.532 INFO:teuthology.orchestra.run.smithi039.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:22:29.533 INFO:teuthology.orchestra.run.smithi039.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:22:29.546 INFO:teuthology.orchestra.run.smithi039.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:22:29.552 INFO:teuthology.orchestra.run.smithi039.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:22:29.552 INFO:teuthology.orchestra.run.smithi039.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:22:29.556 INFO:teuthology.orchestra.run.smithi039.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:22:29.556 INFO:teuthology.orchestra.run.smithi039.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:22:29.564 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:22:29.565 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:22:29.569 INFO:teuthology.orchestra.run.smithi039.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:22:29.569 INFO:teuthology.orchestra.run.smithi039.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:22:29.571 INFO:teuthology.orchestra.run.smithi039.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:22:29.572 INFO:teuthology.orchestra.run.smithi039.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:22:29.581 INFO:teuthology.orchestra.run.smithi039.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:22:29.582 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:22:29.596 INFO:teuthology.orchestra.run.smithi039.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:22:29.596 INFO:teuthology.orchestra.run.smithi039.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:22:29.599 INFO:teuthology.orchestra.run.smithi039.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:22:29.599 INFO:teuthology.orchestra.run.smithi039.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:22:29.658 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:22:29.667 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:22:29.695 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:22:29.703 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:22:29.869 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:22:30.485 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:22:30.656 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:22:30.662 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:22:30.666 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:22:30.723 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:22:30.947 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:22:31.124 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:22:31.256 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:22:31.314 INFO:teuthology.orchestra.run.smithi039.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:22:31.370 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:22:31.427 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:22:31.434 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:22:31.673 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:22:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:22:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:22:31.812 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:22:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:22:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:22:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:22:31.943 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:22:32.032 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:22:32.071 INFO:teuthology.orchestra.run.smithi071.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:22:32.099 INFO:teuthology.orchestra.run.smithi039.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:22:32.149 INFO:teuthology.orchestra.run.smithi071.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:22:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:22:32.250 INFO:teuthology.orchestra.run.smithi039.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:22:32.324 INFO:teuthology.orchestra.run.smithi039.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:22:32.330 INFO:teuthology.orchestra.run.smithi039.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:22:32.359 INFO:teuthology.orchestra.run.smithi039.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:22:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:22:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:22:32.375 INFO:teuthology.orchestra.run.smithi039.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:22:32.432 INFO:teuthology.orchestra.run.smithi071.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:22:32.433 INFO:teuthology.orchestra.run.smithi039.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:22:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:22:32.523 INFO:teuthology.orchestra.run.smithi071.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:22:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:22:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:22:32.636 INFO:teuthology.orchestra.run.smithi071.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:22:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:22:32.856 INFO:teuthology.orchestra.run.smithi071.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:22:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:22:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:22:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:22:33.067 INFO:teuthology.orchestra.run.smithi071.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:22:33.153 INFO:teuthology.orchestra.run.smithi071.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:22:33.165 INFO:teuthology.orchestra.run.smithi071.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:22:33.348 INFO:teuthology.orchestra.run.smithi071.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:22:33.377 INFO:teuthology.orchestra.run.smithi039.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:22:33.386 INFO:teuthology.orchestra.run.smithi039.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:22:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:22:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:22:33.439 INFO:teuthology.orchestra.run.smithi039.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:22:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:22:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:22:33.574 INFO:teuthology.orchestra.run.smithi071.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:22:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:22:33.593 INFO:teuthology.orchestra.run.smithi071.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:22:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:22:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:22:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:22:34.218 INFO:teuthology.orchestra.run.smithi071.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:22:34.306 INFO:teuthology.orchestra.run.smithi071.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:22:34.315 INFO:teuthology.orchestra.run.smithi071.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:22:34.328 INFO:teuthology.orchestra.run.smithi071.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:22:34.369 INFO:teuthology.orchestra.run.smithi071.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:22:34.637 INFO:teuthology.orchestra.run.smithi071.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:22:34.638 INFO:teuthology.orchestra.run.smithi071.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:22:34.639 INFO:teuthology.orchestra.run.smithi071.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:22:34.805 INFO:teuthology.orchestra.run.smithi071.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:22:34.920 INFO:teuthology.orchestra.run.smithi071.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:22:34.921 INFO:teuthology.orchestra.run.smithi071.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:22:34.925 INFO:teuthology.orchestra.run.smithi071.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:22:34.926 INFO:teuthology.orchestra.run.smithi071.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:22:34.928 INFO:teuthology.orchestra.run.smithi071.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:22:34.931 INFO:teuthology.orchestra.run.smithi071.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:22:35.150 INFO:teuthology.orchestra.run.smithi071.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:22:35.544 INFO:teuthology.orchestra.run.smithi039.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:22:35.559 INFO:teuthology.orchestra.run.smithi071.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:22:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:22:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:22:35.640 INFO:teuthology.orchestra.run.smithi071.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:22:35.640 INFO:teuthology.orchestra.run.smithi071.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:22:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:22:35.642 INFO:teuthology.orchestra.run.smithi071.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:22:35.643 INFO:teuthology.orchestra.run.smithi071.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:22:35.643 INFO:teuthology.orchestra.run.smithi071.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:22:35.709 INFO:teuthology.orchestra.run.smithi071.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:22:35.810 INFO:teuthology.orchestra.run.smithi071.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:22:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:22:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:22:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:22:35.882 INFO:teuthology.orchestra.run.smithi039.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:22:36.016 INFO:teuthology.orchestra.run.smithi071.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:22:36.107 INFO:teuthology.orchestra.run.smithi039.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:22:36.602 INFO:teuthology.orchestra.run.smithi071.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:22:36.875 INFO:teuthology.orchestra.run.smithi071.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:22:36.883 INFO:teuthology.orchestra.run.smithi039.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:22:36.884 INFO:teuthology.orchestra.run.smithi039.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:22:36.905 INFO:teuthology.orchestra.run.smithi039.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:22:36.990 INFO:teuthology.orchestra.run.smithi039.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:22:37.019 INFO:teuthology.orchestra.run.smithi039.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:22:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:22:37.096 INFO:teuthology.orchestra.run.smithi071.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:22:37.106 INFO:teuthology.orchestra.run.smithi039.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:22:37.168 INFO:teuthology.orchestra.run.smithi071.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:22:37.407 INFO:teuthology.orchestra.run.smithi039.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:22:37.408 INFO:teuthology.orchestra.run.smithi039.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:22:37.553 INFO:teuthology.orchestra.run.smithi071.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:22:37.751 INFO:teuthology.orchestra.run.smithi071.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:22:37.767 INFO:teuthology.orchestra.run.smithi071.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:22:37.816 INFO:teuthology.orchestra.run.smithi071.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:22:37.837 INFO:teuthology.orchestra.run.smithi071.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:22:38.318 INFO:teuthology.orchestra.run.smithi071.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:22:38.576 INFO:teuthology.orchestra.run.smithi071.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:22:38.836 INFO:teuthology.orchestra.run.smithi071.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:22:38.838 INFO:teuthology.orchestra.run.smithi071.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:22:38.854 INFO:teuthology.orchestra.run.smithi071.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:22:38.859 INFO:teuthology.orchestra.run.smithi071.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:22:38.897 INFO:teuthology.orchestra.run.smithi071.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:22:38.911 INFO:teuthology.orchestra.run.smithi071.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:22:39.001 INFO:teuthology.orchestra.run.smithi071.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:22:39.002 INFO:teuthology.orchestra.run.smithi071.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:22:39.004 INFO:teuthology.orchestra.run.smithi071.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:22:39.186 INFO:teuthology.orchestra.run.smithi071.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:22:39.242 INFO:teuthology.orchestra.run.smithi039.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:22:39.243 INFO:teuthology.orchestra.run.smithi039.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:22:39.246 INFO:teuthology.orchestra.run.smithi039.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:22:39.246 INFO:teuthology.orchestra.run.smithi039.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:22:39.246 INFO:teuthology.orchestra.run.smithi039.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:22:39.247 INFO:teuthology.orchestra.run.smithi039.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:22:39.452 INFO:teuthology.orchestra.run.smithi071.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:22:39.696 INFO:teuthology.orchestra.run.smithi039.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:22:40.357 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 182 MB in 11s (16.9 MB/s) 2024-04-26T23:22:40.504 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:22:40.552 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 182 MB in 11s (16.3 MB/s) 2024-04-26T23:22:40.572 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:22:40.576 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:22:40.628 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:22:40.699 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:22:40.765 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:22:40.768 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:22:40.806 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:22:40.930 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:22:40.944 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:22:40.989 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:22:41.092 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:22:41.105 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:22:41.142 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:22:41.300 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:22:41.314 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:22:41.350 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:22:41.686 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:22:41.701 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:22:41.787 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:22:41.856 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:22:41.869 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:22:41.956 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:22:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:22:42.130 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:22:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:22:42.293 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:22:42.307 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:22:42.343 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:22:42.485 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:22:42.501 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:22:42.543 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:22:42.654 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:22:42.669 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:22:42.712 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:22:42.996 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:22:43.012 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:43.063 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:43.091 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:22:43.106 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:43.148 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:43.433 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:22:43.447 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:43.482 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:43.560 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:22:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:43.635 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:43.861 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:22:43.876 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:43.919 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:43.988 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:22:44.003 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:22:44.046 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:22:44.280 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:22:44.296 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:22:44.339 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:22:44.433 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:22:44.448 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:22:44.483 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:22:44.625 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librados2. 2024-04-26T23:22:44.640 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:44.675 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:44.769 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librados2. 2024-04-26T23:22:44.784 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:45.069 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:22:45.084 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:45.144 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:45.255 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:22:45.270 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:45.313 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:45.574 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:22:45.589 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:45.749 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:22:45.755 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:45.763 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:45.808 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.041 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:22:46.056 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:46.077 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:22:46.091 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:46.099 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.127 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.394 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:22:46.409 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:22:46.437 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:22:46.443 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.452 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:22:46.496 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.688 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:22:46.703 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:46.746 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:46.774 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:22:46.788 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:47.074 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:22:47.089 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:22:47.132 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:47.143 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:22:47.158 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:22:47.201 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:47.469 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:22:47.484 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:22:47.496 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:22:47.510 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:22:47.527 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:22:47.554 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:22:47.779 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:22:47.795 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:47.829 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:47.840 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:22:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:47.898 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:48.140 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:22:48.156 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:22:48.198 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:22:48.226 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:22:48.241 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:22:48.284 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:22:48.493 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:22:48.508 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:22:48.545 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:22:48.551 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:22:48.559 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:22:48.595 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:22:48.838 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:22:48.853 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:22:48.887 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:22:49.065 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:22:49.079 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:22:49.123 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:22:49.216 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:22:49.232 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:22:49.274 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:22:49.443 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:22:49.457 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:22:49.501 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:22:49.616 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:22:49.631 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:22:49.677 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:22:49.795 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:22:49.810 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:22:49.854 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:22:49.913 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package zip. 2024-04-26T23:22:49.928 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:22:49.963 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:22:50.056 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package zip. 2024-04-26T23:22:50.070 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:22:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:22:50.291 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package unzip. 2024-04-26T23:22:50.305 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:22:50.349 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:22:50.451 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package unzip. 2024-04-26T23:22:50.465 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:22:50.509 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:22:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:22:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:22:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:22:50.879 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:22:50.893 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:22:50.938 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:22:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:22:51.158 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:51.202 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:51.303 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:22:51.317 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:51.395 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:51.696 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:22:51.714 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:51.842 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:22:51.854 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:51.909 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:52.099 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:22:52.115 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:22:52.158 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:22:52.242 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:22:52.257 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:22:52.301 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:22:52.469 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:22:52.484 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:52.527 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:52.637 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:22:52.651 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:52.695 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:22:53.004 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:53.046 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:22:53.080 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:53.123 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:54.133 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:22:54.149 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:54.195 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:54.236 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:22:54.251 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:22:54.304 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:22:54.689 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:22:54.703 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:22:54.739 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:22:54.881 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:22:54.895 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:22:54.941 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:22:55.042 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:22:55.056 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:22:55.100 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:22:55.185 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:22:55.199 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:22:55.235 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:22:55.429 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:22:55.444 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:22:55.486 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:22:55.529 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:22:55.544 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:22:55.588 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:22:55.790 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:22:55.805 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:22:55.848 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:22:55.891 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:22:55.905 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:22:55.949 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:22:56.134 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:22:56.149 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:22:56.192 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:22:56.269 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:22:56.283 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:22:56.327 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:22:56.495 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:22:56.511 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:22:56.553 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:22:56.579 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:22:56.594 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:22:56.638 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:22:56.814 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:22:56.830 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:22:56.864 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:22:56.916 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:22:56.930 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:22:56.965 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:22:57.167 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:22:57.183 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:22:57.225 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:22:57.260 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:22:57.275 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:22:57.318 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:22:57.528 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:22:57.544 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:22:57.586 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:22:57.621 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:22:57.636 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:22:57.679 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:22:57.890 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:22:57.906 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:22:57.948 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:22:58.033 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:22:58.047 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:22:58.091 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:22:58.260 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:22:58.275 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:22:58.326 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:22:58.411 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:22:58.425 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:22:58.469 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:22:58.654 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:22:58.670 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:22:58.712 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:22:58.730 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:22:58.745 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:22:58.780 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:22:59.023 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:22:59.039 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:22:59.074 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:22:59.074 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:22:59.089 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:22:59.133 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:22:59.402 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:22:59.417 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:22:59.451 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:22:59.461 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:22:59.476 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:22:59.544 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:22:59.738 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:22:59.753 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:22:59.796 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:22:59.847 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:22:59.862 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:22:59.905 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:23:00.074 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:23:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:23:00.157 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:23:00.200 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:23:00.214 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:23:00.258 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:23:00.501 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:23:00.517 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:23:00.563 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:23:00.594 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:23:00.609 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:23:00.680 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:23:00.989 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:23:01.003 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:23:01.047 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:23:01.333 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:23:01.348 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:23:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:23:01.880 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:23:01.896 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:23:01.938 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:23:02.233 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:23:02.248 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:23:02.290 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:23:02.370 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:23:02.385 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:23:02.428 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:23:02.611 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:23:02.626 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:23:02.660 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:23:02.714 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:23:02.729 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:23:02.772 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:23:02.905 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:23:02.920 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:23:02.963 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:23:03.042 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:23:03.057 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:23:03.092 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:23:03.274 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:23:03.290 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:23:03.333 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:23:03.394 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:23:03.408 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:23:03.453 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:23:03.644 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:23:03.659 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:23:03.702 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:23:03.833 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:23:03.847 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:23:03.891 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:23:04.073 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:23:04.089 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:23:04.132 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:23:04.281 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:23:04.296 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:23:04.419 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:23:04.451 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:23:04.467 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:23:04.501 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:23:04.721 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:23:04.736 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:23:04.779 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:23:04.821 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:23:04.836 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:23:04.879 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:23:05.100 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:23:05.114 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:23:05.157 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:23:05.157 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:23:05.173 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:23:05.215 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:23:05.469 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:23:05.484 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:23:05.527 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:23:05.543 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:23:05.559 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:23:05.601 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:23:05.847 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:23:05.862 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:05.871 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:23:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:05.905 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:06.252 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:23:06.266 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:06.301 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:06.342 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:23:06.358 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:06.400 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:06.596 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:23:06.610 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:23:06.654 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:23:06.687 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:23:06.699 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:23:06.737 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:23:06.990 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:23:07.005 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:23:07.040 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:23:07.048 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:23:07.056 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:23:07.098 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:23:07.368 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:23:07.383 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:07.418 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:23:07.455 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:07.492 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:07.746 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:23:07.759 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:07.812 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:23:07.885 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:07.922 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:23:08.414 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:08.476 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:23:08.489 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:08.526 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:09.227 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph. 2024-04-26T23:23:09.241 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:09.285 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:09.371 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph. 2024-04-26T23:23:09.384 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:09.421 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:09.554 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:23:09.568 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:09.604 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:09.707 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:23:09.720 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:09.757 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:09.991 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:23:10.005 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:10.049 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:10.110 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:23:10.123 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:10.160 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:10.452 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:23:10.466 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:10.510 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:10.530 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:23:10.543 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:10.580 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:10.771 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:23:10.785 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:23:10.821 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:23:10.924 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:23:10.937 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:23:10.974 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:23:11.099 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:23:11.113 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:23:11.157 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:11.310 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:23:11.323 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:23:11.360 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:12.178 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:23:12.191 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:23:12.228 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:12.407 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:23:12.421 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:23:12.465 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:12.556 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:23:12.569 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:23:12.639 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:23:12.761 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:23:12.773 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:23:12.810 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:23:12.984 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:23:12.997 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:13.034 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:23:13.135 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:13.163 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:13.370 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:23:13.384 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:23:13.429 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:23:13.484 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:23:13.497 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:23:13.525 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:23:13.734 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:23:13.748 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:23:13.808 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:23:13.811 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:23:13.825 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:23:13.869 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:23:14.137 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:23:14.151 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:14.164 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:23:14.178 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:14.187 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:14.223 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:15.459 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:23:15.472 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:23:15.509 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:23:15.520 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:23:15.532 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:23:15.569 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:23:16.004 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:23:16.017 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:23:16.048 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:23:16.054 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:23:16.061 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:23:16.090 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:23:16.408 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:23:16.420 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:23:16.460 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:23:16.473 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:23:16.535 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:23:16.596 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:23:16.805 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:23:16.821 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:23:16.854 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:23:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:23:16.903 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:23:16.941 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:23:17.534 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:23:17.544 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:17.548 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:23:17.563 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:17.575 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:17.607 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:18.553 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:23:18.562 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:23:18.563 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:23:18.576 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:23:18.602 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:23:18.620 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:23:18.889 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:23:18.901 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:23:18.931 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:23:18.938 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:23:18.944 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:23:18.981 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:23:19.276 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:23:19.285 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:23:19.310 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:23:19.323 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:23:19.325 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:23:19.360 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:23:19.637 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:23:19.647 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:23:19.671 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:23:19.684 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:23:19.729 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:23:19.780 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:23:20.050 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:23:20.066 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:23:20.100 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:23:20.208 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:23:20.217 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:23:20.257 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:23:20.395 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:23:20.409 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:23:20.453 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:23:20.545 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:23:20.554 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:23:20.594 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:23:20.765 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:23:20.779 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:23:20.823 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:23:20.933 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:23:20.943 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:23:20.989 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:23:21.135 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:23:21.149 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:23:21.193 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:23:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:23:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:23:21.359 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:23:22.007 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:23:22.021 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:22.032 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:23:22.040 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:22.057 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:22.107 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:22.435 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:23:22.444 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:23:22.485 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:23:22.519 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:23:22.531 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:23:22.560 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:23:22.821 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:23:22.830 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:23:22.871 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:23:22.880 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:23:22.893 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:23:22.963 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:23:23.107 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package jq. 2024-04-26T23:23:23.116 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:23:23.157 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:23:23.233 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package jq. 2024-04-26T23:23:23.249 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:23:23.291 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:23:23.452 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package socat. 2024-04-26T23:23:23.462 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:23:23.502 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:23:23.519 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package socat. 2024-04-26T23:23:23.533 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:23:23.569 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:23:23.806 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:23:23.815 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:23:23.847 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:23:23.855 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:23:23.861 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:23:23.905 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:23:24.218 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:23:24.227 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:24.251 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:23:24.264 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:24.268 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:24.301 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:26.264 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:23:26.274 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:26.314 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:26.356 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:23:26.370 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:26.406 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:26.702 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:23:26.712 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:26.735 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:23:26.749 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:26.751 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:26.793 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.038 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:23:27.048 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:23:27.104 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:23:27.113 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:23:27.119 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:23:27.163 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:23:27.324 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:23:27.334 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:27.374 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.407 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:23:27.422 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:27.465 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.636 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:23:27.645 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:27.685 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.743 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:23:27.757 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:23:27.793 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.938 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:23:27.948 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:27.979 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:23:27.988 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:27.993 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:28.029 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:28.350 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:23:28.359 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:23:28.368 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:23:28.380 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:23:28.399 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:23:28.423 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:23:28.713 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:23:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:23:28.761 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:23:28.762 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:23:28.776 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:23:28.819 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:23:29.133 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:23:29.143 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:23:29.182 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:23:29.183 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:23:29.196 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:23:29.249 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:23:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:23:29.623 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:23:29.637 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:23:29.652 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:23:29.663 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:23:29.695 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:23:29.883 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:23:29.893 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:23:29.924 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:23:29.966 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:23:29.980 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:23:30.023 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:23:30.295 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:23:30.304 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:23:30.336 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:23:30.468 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:23:30.482 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:23:30.526 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:23:30.656 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:23:30.665 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:23:30.706 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:23:30.813 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:23:30.827 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:23:30.863 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:23:31.026 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:23:31.036 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:23:31.076 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:23:31.142 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:23:31.156 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:23:31.199 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:23:31.354 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:23:31.364 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:23:31.404 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:23:31.511 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:23:31.525 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:23:31.569 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:23:31.757 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:23:31.767 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:23:31.807 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:23:31.906 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:23:31.920 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:23:31.964 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:23:32.119 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:23:32.132 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:23:32.177 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:23:32.309 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:23:32.323 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:23:32.367 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:23:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:23:32.600 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:23:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:23:32.830 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:23:32.843 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:23:32.888 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:23:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:23:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:23:33.026 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:23:33.133 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:23:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:23:33.182 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:23:33.304 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:23:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:23:33.346 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:23:33.485 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:23:33.499 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:23:33.543 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:23:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:23:33.702 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:23:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:23:33.872 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:23:33.886 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:23:33.922 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:23:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:23:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:23:34.086 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:23:34.167 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:23:34.181 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:23:34.225 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:23:34.723 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:23:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:34.773 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:34.920 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:23:34.934 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:34.970 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:35.657 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:23:35.671 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:35.718 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:23:35.730 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:23:35.768 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:36.026 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:23:36.060 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:23:36.295 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:23:36.365 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:23:36.421 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:23:36.483 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:23:36.695 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:23:36.722 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:23:37.113 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:23:37.131 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:23:37.781 INFO:teuthology.orchestra.run.smithi039.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:23:37.796 INFO:teuthology.orchestra.run.smithi071.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:23:37.810 INFO:teuthology.orchestra.run.smithi071.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:23:37.860 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:37.914 INFO:teuthology.orchestra.run.smithi039.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:23:38.016 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:38.404 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user cephadm....done 2024-04-26T23:23:38.567 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:23:38.593 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user cephadm....done 2024-04-26T23:23:38.747 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:23:38.851 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:23:39.119 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:23:39.157 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:23:39.245 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:23:39.467 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:23:39.505 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:23:39.576 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:23:39.773 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:23:39.844 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:23:39.916 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:23:40.145 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:23:40.218 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:23:40.271 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:23:40.586 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:23:40.589 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:23:40.854 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:23:40.942 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:23:41.147 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:23:41.193 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:23:41.424 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:23:41.462 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:23:41.659 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:23:41.754 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:23:41.944 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:23:42.064 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:23:42.211 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:23:42.340 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:23:42.479 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:42.616 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:23:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:23:42.876 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:42.881 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:23:43.007 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:23:43.281 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:23:43.385 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:23:43.468 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:23:43.594 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:23:43.645 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:23:43.721 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:23:43.988 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:23:44.069 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:23:44.100 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:23:44.114 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:23:44.164 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:23:44.274 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:23:44.382 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:23:44.617 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:44.743 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:23:44.745 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:23:44.805 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:23:44.869 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:23:44.995 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:23:45.027 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:23:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:23:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:45.497 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:23:45.630 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:23:45.756 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:23:45.782 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:23:46.050 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:23:46.343 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:23:46.442 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:23:46.469 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:23:46.693 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:23:46.860 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:23:46.989 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:23:47.179 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:23:47.304 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:23:47.463 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:23:47.615 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:23:47.730 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:23:47.741 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:23:47.982 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:23:48.067 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:23:48.350 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:23:48.468 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:23:48.643 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:23:48.728 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:23:48.969 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:23:49.137 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:23:49.354 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:23:49.449 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:23:49.614 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:23:49.740 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:49.759 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:23:50.033 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:23:50.119 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:23:50.367 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:23:50.394 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:23:50.545 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:23:50.855 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:23:51.206 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:23:51.599 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:23:51.842 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:51.977 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:23:52.253 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:23:52.379 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:23:52.495 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:23:52.530 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:23:52.738 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:52.823 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:23:52.872 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:23:53.066 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:23:53.148 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:23:53.266 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:23:53.309 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:53.367 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:23:53.435 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:23:53.677 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:23:53.745 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:23:53.953 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:23:54.015 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:23:54.224 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:54.289 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:23:54.348 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:23:54.532 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:23:54.673 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:23:54.800 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:23:54.941 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:23:55.076 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:23:55.202 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:23:55.233 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:23:55.486 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:23:55.501 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:23:55.612 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:23:55.752 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:23:55.905 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:23:56.028 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:23:56.154 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:23:56.231 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:23:56.447 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:23:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:23:56.589 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:23:56.611 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:23:56.737 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:56.826 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:23:56.890 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:23:57.064 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:23:57.189 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:23:57.443 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:23:57.568 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:23:57.574 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:23:57.694 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:23:57.783 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:23:57.854 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:23:57.977 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:23:58.054 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:23:58.180 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:23:58.270 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:58.396 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:23:58.607 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:23:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:23:58.875 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:23:58.984 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:23:59.023 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:23:59.252 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:23:59.292 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:23:59.378 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:23:59.494 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:23:59.712 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:23:59.763 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:24:00.030 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:24:00.030 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:24:00.290 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:24:00.323 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:24:00.551 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:24:00.676 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:24:00.818 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:24:00.969 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:24:01.103 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:24:01.321 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:24:01.371 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:24:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:01.557 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:01.666 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:24:01.772 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:24:02.037 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.057 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:24:02.154 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.255 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:24:02.393 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:24:02.515 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.519 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.633 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.662 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.768 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:02.787 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:24:03.009 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:24:03.009 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:24:03.124 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.233 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.334 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:24:03.619 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.661 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.745 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.845 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:03.883 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:04.008 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:04.104 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:24:04.104 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:24:04.123 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:04.249 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:24:04.739 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:04.840 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:04.957 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:05.084 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:05.226 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:24:05.546 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:05.647 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:05.756 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:05.882 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.008 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.571 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.672 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.773 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:06.899 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:07.054 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:07.184 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:07.209 INFO:teuthology.orchestra.run.smithi071.stdout:Adding group ceph....done 2024-04-26T23:24:07.577 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user ceph....done 2024-04-26T23:24:07.754 INFO:teuthology.orchestra.run.smithi071.stdout:Setting system user ceph properties....done 2024-04-26T23:24:07.769 INFO:teuthology.orchestra.run.smithi071.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:24:07.778 INFO:teuthology.orchestra.run.smithi039.stdout:Adding group ceph....done 2024-04-26T23:24:07.908 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:24:08.155 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user ceph....done 2024-04-26T23:24:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:24:08.365 INFO:teuthology.orchestra.run.smithi039.stdout:Setting system user ceph properties....done 2024-04-26T23:24:08.393 INFO:teuthology.orchestra.run.smithi039.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:24:08.540 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:24:08.965 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:24:08.991 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:09.199 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:24:09.199 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:24:09.644 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:09.843 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:09.860 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:24:09.860 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:24:09.993 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:10.503 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:24:10.550 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:24:10.629 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:11.170 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:11.201 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:24:11.201 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:24:11.494 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:24:11.847 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:12.156 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:12.191 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:24:12.422 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:24:12.422 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:24:12.858 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:13.051 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:13.070 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:24:13.070 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:24:13.263 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:24:13.263 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:24:13.881 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:13.902 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:14.096 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:24:14.097 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:24:14.202 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:24:14.202 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:24:14.728 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:14.846 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:14.947 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:15.046 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:24:15.047 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:24:15.074 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:15.281 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:24:15.282 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:24:15.672 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:15.781 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:15.898 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:15.916 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.059 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.105 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:24:16.106 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:24:16.185 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.328 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.689 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:24:16.758 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.789 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:24:16.892 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:16.984 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:24:17.018 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:17.161 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:24:17.530 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:24:17.689 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:24:17.824 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:24:18.169 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:24:18.877 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:24:18.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:24:18.955 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-26T23:24:19.018 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:24:19.130 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-04-26T23:24:19.131 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:24:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:24:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:24:19.304 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:24:19.304 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-04-26T23:24:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:24:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:24:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:24:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:24:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:24:19.306 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-04-26T23:24:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:24:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:24:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:24:19.359 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:24:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:24:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:24:19.362 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages will be upgraded: 2024-04-26T23:24:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:24:19.425 INFO:teuthology.orchestra.run.smithi071.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:24:19.425 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:24:19.425 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:24:19.425 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:24:19.603 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:24:19.613 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:24:19.645 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:24:19.646 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:24:19.646 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:24:19.659 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:24:19.660 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:24:19.661 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:24:19.663 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:24:19.663 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:24:19.664 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:24:19.674 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:24:19.675 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:24:19.675 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:24:19.695 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:24:19.718 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:24:19.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:24:19.803 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-04-26T23:24:19.931 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:24:19.932 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:24:19.933 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:24:19.935 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:24:19.936 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:24:19.940 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:24:19.942 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:24:19.949 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:24:19.950 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:24:19.971 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:24:19.972 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:24:19.982 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-04-26T23:24:19.982 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-04-26T23:24:19.983 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:24:20.003 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:24:20.007 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:24:20.007 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:24:20.008 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:24:20.009 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:24:20.020 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:24:20.022 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:24:20.163 INFO:teuthology.orchestra.run.smithi039.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:24:20.163 INFO:teuthology.orchestra.run.smithi039.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:24:20.163 INFO:teuthology.orchestra.run.smithi039.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:24:20.164 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:24:20.165 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:24:20.165 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2024-04-26T23:24:20.165 INFO:teuthology.orchestra.run.smithi039.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:24:20.165 INFO:teuthology.orchestra.run.smithi039.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:24:20.166 INFO:teuthology.orchestra.run.smithi039.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:24:20.166 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:24:20.166 INFO:teuthology.orchestra.run.smithi039.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:24:20.167 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2024-04-26T23:24:20.167 INFO:teuthology.orchestra.run.smithi039.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:24:20.167 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:24:20.167 INFO:teuthology.orchestra.run.smithi039.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:24:20.184 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:24:20.185 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:24:20.185 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:24:20.185 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:24:20.185 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:24:20.185 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:24:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:24:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:24:20.222 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:24:20.224 INFO:teuthology.orchestra.run.smithi039.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:24:20.225 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2024-04-26T23:24:20.226 INFO:teuthology.orchestra.run.smithi039.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:24:20.289 INFO:teuthology.orchestra.run.smithi039.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:24:20.289 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:24:20.290 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:24:20.290 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:24:20.454 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:24:20.458 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:24:20.491 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:24:20.492 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:24:20.492 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:24:20.500 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:24:20.500 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:24:20.502 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:24:20.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:24:20.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:24:20.504 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:24:20.517 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:24:20.517 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:24:20.518 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:24:20.537 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:24:20.571 INFO:teuthology.orchestra.run.smithi071.stdout:Preconfiguring packages ... 2024-04-26T23:24:20.716 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 55.7 MB in 1s (67.2 MB/s) 2024-04-26T23:24:20.766 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:24:20.768 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:24:20.768 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:24:20.771 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:24:20.771 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:24:20.776 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:24:20.777 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:24:20.785 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:24:20.785 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:24:20.807 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:24:20.808 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:24:20.819 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:24:20.839 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:24:20.843 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:24:20.843 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:24:20.844 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:24:20.844 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:24:20.856 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:24:20.858 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:24:21.010 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:24:21.010 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:24:21.011 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:24:21.011 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:24:21.011 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:24:21.011 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:24:21.012 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:24:21.016 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:21.024 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:24:21.025 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:24:21.158 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:21.419 INFO:teuthology.orchestra.run.smithi039.stdout:Preconfiguring packages ... 2024-04-26T23:24:21.592 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 55.7 MB in 1s (70.5 MB/s) 2024-04-26T23:24:21.834 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:21.881 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:24:21.884 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:22.023 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:22.657 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:22.926 INFO:teuthology.orchestra.run.smithi071.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:24:23.190 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package flex. 2024-04-26T23:24:23.261 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:24:23.264 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:23.314 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:24:23.714 INFO:teuthology.orchestra.run.smithi039.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:24:23.833 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:24:23.978 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:24:23.986 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package flex. 2024-04-26T23:24:24.060 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:24:24.064 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:24.101 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:24:24.468 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:24:24.806 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:24:24.966 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:24:24.970 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:25.070 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:25.341 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:25.458 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:25.586 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:25.866 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:24:25.869 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:25.874 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:25.983 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:26.262 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package bison. 2024-04-26T23:24:26.332 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:24:26.336 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:24:26.381 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:24:26.396 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:24:26.531 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:24:26.782 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:24:26.796 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:24:26.840 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:24:26.871 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:27.136 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package dump. 2024-04-26T23:24:27.150 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:24:27.186 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:24:27.256 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package bison. 2024-04-26T23:24:27.331 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:24:27.335 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:24:27.375 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:24:27.481 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package indent. 2024-04-26T23:24:27.498 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:27.540 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:24:27.784 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:24:27.799 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:24:27.801 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:24:27.816 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:24:27.843 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:24:27.859 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:24:28.155 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:24:28.169 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:24:28.170 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package dump. 2024-04-26T23:24:28.186 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:24:28.205 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:24:28.221 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:24:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:24:28.497 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:24:28.499 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package indent. 2024-04-26T23:24:28.514 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:28.550 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:24:28.557 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:24:28.835 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:24:28.850 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:24:28.893 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:24:28.904 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:24:28.918 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:28.962 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:29.189 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:24:29.204 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:24:29.215 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:24:29.229 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:29.239 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:24:29.264 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:29.475 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:24:29.485 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:24:29.490 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:24:29.498 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:24:29.533 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:24:29.568 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:24:29.879 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:24:29.886 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:24:29.893 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:24:29.903 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:29.938 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:24:29.945 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:30.273 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:24:30.289 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:24:30.331 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:30.550 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:24:30.567 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:24:30.609 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:24:30.886 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:24:30.903 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:24:30.937 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:24:31.316 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:24:31.331 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:24:31.374 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:31.627 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:24:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:24:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:32.030 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:24:32.046 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:24:32.088 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:32.289 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:24:32.306 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:24:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:24:32.474 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:24:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:24:32.617 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:24:32.633 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:24:32.692 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:32.837 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:24:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:24:32.895 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:24:32.986 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:24:33.003 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:24:33.036 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:24:33.255 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:33.389 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:24:33.405 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:24:33.447 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:24:33.634 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:24:33.650 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:24:33.767 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:24:33.783 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:24:33.825 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:24:33.996 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:24:34.010 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:24:34.195 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:24:34.211 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:34.253 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:34.298 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:24:34.313 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:24:34.357 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:34.606 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:24:34.622 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:34.664 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:24:34.877 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:24:34.892 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:24:34.936 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:24:34.966 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:24:34.983 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:35.025 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:24:35.206 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:24:35.221 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:24:35.256 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:35.287 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:24:35.303 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:24:35.345 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:35.897 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:24:35.913 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:24:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:24:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:24:35.962 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:24:35.974 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:24:36.302 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:24:36.317 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:24:36.351 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:36.514 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ppp. 2024-04-26T23:24:36.529 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:24:36.872 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:24:36.991 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:24:37.007 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:24:37.057 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:24:37.185 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:24:37.199 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:24:37.243 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:24:37.471 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:24:37.486 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:24:37.529 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:24:37.675 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ppp. 2024-04-26T23:24:37.690 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:24:37.849 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:24:37.864 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:24:37.907 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:24:38.046 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:24:38.237 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:24:38.251 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:38.295 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:38.371 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:24:38.386 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:24:38.421 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:24:38.640 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:24:38.655 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:24:38.698 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:24:38.792 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:24:38.806 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:24:38.868 INFO:teuthology.orchestra.run.smithi071.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:24:38.907 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:24:39.026 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:24:39.042 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:24:39.085 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:24:39.389 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:24:39.404 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:39.416 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:24:39.430 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:39.446 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:39.951 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:24:39.966 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:24:40.019 INFO:teuthology.orchestra.run.smithi039.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:24:40.049 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:24:40.605 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:24:40.619 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:24:40.663 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:24:40.668 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:24:40.684 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:24:40.729 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:40.909 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:24:40.921 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:24:40.965 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:24:41.193 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:24:41.206 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:24:41.251 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:24:41.561 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:24:41.576 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:24:41.611 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:24:41.864 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package tcl. 2024-04-26T23:24:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:24:41.878 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:24:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:24:41.926 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:24:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:24:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:24:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:24:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:24:42.450 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:24:42.465 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:24:42.499 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:24:42.683 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:24:42.698 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:24:42.742 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:24:42.752 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:24:42.767 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:24:42.802 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:24:43.079 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:24:43.088 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package tcl. 2024-04-26T23:24:43.093 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:24:43.103 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:24:43.129 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:24:43.150 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:24:43.441 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:24:43.455 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:24:43.506 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:24:43.524 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:24:43.539 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:24:43.582 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:24:43.815 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:24:43.928 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:24:43.943 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:24:43.978 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:24:43.996 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:24:44.122 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:24:44.248 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:44.323 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:24:44.338 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:24:44.374 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:24:44.389 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:24:44.500 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:24:44.626 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:44.682 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:24:44.903 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:24:45.029 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:24:45.155 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:45.282 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:24:45.577 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:24:45.674 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:24:45.782 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:24:45.908 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:46.034 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:24:46.035 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:24:46.751 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:46.874 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:24:46.886 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:24:46.980 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:24:47.012 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:47.138 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:24:47.288 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:24:47.365 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:24:47.366 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:24:47.431 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:47.557 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:24:47.717 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:24:48.100 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:24:48.226 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:24:48.352 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:24:48.472 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:24:48.477 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:24:48.595 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:24:48.598 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:24:48.693 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:24:48.721 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:48.758 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:48.822 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:24:48.884 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:24:48.940 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:24:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:24:49.102 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:24:49.203 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:24:49.284 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:24:49.355 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:24:49.481 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:24:49.629 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:24:49.682 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:24:49.737 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:24:49.808 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:49.816 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:24:49.864 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:24:49.917 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:24:49.982 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:24:50.077 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:24:50.108 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:24:50.203 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:24:50.234 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:24:50.361 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:24:50.449 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:24:50.519 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:24:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout:- enp3s0f1 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:24:50.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:24:51.197 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:24:51.315 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:24:51.323 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:51.449 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:24:51.618 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:24:51.719 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:24:51.726 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:24:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:52.320 INFO:teuthology.orchestra.run.smithi039.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:24:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:24:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:- ens1f0 2024-04-26T23:24:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:24:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:24:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:52.439 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:52.459 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:24:52.582 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:52.700 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:24:52.834 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:24:52.884 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:24:53.297 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:24:54.029 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:24:54.163 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:24:54.290 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:24:54.415 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:24:54.524 INFO:teuthology.orchestra.run.smithi071.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:24:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:54.879 INFO:teuthology.orchestra.run.smithi071.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:24:55.123 INFO:teuthology.orchestra.run.smithi071.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:24:55.124 INFO:teuthology.orchestra.run.smithi071.stdout:Removing obsolete dictionary files: 2024-04-26T23:24:55.345 INFO:teuthology.orchestra.run.smithi039.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:24:55.589 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:55.590 INFO:teuthology.orchestra.run.smithi039.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:24:55.841 INFO:teuthology.orchestra.run.smithi039.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:24:55.841 INFO:teuthology.orchestra.run.smithi039.stdout:Removing obsolete dictionary files: 2024-04-26T23:24:55.848 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:24:56.312 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:56.583 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:24:56.704 INFO:teuthology.orchestra.run.smithi071.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:24:56.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:24:56.734 INFO:teuthology.orchestra.run.smithi071.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:24:56.734 INFO:teuthology.orchestra.run.smithi071.stdout:This user must also own the server process. 2024-04-26T23:24:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:The default text search configuration will be set to "english". 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:Data page checksums are disabled. 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:24:56.736 INFO:teuthology.orchestra.run.smithi071.stdout:creating subdirectories ... ok 2024-04-26T23:24:56.736 INFO:teuthology.orchestra.run.smithi071.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:24:56.757 INFO:teuthology.orchestra.run.smithi071.stdout:selecting default max_connections ... 100 2024-04-26T23:24:56.792 INFO:teuthology.orchestra.run.smithi071.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:24:56.805 INFO:teuthology.orchestra.run.smithi071.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:24:56.805 INFO:teuthology.orchestra.run.smithi071.stdout:creating configuration files ... ok 2024-04-26T23:24:56.969 INFO:teuthology.orchestra.run.smithi071.stdout:running bootstrap script ... ok 2024-04-26T23:24:57.068 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:24:57.394 INFO:teuthology.orchestra.run.smithi039.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:24:57.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:This user must also own the server process. 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:The default text search configuration will be set to "english". 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:Data page checksums are disabled. 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:24:57.498 INFO:teuthology.orchestra.run.smithi039.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:24:57.499 INFO:teuthology.orchestra.run.smithi039.stdout:creating subdirectories ... ok 2024-04-26T23:24:57.499 INFO:teuthology.orchestra.run.smithi039.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:24:57.523 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default max_connections ... 100 2024-04-26T23:24:57.558 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:24:57.573 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:24:57.573 INFO:teuthology.orchestra.run.smithi039.stdout:creating configuration files ... ok 2024-04-26T23:24:57.612 INFO:teuthology.orchestra.run.smithi071.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:24:57.747 INFO:teuthology.orchestra.run.smithi039.stdout:running bootstrap script ... ok 2024-04-26T23:24:58.179 INFO:teuthology.orchestra.run.smithi071.stdout:syncing data to disk ... ok 2024-04-26T23:24:58.402 INFO:teuthology.orchestra.run.smithi039.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:24:58.975 INFO:teuthology.orchestra.run.smithi039.stdout:syncing data to disk ... ok 2024-04-26T23:24:59.518 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:25:01.661 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:25:01.786 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:25:01.913 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:25:02.024 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:25:02.123 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:25:02.392 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:25:02.392 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:25:02.607 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:25:02.733 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:25:02.842 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:25:02.968 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:25:03.069 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:25:03.116 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:25:03.209 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:25:03.345 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:25:03.345 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:25:03.536 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:25:03.679 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:25:04.088 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:25:04.180 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:25:04.515 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:25:04.676 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:25:04.713 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:25:04.813 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:25:05.368 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:25:05.375 DEBUG:teuthology.parallel:result is None 2024-04-26T23:25:06.061 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:25:06.161 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:25:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:25:06.724 DEBUG:teuthology.parallel:result is None 2024-04-26T23:25:06.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:25:06.868 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:25:06.890 INFO:teuthology.orchestra.run.smithi039.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:25:06.891 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:25:06.891 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:25:06.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:25:07.124 DEBUG:teuthology.orchestra.run.smithi071:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:25:07.148 INFO:teuthology.orchestra.run.smithi071.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:25:07.148 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:25:07.148 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:25:07.150 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:25:07.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:07.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:25:07.171 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:07.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:25:07.216 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:25:07.216 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:07.216 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:25:07.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:25:07.297 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:07.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:25:07.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:25:07.382 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:25:07.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:07.382 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:25:07.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:25:07.461 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:07.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:25:07.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:25:07.546 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:25:07.546 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:07.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:25:07.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:25:07.629 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:07.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:25:07.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:25:07.713 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:25:07.826 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:25:07.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2024-04-26T23:25:07.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-04-26T23:25:07.849 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:25:07.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:25:07.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:25:07.913 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:25:07.913 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:25:07.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:25:07.980 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:25:07.981 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:25:07.981 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:25:07.981 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:07.981 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:25:08.020 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:25:08.108 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:08.109 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:25:08.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:25:08.222 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:25:08.223 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:25:08.223 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': None, 'first_in_suite': False, 'job_id': '7675292', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGaH69UcDfuzablpDvkEsJVoPJhBwFxPeT00M2bAFqc5k1GGqU8rE1e7NFisveRm/P3H7boohkJ6EN2BRI23/vs=', 'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGFIYNFT//qXwGsAYPsYXooTHX948SVI5BRrsPf/jY9TGfgE8WDVgCeR3GtArSJ2T56ZhB0opaY5GTRwFZZCFPQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes', 'tasks.cephfs.test_subvolume.TestSubvolume']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:25:08.223 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:25:08.227 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:25:08.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:25:08.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:25:08.302 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:08.302 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:25:08.350 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:25:08.350 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-04-26T23:25:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:25:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:08.404 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 873 Links: 1 2024-04-26T23:25:08.404 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:08.405 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-04-26 23:18:42.169545907 +0000 2024-04-26T23:25:08.405 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-04-26 23:18:42.165545943 +0000 2024-04-26T23:25:08.405 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-04-26 23:18:42.165545943 +0000 2024-04-26T23:25:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-04-26 23:18:42.165545943 +0000 2024-04-26T23:25:08.405 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:25:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-04-26T23:25:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-04-26T23:25:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000671971 s, 762 kB/s 2024-04-26T23:25:08.470 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:25:08.524 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-04-26T23:25:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-04-26 23:18:42.997538511 +0000 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-04-26 23:18:42.701541156 +0000 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-04-26 23:18:42.701541156 +0000 2024-04-26T23:25:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-04-26 23:18:42.701541156 +0000 2024-04-26T23:25:08.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:25:08.640 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-04-26T23:25:08.640 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-04-26T23:25:08.640 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000394078 s, 1.3 MB/s 2024-04-26T23:25:08.642 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:25:08.692 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 907 Links: 1 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-04-26 23:18:43.573533366 +0000 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-04-26 23:18:43.305535761 +0000 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-04-26 23:18:43.305535761 +0000 2024-04-26T23:25:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-04-26 23:18:43.305535761 +0000 2024-04-26T23:25:08.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:25:08.804 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-04-26T23:25:08.804 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-04-26T23:25:08.804 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.00039115 s, 1.3 MB/s 2024-04-26T23:25:08.806 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:25:08.856 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 925 Links: 1 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-04-26 23:18:43.889530544 +0000 2024-04-26T23:25:08.907 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-04-26 23:18:43.885530580 +0000 2024-04-26T23:25:08.908 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-04-26 23:18:43.885530580 +0000 2024-04-26T23:25:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-04-26 23:18:43.885530580 +0000 2024-04-26T23:25:08.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:25:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-04-26T23:25:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-04-26T23:25:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000409623 s, 1.2 MB/s 2024-04-26T23:25:08.969 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:25:09.020 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:09.020 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:09.020 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:25:09.029 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:25:09.029 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-04-26T23:25:09.079 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 23:18:34.748452506 +0000 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 23:18:34.476454932 +0000 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 23:18:34.476454932 +0000 2024-04-26T23:25:09.080 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-26 23:18:34.476454932 +0000 2024-04-26T23:25:09.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:25:09.141 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T23:25:09.141 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T23:25:09.141 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000397581 s, 1.3 MB/s 2024-04-26T23:25:09.143 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:25:09.196 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 23:18:35.064449687 +0000 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 23:18:35.060449721 +0000 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 23:18:35.060449721 +0000 2024-04-26T23:25:09.247 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-26 23:18:35.060449721 +0000 2024-04-26T23:25:09.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:25:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T23:25:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T23:25:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000377308 s, 1.4 MB/s 2024-04-26T23:25:09.311 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:25:09.364 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-04-26T23:25:09.414 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 934 Links: 1 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 23:18:35.872442478 +0000 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 23:18:35.620444726 +0000 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 23:18:35.620444726 +0000 2024-04-26T23:25:09.415 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-26 23:18:35.620444726 +0000 2024-04-26T23:25:09.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:25:09.476 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T23:25:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T23:25:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000394058 s, 1.3 MB/s 2024-04-26T23:25:09.479 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:25:09.533 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 952 Links: 1 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 23:18:36.424437553 +0000 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 23:18:36.164439873 +0000 2024-04-26T23:25:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 23:18:36.164439873 +0000 2024-04-26T23:25:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-26 23:18:36.164439873 +0000 2024-04-26T23:25:09.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:25:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T23:25:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T23:25:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000396821 s, 1.3 MB/s 2024-04-26T23:25:09.651 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:25:09.704 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:09.705 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:25:09.705 INFO:tasks.ceph:Generating config... 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] pid file = 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:25:09.706 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:25:09.706 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T23:25:09.706 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:25:09.707 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:25:09.708 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:25:09.708 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:25:09.708 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:25:09.708 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:25:09.709 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:25:09.709 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:25:09.709 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:25:09.709 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:25:09.709 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:25:09.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:25:09.754 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:25:09.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:25:09.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:25:09.926 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.b', '172.21.15.71'), ('mon.c', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]')] 2024-04-26T23:25:09.926 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:25:09.927 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:09.927 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:25:09.974 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --add b 172.21.15.71 --addv c '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:10.065 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 65ff9fdb-1208-4558-966c-a36e641138f0 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 65ff9fdb-1208-4558-966c-a36e641138f0 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2024-04-26T23:25:10.066273+0000 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-04-26T23:25:10.066273+0000 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 17 (quincy) 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 1 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-04-26T23:25:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-04-26T23:25:10.067 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:25:10.069 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:25:10.078 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 65ff9fdb-1208-4558-966c-a36e641138f0... 2024-04-26T23:25:10.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:25:10.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:25:10.166 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-04-26T23:25:10.166 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2024-04-26T23:25:10.166 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2024-04-26T23:25:10.167 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2024-04-26T23:25:10.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2024-04-26T23:25:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]" 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on skipped message = False 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 65ff9fdb-1208-4558-966c-a36e641138f0 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2024-04-26T23:25:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug trim objects = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2024-04-26T23:25:10.171 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: bdev async discard = True 2024-04-26T23:25:10.172 INFO:teuthology.orchestra.run.smithi039.stdout: bdev enable discard = True 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore allocator = bitmap 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 1/20 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 1/20 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 4/10 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:25:10.173 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:25:10.174 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug finisher = 20 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2024-04-26T23:25:10.175 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:25:10.176 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: mon down mkfs grace = 300 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:10.177 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-04-26T23:25:10.178 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = "" 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2024-04-26T23:25:10.179 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds balancer = 20 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-04-26T23:25:10.180 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-04-26T23:25:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-04-26T23:25:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:25:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.39,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]" 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on skipped message = False 2024-04-26T23:25:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 65ff9fdb-1208-4558-966c-a36e641138f0 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-04-26T23:25:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:25:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-04-26T23:25:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-04-26T23:25:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug finisher = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-26T23:25:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: mon down mkfs grace = 300 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:25:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-04-26T23:25:10.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds balancer = 20 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2024-04-26T23:25:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2024-04-26T23:25:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2024-04-26T23:25:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2024-04-26T23:25:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2024-04-26T23:25:10.197 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:25:10.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:25:10.297 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:25:10.297 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:10.297 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:25:10.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:10.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:25:10.354 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:25:10.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:10.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:25:10.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:25:10.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:10.430 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:10.482 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:25:10.482 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:10.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:25:10.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:25:10.518 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:10.518 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:10.571 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:25:10.571 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:25:10.571 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:25:10.627 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:25:10.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:25:10.693 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:25:10.715 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:25:10.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:25:10.770 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:25:10.775 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:25:10.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:25:10.894 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:25:10.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T23:25:10.918 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:25:10.977 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:25:10.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:25:11.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:25:11.104 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:25:11.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T23:25:11.127 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:25:11.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:25:11.171 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:25:11.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T23:25:11.277 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T23:25:11.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T23:25:11.337 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T23:25:11.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T23:25:11.434 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T23:25:11.451 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:25:11.451 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:25:11.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:25:11.471 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:11.471 INFO:tasks.ceph:role: osd.0 2024-04-26T23:25:11.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:25:11.471 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:11.566 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:12.839 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-04-26T23:25:12.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-04-26T23:25:12.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:25:12.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:25:12.935 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:12.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:12.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:25:12.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:12.999 INFO:tasks.ceph:role: osd.1 2024-04-26T23:25:12.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:25:12.999 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:25:13.090 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:13.090 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:13.090 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:13.091 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:14.392 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-04-26T23:25:14.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-04-26T23:25:14.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:25:14.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:25:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:14.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:14.488 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:25:14.555 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:14.555 INFO:tasks.ceph:role: osd.2 2024-04-26T23:25:14.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:25:14.555 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:14.647 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:15.915 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-04-26T23:25:15.918 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-04-26T23:25:15.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:25:15.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:25:16.012 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:16.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:16.013 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:25:16.079 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:16.080 INFO:tasks.ceph:role: osd.3 2024-04-26T23:25:16.080 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:25:16.080 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:16.172 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:17.469 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-04-26T23:25:17.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-04-26T23:25:17.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:25:17.506 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:25:17.577 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:17.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:17.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:17.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.711+0000 7fdc91a227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:25:17.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.711+0000 7fdc91a227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:25:17.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.711+0000 7fdc91a227c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:25:17.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.711+0000 7fdc91a227c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:25:17.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.711+0000 7fdc91a227c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:25:17.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:17.715+0000 7fdc91a227c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:25:20.765 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:25:20.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:20.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:25:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:25:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:25:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:25:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:25:20.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:20.883+0000 7f4d8c7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:25:23.925 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:25:23.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:24.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:25:24.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:25:24.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:25:24.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:25:24.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:25:24.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:24.043+0000 7f3093aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:25:27.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:25:27.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:27.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.195+0000 7f3c7528e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:25:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.195+0000 7f3c7528e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:25:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.195+0000 7f3c7528e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:25:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.195+0000 7f3c7528e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:25:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.195+0000 7f3c7528e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:25:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:27.199+0000 7f3c7528e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:25:30.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:25:30.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:25:30.325 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:30.325 INFO:tasks.ceph:role: osd.4 2024-04-26T23:25:30.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:25:30.325 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:25:30.394 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:30.395 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:30.805 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-26T23:25:30.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-26T23:25:30.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:25:30.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:25:30.968 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:30.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:30.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:25:31.030 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:31.030 INFO:tasks.ceph:role: osd.5 2024-04-26T23:25:31.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:25:31.030 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:25:31.101 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:31.101 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:31.101 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:31.464 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-26T23:25:31.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-26T23:25:31.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:25:31.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:25:31.602 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:31.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:31.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:25:31.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:31.666 INFO:tasks.ceph:role: osd.6 2024-04-26T23:25:31.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:25:31.666 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:25:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:31.737 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:31.737 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:31.737 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:31.738 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:31.738 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:32.132 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-26T23:25:32.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-26T23:25:32.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:25:32.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:25:32.263 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:32.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:32.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:25:32.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:25:32.326 INFO:tasks.ceph:role: osd.7 2024-04-26T23:25:32.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:25:32.326 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:25:32.402 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:25:32.806 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-26T23:25:32.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-26T23:25:32.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:25:32.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:25:32.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:32.966 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:25:32.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:33.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.094+0000 7f7e6c93c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:25:33.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.098+0000 7f7e6c93c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:25:33.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.098+0000 7f7e6c93c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:25:33.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.098+0000 7f7e6c93c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:25:33.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.098+0000 7f7e6c93c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:25:33.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:33.102+0000 7f7e6c93c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:25:36.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:25:36.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.282+0000 7f944822b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.282+0000 7f944822b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.282+0000 7f944822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.282+0000 7f944822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.282+0000 7f944822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:25:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:36.286+0000 7f944822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:25:38.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:25:38.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:25:39.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:25:39.381 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:39.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:25:39.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:25:39.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:25:39.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:25:39.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:25:39.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:39.466+0000 7f7e776447c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:25:42.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:25:42.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.618+0000 7fc7093fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:25:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.618+0000 7fc7093fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:25:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.618+0000 7fc7093fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:25:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.618+0000 7fc7093fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:25:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.618+0000 7fc7093fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:25:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:42.622+0000 7fc7093fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:25:45.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:25:45.677 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:25:45.677 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:25:45.700 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:25:45.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T23:25:45.828 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.828 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:25:45.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:25:45.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:45.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:25:46.022 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:46.022 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:25:46.082 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:25:46.104 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:25:46.166 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T23:25:46.230 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:25:46.294 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:25:46.358 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:25:46.422 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:25:46.481 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:46.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:25:46.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:46.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T23:25:46.543 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.543 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T23:25:46.552 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:46.552 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T23:25:46.602 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:25:46.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:25:46.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:25:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2024-04-26T23:25:46.649 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWNyxmqK9rJRAA9aE1iwhQtH0eYlqn5obd/A== 2024-04-26T23:25:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWNyxmqV33LRAAEJGRcr66jyYjplL5wl+brg== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWNyxmSwdTNRAA9WY84j6z2N65LmrYLj+lYA== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDdNyxmZuaFKhAAsfRLhoI4+QYnw9ufIR28iA== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDgNyxmPDO6NBAAdHN3Ijn/eE9d0sEomTfEtw== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDkNyxmTFCfAhAA/Q6nJAECSWB/CwTzLIV3rA== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDnNyxmh9LLCxAA+qQSaClk3U21trpe22vj3A== 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2024-04-26T23:25:46.650 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWNyxmW4xWKRAA7+rz/WwBsBWQ5XhHVOvfkQ== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWNyxmxfZIOhAAqBAlj+xssqRyWvvbCYfPwA== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmau88BhAAGTd6/z68e7znV/KHRCCDGA== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDtNyxmbifsBRAAjNjFGc0ejjAFGEcIugsBvA== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDwNyxmnTs7ERAA//zGSDQBvm2tcRzZTOlNvA== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDzNyxm5C8dHBAAeWFaQRTmZVLQqrfyScFj3A== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQD2Nyxmek04JRAALoMi3/NJ6Sp0Lfx6VeWKWA== 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-04-26T23:25:46.651 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g== 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout:[client.2] 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmT9aVEBAAib2ep6XrtA1R8JCqVmQbRw== 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmTGgYFBAAVTR5yp7RgxU5styz5dROGw== 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout:[client.3] 2024-04-26T23:25:46.652 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmMDXpGRAA9orIW7EXyWBNIend4Gr4pA== 2024-04-26T23:25:46.663 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWNyxmqK9rJRAA9aE1iwhQtH0eYlqn5obd/A== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWNyxmqV33LRAAEJGRcr66jyYjplL5wl+brg== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWNyxmSwdTNRAA9WY84j6z2N65LmrYLj+lYA== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDdNyxmZuaFKhAAsfRLhoI4+QYnw9ufIR28iA== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDgNyxmPDO6NBAAdHN3Ijn/eE9d0sEomTfEtw== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDkNyxmTFCfAhAA/Q6nJAECSWB/CwTzLIV3rA== 2024-04-26T23:25:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDnNyxmh9LLCxAA+qQSaClk3U21trpe22vj3A== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWNyxmW4xWKRAA7+rz/WwBsBWQ5XhHVOvfkQ== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWNyxmxfZIOhAAqBAlj+xssqRyWvvbCYfPwA== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDXNyxmau88BhAAGTd6/z68e7znV/KHRCCDGA== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDtNyxmbifsBRAAjNjFGc0ejjAFGEcIugsBvA== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDwNyxmnTs7ERAA//zGSDQBvm2tcRzZTOlNvA== 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-04-26T23:25:46.665 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDzNyxm5C8dHBAAeWFaQRTmZVLQqrfyScFj3A== 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD2Nyxmek04JRAALoMi3/NJ6Sp0Lfx6VeWKWA== 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g== 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDXNyxmT9aVEBAAib2ep6XrtA1R8JCqVmQbRw== 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDXNyxmTGgYFBAAVTR5yp7RgxU5styz5dROGw== 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2024-04-26T23:25:46.666 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDXNyxmMDXpGRAA9orIW7EXyWBNIend4Gr4pA== 2024-04-26T23:25:46.667 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:25:46.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:25:46.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:46.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:46.829 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:46.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:46.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:46.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:46.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:46.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.057 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:25:47.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:25:47.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:47.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:47.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:47.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:25:47.289 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:25:47.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:25:47.752 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:25:47.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:25:47.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:25:47.900 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:25:47.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:25:47.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:25:48.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:25:48.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:25:48.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:25:48.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:25:48.256 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:48.259 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:25:48.310 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:25:48.310 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:25:48.311 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:25:48.314 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:25:48.314 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:25:48.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:25:48.365 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:25:48.365 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:25:48.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:25:48.368 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:25:48.368 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:25:48.368 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:25:48.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:25:48.372 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:25:48.372 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:25:48.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:25:48.375 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:25:48.375 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:25:48.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:25:48.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 Processor -- start 2024-04-26T23:25:48.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 -- start start 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 0x7fa20015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2000cdbc0 con 0x7fa2000cfd60 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2000cdea0 con 0x7fa2000d38c0 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa205400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa20015b010 con 0x7fa20015ac30 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa204a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa2000cfd60 0x7fa2000d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53724/0 (socket says 172.21.15.39:53724) 2024-04-26T23:25:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.526+0000 7fa204a00640 1 -- 172.21.15.39:0/436332621 learned_addr learned my addr 172.21.15.39:0/436332621 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:25:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.530+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 0x7fa20015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.530+0000 7fa1ffe00640 1 -- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 msgr2=0x7fa20015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:25:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.530+0000 7fa1ffe00640 1 -- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 msgr2=0x7fa20015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:25:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.530+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 0x7fa20015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:25:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.530+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 0x7fa20015e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:25:48.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901386133 0 0) 0x7fa2000cdbc0 con 0x7fa2000cfd60 2024-04-26T23:25:48.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1e4003530 con 0x7fa2000cfd60 2024-04-26T23:25:48.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50241188 0 0) 0x7fa2000cdea0 con 0x7fa2000d38c0 2024-04-26T23:25:48.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2000cdbc0 con 0x7fa2000d38c0 2024-04-26T23:25:48.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 929265992 0 0) 0x7fa1e4003530 con 0x7fa2000cfd60 2024-04-26T23:25:48.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 msgr2=0x7fa20015e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:25:48.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 --2- 172.21.15.39:0/436332621 >> v2:172.21.15.71:3300/0 conn(0x7fa20015ac30 0x7fa20015e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 >> v1:172.21.15.71:6789/0 conn(0x7fa2000d38c0 legacy=0x7fa2000cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2000ce180 con 0x7fa2000cfd60 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fa1f8001a00 con 0x7fa2000cfd60 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 >> v1:172.21.15.39:6789/0 conn(0x7fa2000cfd60 legacy=0x7fa2000d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4003b50 0x7fa1e4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 0x7fa1e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e40052f0 0x7fa1e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa20015b010 con 0x7fa1e4003b50 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e400c1a0 con 0x7fa1e40052f0 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e400c3a0 con 0x7fa1e4004810 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1f7400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 0x7fa1e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa204a00640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e40052f0 0x7fa1e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.678+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4003b50 0x7fa1e4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 -- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e40052f0 msgr2=0x7fa1e400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:48.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e40052f0 0x7fa1e400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 -- 172.21.15.39:0/436332621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4003b50 msgr2=0x7fa1e4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:48.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4003b50 0x7fa1e4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 -- 172.21.15.39:0/436332621 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e4003530 con 0x7fa1e4004810 2024-04-26T23:25:48.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4003b50 0x7fa1e4003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:48.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa204a00640 1 -- 172.21.15.39:0/436332621 reap_dead start 2024-04-26T23:25:48.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.682+0000 7fa1f7400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 0x7fa1e4004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8007fd0 tx=0x7fa1e801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f803bdac9b27e9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:48.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8001520 con 0x7fa1e4004810 2024-04-26T23:25:48.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e80052f0 con 0x7fa1e4004810 2024-04-26T23:25:48.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa1ff400640 1 -- 172.21.15.39:0/436332621 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8003840 con 0x7fa1e4004810 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 -- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 msgr2=0x7fa1e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 0x7fa1e4004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8007fd0 tx=0x7fa1e801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 -- 172.21.15.39:0/436332621 shutdown_connections 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 --2- 172.21.15.39:0/436332621 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e4004810 0x7fa1e4004c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 -- 172.21.15.39:0/436332621 >> 172.21.15.39:0/436332621 conn(0x7fa2000d2da0 msgr2=0x7fa2000d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 -- 172.21.15.39:0/436332621 shutdown_connections 2024-04-26T23:25:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.686+0000 7fa205400640 1 -- 172.21.15.39:0/436332621 wait complete. 2024-04-26T23:25:48.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 Processor -- start 2024-04-26T23:25:48.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 -- start start 2024-04-26T23:25:48.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa20015fae0 0x7fa20015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 0x7fa2000cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000cfa60 con 0x7fa1e4004810 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000cec60 con 0x7fa20015fae0 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa205400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa2000cfbe0 con 0x7fa2000cae70 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50972/0 (socket says 172.21.15.39:50972) 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 -- 172.21.15.39:0/4121671820 learned_addr learned my addr 172.21.15.39:0/4121671820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa204a00640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 0x7fa2000cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1f7400640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa20015fae0 0x7fa20015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:48.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 -- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 msgr2=0x7fa2000cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 0x7fa2000cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 -- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa20015fae0 msgr2=0x7fa20015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa20015fae0 0x7fa20015ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 -- 172.21.15.39:0/4121671820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20015b550 con 0x7fa1e4004810 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa204a00640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 0x7fa2000cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:25:48.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.690+0000 7fa1ffe00640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0011550 tx=0x7fa1f0011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0019070 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f0015890 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000f040 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20015b830 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20015bdf0 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1f001c070 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1f001ee00 con 0x7fa1e4004810 2024-04-26T23:25:48.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.694+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2000506d0 con 0x7fa1e4004810 2024-04-26T23:25:48.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.718+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa1f0015cc0 con 0x7fa1e4004810 2024-04-26T23:25:48.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.778+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa200159b50 con 0x7fa1e4004810 2024-04-26T23:25:48.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa1fcc00640 1 -- 172.21.15.39:0/4121671820 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa1f001e450 con 0x7fa1e4004810 2024-04-26T23:25:48.784 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-04-26T23:25:48.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 msgr2=0x7fa200200a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:48.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0011550 tx=0x7fa1f0011a10 comp rx=0 tx=0).stop 2024-04-26T23:25:48.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 shutdown_connections 2024-04-26T23:25:48.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2000cae70 0x7fa2000cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa20015fae0 0x7fa20015ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 --2- 172.21.15.39:0/4121671820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e4004810 0x7fa200200a90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:48.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 >> 172.21.15.39:0/4121671820 conn(0x7fa2000d2da0 msgr2=0x7fa20006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:48.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 shutdown_connections 2024-04-26T23:25:48.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:48.782+0000 7fa205400640 1 -- 172.21.15.39:0/4121671820 wait complete. 2024-04-26T23:25:48.805 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:25:48.805 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:25:48.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:48.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:25:48.824 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:48.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:25:48.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:48.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:25:48.891 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:48.886+0000 7f8db642a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:25:48.955 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:48.950+0000 7f7567f7b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:25:48.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:25:48.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:25:49.019 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:49.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:25:49.042 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:49.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:25:49.110 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:49.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:25:49.176 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:25:49.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:25:49.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 39e9400e-09e1-4013-a3c2-38057b71c364 0 2024-04-26T23:25:49.396 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:49.394+0000 7f8db642a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:25:49.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.426+0000 7f2e48a00640 1 Processor -- start 2024-04-26T23:25:49.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.426+0000 7f2e48a00640 1 -- start start 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.426+0000 7f2e48a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e4415d5e0 0x7f2e440cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.426+0000 7f2e48a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.426+0000 7f2e48a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440ceb20 con 0x7f2e440d0f20 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e48a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2e440affc0 con 0x7f2e4415d5e0 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e48a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440cee00 con 0x7f2e440cfb70 2024-04-26T23:25:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38752/0 (socket says 172.21.15.71:38752) 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 -- 172.21.15.71:0/4005214952 learned_addr learned my addr 172.21.15.71:0/4005214952 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41e00640 1 --2- 172.21.15.71:0/4005214952 >> v2:172.21.15.71:3300/0 conn(0x7f2e4415d5e0 0x7f2e440cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 -- 172.21.15.71:0/4005214952 >> v2:172.21.15.71:3300/0 conn(0x7f2e4415d5e0 msgr2=0x7f2e440cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 --2- 172.21.15.71:0/4005214952 >> v2:172.21.15.71:3300/0 conn(0x7f2e4415d5e0 0x7f2e440cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 -- 172.21.15.71:0/4005214952 >> v1:172.21.15.71:6789/0 conn(0x7f2e440d0f20 legacy=0x7f2e440d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 -- 172.21.15.71:0/4005214952 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440cf0e0 con 0x7f2e440cfb70 2024-04-26T23:25:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e41400640 1 --2- 172.21.15.71:0/4005214952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009870 tx=0x7f2e3001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331e13892ab17855 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e40a00640 1 -- 172.21.15.71:0/4005214952 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300b2070 con 0x7f2e440cfb70 2024-04-26T23:25:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.430+0000 7f2e40a00640 1 -- 172.21.15.71:0/4005214952 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300a9070 con 0x7f2e440cfb70 2024-04-26T23:25:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e40a00640 1 -- 172.21.15.71:0/4005214952 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300ad880 con 0x7f2e440cfb70 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- 172.21.15.71:0/4005214952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 msgr2=0x7f2e440cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- 172.21.15.71:0/4005214952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009870 tx=0x7f2e3001c560 comp rx=0 tx=0).stop 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- 172.21.15.71:0/4005214952 shutdown_connections 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- 172.21.15.71:0/4005214952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e440cfb70 0x7f2e440cffd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- 172.21.15.71:0/4005214952 >> v2:172.21.15.71:3300/0 conn(0x7f2e4415d5e0 0x7f2e440cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- 172.21.15.71:0/4005214952 >> 172.21.15.71:0/4005214952 conn(0x7f2e440d3020 msgr2=0x7f2e440d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- 172.21.15.71:0/4005214952 shutdown_connections 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- 172.21.15.71:0/4005214952 wait complete. 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 Processor -- start 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- start start 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e440cfb70 0x7f2e440b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e4415d5e0 0x7f2e4415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440d2020 con 0x7f2e440cfb70 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440d1ea0 con 0x7f2e440d0f20 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e48a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4416aa50 con 0x7f2e4415d5e0 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e41400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e42800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e4415d5e0 0x7f2e4415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e41400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58158/0 (socket says 172.21.15.71:58158) 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.434+0000 7f2e41400640 1 -- 172.21.15.71:0/2001980281 learned_addr learned my addr 172.21.15.71:0/2001980281 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 -- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e4415d5e0 msgr2=0x7f2e4415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e4415d5e0 0x7f2e4415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 -- 172.21.15.71:0/2001980281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e440cfb70 msgr2=0x7f2e440b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e440cfb70 0x7f2e440b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 -- 172.21.15.71:0/2001980281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440b6a30 con 0x7f2e440d0f20 2024-04-26T23:25:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e41400640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e300097c0 tx=0x7f2e30019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300b2040 con 0x7f2e440d0f20 2024-04-26T23:25:49.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300adb50 con 0x7f2e440d0f20 2024-04-26T23:25:49.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300b6440 con 0x7f2e440d0f20 2024-04-26T23:25:49.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e440b6d10 con 0x7f2e440d0f20 2024-04-26T23:25:49.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e440b72d0 con 0x7f2e440d0f20 2024-04-26T23:25:49.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e300bd020 con 0x7f2e440d0f20 2024-04-26T23:25:49.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2e300bf450 con 0x7f2e440d0f20 2024-04-26T23:25:49.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.438+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4406a720 con 0x7f2e440d0f20 2024-04-26T23:25:49.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.442+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2e300c4020 con 0x7f2e440d0f20 2024-04-26T23:25:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.506+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39e9400e-09e1-4013-a3c2-38057b71c364", "id": 0} v 0) -- 0x7f2e440d34a0 con 0x7f2e440d0f20 2024-04-26T23:25:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.514+0000 7f2e3a000640 1 -- 172.21.15.71:0/2001980281 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39e9400e-09e1-4013-a3c2-38057b71c364", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2e30016150 con 0x7f2e440d0f20 2024-04-26T23:25:49.518 INFO:teuthology.orchestra.run.smithi071.stdout:0 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.514+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 msgr2=0x7f2e440c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.514+0000 7f2e48a00640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e300097c0 tx=0x7f2e30019300 comp rx=0 tx=0).stop 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 shutdown_connections 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e4415d5e0 0x7f2e4415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e440d0f20 0x7f2e440c9a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 --2- 172.21.15.71:0/2001980281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e440cfb70 0x7f2e440b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 >> 172.21.15.71:0/2001980281 conn(0x7f2e440d3020 msgr2=0x7f2e4415c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 shutdown_connections 2024-04-26T23:25:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.518+0000 7f2e48a00640 1 -- 172.21.15.71:0/2001980281 wait complete. 2024-04-26T23:25:49.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 12cdd206-8fac-4f71-b1a9-cf5078d7a3e1 1 2024-04-26T23:25:49.563 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:49.558+0000 7f7567f7b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:25:49.612 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:49.610+0000 7f8db642a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:25:49.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 Processor -- start 2024-04-26T23:25:49.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 -- start start 2024-04-26T23:25:49.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 0x7fb40c0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb40c06e930 con 0x7fb40c0d2f80 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb40c0d38a0 con 0x7fb40c162ea0 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb413000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c06e090 con 0x7fb40c06f1e0 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb411000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb411000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58166/0 (socket says 172.21.15.71:58166) 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb411000640 1 -- 172.21.15.71:0/2067864652 learned_addr learned my addr 172.21.15.71:0/2067864652 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:49.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38762/0 (socket says 172.21.15.71:38762) 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb40be00640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 0x7fb40c0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 -- 172.21.15.71:0/2067864652 >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 msgr2=0x7fb40c163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 -- 172.21.15.71:0/2067864652 >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 msgr2=0x7fb40c0d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 0x7fb40c0d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb403e00640 1 -- 172.21.15.71:0/2067864652 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c06e370 con 0x7fb40c06f1e0 2024-04-26T23:25:49.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb40be00640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 0x7fb40c0d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:25:49.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.670+0000 7fb411000640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:49.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb403e00640 1 --2- 172.21.15.71:0/2067864652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb40c06ecd0 tx=0x7fb3f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a53b3b051275a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb40b400640 1 -- 172.21.15.71:0/2067864652 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40b0070 con 0x7fb40c06f1e0 2024-04-26T23:25:49.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb40b400640 1 -- 172.21.15.71:0/2067864652 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40ab600 con 0x7fb40c06f1e0 2024-04-26T23:25:49.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb40b400640 1 -- 172.21.15.71:0/2067864652 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40ab9d0 con 0x7fb40c06f1e0 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 -- 172.21.15.71:0/2067864652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 msgr2=0x7fb40c0c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 --2- 172.21.15.71:0/2067864652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb40c06ecd0 tx=0x7fb3f401c480 comp rx=0 tx=0).stop 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 -- 172.21.15.71:0/2067864652 shutdown_connections 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.71:3300/0 conn(0x7fb40c162ea0 0x7fb40c163330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 --2- 172.21.15.71:0/2067864652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c0c7ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 --2- 172.21.15.71:0/2067864652 >> v2:172.21.15.39:3300/0 conn(0x7fb40c0d2f80 0x7fb40c0d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 -- 172.21.15.71:0/2067864652 >> 172.21.15.71:0/2067864652 conn(0x7fb40c068140 msgr2=0x7fb40c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:49.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 -- 172.21.15.71:0/2067864652 shutdown_connections 2024-04-26T23:25:49.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.674+0000 7fb413000640 1 -- 172.21.15.71:0/2067864652 wait complete. 2024-04-26T23:25:49.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 Processor -- start 2024-04-26T23:25:49.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 -- start start 2024-04-26T23:25:49.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 0x7fb40c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 0x7fb40c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c0d17f0 con 0x7fb40c0d2f80 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c148f80 con 0x7fb40c162ea0 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb413000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c0d1970 con 0x7fb40c06f1e0 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb40be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb411000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 0x7fb40c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb40be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38772/0 (socket says 172.21.15.71:38772) 2024-04-26T23:25:49.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb40be00640 1 -- 172.21.15.71:0/2643923180 learned_addr learned my addr 172.21.15.71:0/2643923180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:49.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 0x7fb40c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 -- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 msgr2=0x7fb40c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 -- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 msgr2=0x7fb40c13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 0x7fb40c13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb403e00640 1 -- 172.21.15.71:0/2643923180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c140fd0 con 0x7fb40c0d2f80 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb40be00640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:49.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.678+0000 7fb411000640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 0x7fb40c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:49.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb403e00640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 0x7fb40c15dbe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ab000 tx=0x7fb3f401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40b0050 con 0x7fb40c0d2f80 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40bc070 con 0x7fb40c0d2f80 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40b5830 con 0x7fb40c0d2f80 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c0b73d0 con 0x7fb40c0d2f80 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c15e120 con 0x7fb40c0d2f80 2024-04-26T23:25:49.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb3f40b59d0 con 0x7fb40c0d2f80 2024-04-26T23:25:49.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.682+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb3f40c1d50 con 0x7fb40c0d2f80 2024-04-26T23:25:49.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.686+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40c06a720 con 0x7fb40c0d2f80 2024-04-26T23:25:49.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.686+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb3f4016070 con 0x7fb40c0d2f80 2024-04-26T23:25:49.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.754+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12cdd206-8fac-4f71-b1a9-cf5078d7a3e1", "id": 1} v 0) -- 0x7fb40c148740 con 0x7fb40c0d2f80 2024-04-26T23:25:49.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.758+0000 7fb408c00640 1 -- 172.21.15.71:0/2643923180 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12cdd206-8fac-4f71-b1a9-cf5078d7a3e1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb3f40c1460 con 0x7fb40c0d2f80 2024-04-26T23:25:49.762 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:25:49.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 msgr2=0x7fb40c15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 0x7fb40c15dbe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ab000 tx=0x7fb3f401acc0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 shutdown_connections 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb40c162ea0 0x7fb40c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb40c0d2f80 0x7fb40c15dbe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 --2- 172.21.15.71:0/2643923180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb40c06f1e0 0x7fb40c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 >> 172.21.15.71:0/2643923180 conn(0x7fb40c068140 msgr2=0x7fb40c1458c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 shutdown_connections 2024-04-26T23:25:49.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.762+0000 7fb413000640 1 -- 172.21.15.71:0/2643923180 wait complete. 2024-04-26T23:25:49.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 0246a346-6249-463b-b4f5-2ceb40813ba6 2 2024-04-26T23:25:49.827 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:49.822+0000 7f7567f7b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:25:49.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 Processor -- start 2024-04-26T23:25:49.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 -- start start 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 0x7f6a2c0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a2c0d0630 0x7f6a2c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2c0d0d30 con 0x7f6a2c0cdbc0 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6a2c0d1010 con 0x7f6a2c0d0630 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a34800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c0c7f70 con 0x7f6a2c146b60 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a32800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6a2c0cdbc0 0x7f6a2c0c8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47816/0 (socket says 172.21.15.71:47816) 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a32800640 1 -- 172.21.15.71:0/3203800902 learned_addr learned my addr 172.21.15.71:0/3203800902 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-26T23:25:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31e00640 1 --2- 172.21.15.71:0/3203800902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 0x7f6a2c0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31400640 1 --2- 172.21.15.71:0/3203800902 >> v2:172.21.15.39:3300/0 conn(0x7f6a2c0d0630 0x7f6a2c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a30a00640 1 -- 172.21.15.71:0/3203800902 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514406931 0 0) 0x7f6a2c0d0d30 con 0x7f6a2c0cdbc0 2024-04-26T23:25:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31e00640 1 -- 172.21.15.71:0/3203800902 >> v2:172.21.15.39:3300/0 conn(0x7f6a2c0d0630 msgr2=0x7f6a2c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31e00640 1 --2- 172.21.15.71:0/3203800902 >> v2:172.21.15.39:3300/0 conn(0x7f6a2c0d0630 0x7f6a2c0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31e00640 1 -- 172.21.15.71:0/3203800902 >> v1:172.21.15.71:6789/0 conn(0x7f6a2c0cdbc0 legacy=0x7f6a2c0c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.914+0000 7f6a31e00640 1 -- 172.21.15.71:0/3203800902 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0c8250 con 0x7f6a2c146b60 2024-04-26T23:25:49.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a31e00640 1 --2- 172.21.15.71:0/3203800902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 0x7f6a2c0d3360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a180097c0 tx=0x7f6a1801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea617efe242e71f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a30a00640 1 -- 172.21.15.71:0/3203800902 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a180b0070 con 0x7f6a2c146b60 2024-04-26T23:25:49.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a30a00640 1 -- 172.21.15.71:0/3203800902 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a180ab600 con 0x7f6a2c146b60 2024-04-26T23:25:49.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a30a00640 1 -- 172.21.15.71:0/3203800902 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a180ab9d0 con 0x7f6a2c146b60 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 -- 172.21.15.71:0/3203800902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 msgr2=0x7f6a2c0d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 --2- 172.21.15.71:0/3203800902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 0x7f6a2c0d3360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a180097c0 tx=0x7f6a1801c3b0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 -- 172.21.15.71:0/3203800902 shutdown_connections 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 --2- 172.21.15.71:0/3203800902 >> v2:172.21.15.39:3300/0 conn(0x7f6a2c0d0630 0x7f6a2c0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 --2- 172.21.15.71:0/3203800902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c146b60 0x7f6a2c0d3360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 -- 172.21.15.71:0/3203800902 >> 172.21.15.71:0/3203800902 conn(0x7f6a2c068140 msgr2=0x7f6a2c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 -- 172.21.15.71:0/3203800902 shutdown_connections 2024-04-26T23:25:49.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.918+0000 7f6a34800640 1 -- 172.21.15.71:0/3203800902 wait complete. 2024-04-26T23:25:49.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 Processor -- start 2024-04-26T23:25:49.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- start start 2024-04-26T23:25:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c0cdbc0 0x7f6a2c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c146b60 0x7f6a2c1673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c0c9000 con 0x7f6a2c146b60 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c0c8e80 con 0x7f6a2c0d0630 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c16a010 con 0x7f6a2c0cdbc0 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c0cdbc0 0x7f6a2c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46984/0 (socket says 172.21.15.71:46984) 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 -- 172.21.15.71:0/3695992517 learned_addr learned my addr 172.21.15.71:0/3695992517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a32800640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c146b60 0x7f6a2c1673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:49.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 -- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c0cdbc0 msgr2=0x7f6a2c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c0cdbc0 0x7f6a2c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 -- 172.21.15.71:0/3695992517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c146b60 msgr2=0x7f6a2c1673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c146b60 0x7f6a2c1673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 -- 172.21.15.71:0/3695992517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0d15f0 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a31400640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e960 tx=0x7f6a2000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2000ca00 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000cdb0 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c165240 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c165800 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a2001a070 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.922+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6a2001c910 con 0x7f6a2c0d0630 2024-04-26T23:25:49.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.926+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c071880 con 0x7f6a2c0d0630 2024-04-26T23:25:49.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.930+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6a2001cbf0 con 0x7f6a2c0d0630 2024-04-26T23:25:49.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:49.994+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0246a346-6249-463b-b4f5-2ceb40813ba6", "id": 2} v 0) -- 0x7f6a2c06a720 con 0x7f6a2c0d0630 2024-04-26T23:25:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a26000640 1 -- 172.21.15.71:0/3695992517 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0246a346-6249-463b-b4f5-2ceb40813ba6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6a2001c4f0 con 0x7f6a2c0d0630 2024-04-26T23:25:50.005 INFO:teuthology.orchestra.run.smithi071.stdout:2 2024-04-26T23:25:50.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 msgr2=0x7f6a2c166e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e960 tx=0x7f6a2000ee20 comp rx=0 tx=0).stop 2024-04-26T23:25:50.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 shutdown_connections 2024-04-26T23:25:50.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c146b60 0x7f6a2c1673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a2c0d0630 0x7f6a2c166e60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 --2- 172.21.15.71:0/3695992517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6a2c0cdbc0 0x7f6a2c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 >> 172.21.15.71:0/3695992517 conn(0x7f6a2c068140 msgr2=0x7f6a2c0ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 shutdown_connections 2024-04-26T23:25:50.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.002+0000 7f6a34800640 1 -- 172.21.15.71:0/3695992517 wait complete. 2024-04-26T23:25:50.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new b99b627c-64b0-4e1f-be52-e93eccd0d394 3 2024-04-26T23:25:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 Processor -- start 2024-04-26T23:25:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 -- start start 2024-04-26T23:25:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff7415d0c0 0x7eff740732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff74073810 0x7eff740b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7eff740b5ef0 con 0x7eff74073810 2024-04-26T23:25:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7eff7415d4a0 con 0x7eff7415d0c0 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff7a600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7eff740b5c10 con 0x7eff740b5420 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff7415d0c0 0x7eff740732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48474/0 (socket says 172.21.15.71:48474) 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 -- 172.21.15.71:0/649418831 learned_addr learned my addr 172.21.15.71:0/649418831 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff6be00640 1 --2- 172.21.15.71:0/649418831 >> v2:172.21.15.39:3300/0 conn(0x7eff74073810 0x7eff740b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 -- 172.21.15.71:0/649418831 >> v2:172.21.15.71:3300/0 conn(0x7eff7415d0c0 msgr2=0x7eff740732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 --2- 172.21.15.71:0/649418831 >> v2:172.21.15.71:3300/0 conn(0x7eff7415d0c0 0x7eff740732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 -- 172.21.15.71:0/649418831 >> v2:172.21.15.39:3300/0 conn(0x7eff74073810 msgr2=0x7eff740b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 --2- 172.21.15.71:0/649418831 >> v2:172.21.15.39:3300/0 conn(0x7eff74073810 0x7eff740b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.158+0000 7eff73e00640 1 -- 172.21.15.71:0/649418831 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7406f6a0 con 0x7eff740b5420 2024-04-26T23:25:50.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff73e00640 1 --2- 172.21.15.71:0/649418831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff74074140 tx=0x7eff6c01e8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47450a9e6e657d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff72a00640 1 -- 172.21.15.71:0/649418831 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a7650 con 0x7eff740b5420 2024-04-26T23:25:50.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff72a00640 1 -- 172.21.15.71:0/649418831 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0a77f0 con 0x7eff740b5420 2024-04-26T23:25:50.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff72a00640 1 -- 172.21.15.71:0/649418831 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a7bc0 con 0x7eff740b5420 2024-04-26T23:25:50.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 -- 172.21.15.71:0/649418831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 msgr2=0x7eff7415fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 --2- 172.21.15.71:0/649418831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff74074140 tx=0x7eff6c01e8b0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 -- 172.21.15.71:0/649418831 shutdown_connections 2024-04-26T23:25:50.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 --2- 172.21.15.71:0/649418831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff740b5420 0x7eff7415fb50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 --2- 172.21.15.71:0/649418831 >> v2:172.21.15.39:3300/0 conn(0x7eff74073810 0x7eff740b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 --2- 172.21.15.71:0/649418831 >> v2:172.21.15.71:3300/0 conn(0x7eff7415d0c0 0x7eff740732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 -- 172.21.15.71:0/649418831 >> 172.21.15.71:0/649418831 conn(0x7eff740b3be0 msgr2=0x7eff740b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 -- 172.21.15.71:0/649418831 shutdown_connections 2024-04-26T23:25:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.162+0000 7eff7a600640 1 -- 172.21.15.71:0/649418831 wait complete. 2024-04-26T23:25:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 Processor -- start 2024-04-26T23:25:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 -- start start 2024-04-26T23:25:50.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 0x7eff74152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff740b5420 0x7eff7415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7eff7406c550 con 0x7eff740b5420 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff7406c3d0 con 0x7eff74073810 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff7a600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7eff7406c6d0 con 0x7eff7415d0c0 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 0x7eff74152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 0x7eff74152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47006/0 (socket says 172.21.15.71:47006) 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48490/0 (socket says 172.21.15.71:48490) 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73400640 1 -- 172.21.15.71:0/2607920563 learned_addr learned my addr 172.21.15.71:0/2607920563 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 -- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 msgr2=0x7eff74152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 0x7eff74152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 -- 172.21.15.71:0/2607920563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff740b5420 msgr2=0x7eff7415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff740b5420 0x7eff7415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 -- 172.21.15.71:0/2607920563 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff74153000 con 0x7eff7415d0c0 2024-04-26T23:25:50.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.166+0000 7eff73e00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ad000 tx=0x7eff6c01b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0be070 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0073f0 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff7a600640 1 -- 172.21.15.71:0/2607920563 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff74156460 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c009510 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff7a600640 1 -- 172.21.15.71:0/2607920563 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff74157920 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff6c0c1070 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7eff6c007c50 con 0x7eff7415d0c0 2024-04-26T23:25:50.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.170+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff440052a0 con 0x7eff7415d0c0 2024-04-26T23:25:50.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.174+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7eff6c0187f0 con 0x7eff7415d0c0 2024-04-26T23:25:50.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.238+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b99b627c-64b0-4e1f-be52-e93eccd0d394", "id": 3} v 0) -- 0x7eff44005860 con 0x7eff7415d0c0 2024-04-26T23:25:50.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.242+0000 7eff6b400640 1 -- 172.21.15.71:0/2607920563 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b99b627c-64b0-4e1f-be52-e93eccd0d394", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7eff6c0a7750 con 0x7eff7415d0c0 2024-04-26T23:25:50.246 INFO:teuthology.orchestra.run.smithi071.stdout:3 2024-04-26T23:25:50.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 msgr2=0x7eff7415ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ad000 tx=0x7eff6c01b650 comp rx=0 tx=0).stop 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 shutdown_connections 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff7415d0c0 0x7eff7415ac10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff740b5420 0x7eff7415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 --2- 172.21.15.71:0/2607920563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff74073810 0x7eff74152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 >> 172.21.15.71:0/2607920563 conn(0x7eff740b3be0 msgr2=0x7eff7415ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 shutdown_connections 2024-04-26T23:25:50.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.246+0000 7eff68c00640 1 -- 172.21.15.71:0/2607920563 wait complete. 2024-04-26T23:25:50.255 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.254+0000 7f8db642a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:25:50.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 63566f33-5a5d-48b5-b184-8d3d9a3bcd0b 4 2024-04-26T23:25:50.319 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.318+0000 7f8db642a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:25:50.381 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.378+0000 7f8db642a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:25:50.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.398+0000 7f73c8000640 1 Processor -- start 2024-04-26T23:25:50.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.398+0000 7f73c8000640 1 -- start start 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f73c00d0f20 0x7f73c00d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f73c00d1d50 con 0x7f73c00d0f20 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f73c006e750 con 0x7f73c00d18c0 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c8000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f73c006ea30 con 0x7f73c015f990 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c6000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48502/0 (socket says 172.21.15.71:48502) 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 -- 172.21.15.71:0/2707383392 learned_addr learned my addr 172.21.15.71:0/2707383392 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c6000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47020/0 (socket says 172.21.15.71:47020) 2024-04-26T23:25:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c4c00640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.39:3300/0 conn(0x7f73c00d0f20 0x7f73c00d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 -- 172.21.15.71:0/2707383392 >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 msgr2=0x7f73c00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 -- 172.21.15.71:0/2707383392 >> v2:172.21.15.39:3300/0 conn(0x7f73c00d0f20 msgr2=0x7f73c00d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.39:3300/0 conn(0x7f73c00d0f20 0x7f73c00d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c5600640 1 -- 172.21.15.71:0/2707383392 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c006ed10 con 0x7f73c015f990 2024-04-26T23:25:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.402+0000 7f73c6000640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c5600640 1 --2- 172.21.15.71:0/2707383392 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f73c00b2150 tx=0x7f73b401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b40fc3c89dc0f758 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73bfe00640 1 -- 172.21.15.71:0/2707383392 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b40b0070 con 0x7f73c015f990 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73bfe00640 1 -- 172.21.15.71:0/2707383392 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b40ab600 con 0x7f73c015f990 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73bfe00640 1 -- 172.21.15.71:0/2707383392 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b40ab9d0 con 0x7f73c015f990 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 -- 172.21.15.71:0/2707383392 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 msgr2=0x7f73c00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 --2- 172.21.15.71:0/2707383392 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f73c00b2150 tx=0x7f73b401c520 comp rx=0 tx=0).stop 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 -- 172.21.15.71:0/2707383392 shutdown_connections 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.71:3300/0 conn(0x7f73c00d18c0 0x7f73c00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 --2- 172.21.15.71:0/2707383392 >> v2:172.21.15.39:3300/0 conn(0x7f73c00d0f20 0x7f73c00d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 --2- 172.21.15.71:0/2707383392 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c015f990 0x7f73c00b4530 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 -- 172.21.15.71:0/2707383392 >> 172.21.15.71:0/2707383392 conn(0x7f73c00d3020 msgr2=0x7f73c00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 -- 172.21.15.71:0/2707383392 shutdown_connections 2024-04-26T23:25:50.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 -- 172.21.15.71:0/2707383392 wait complete. 2024-04-26T23:25:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.406+0000 7f73c8000640 1 Processor -- start 2024-04-26T23:25:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- start start 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73c00d0f20 0x7f73c0158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 0x7f73c0158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00b32b0 con 0x7f73c00d0f20 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00b3130 con 0x7f73c015f990 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f73c00b3430 con 0x7f73c00d18c0 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c4c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 0x7f73c0158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47022/0 (socket says 172.21.15.71:47022) 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c4c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 0x7f73c0158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48504/0 (socket says 172.21.15.71:48504) 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 -- 172.21.15.71:0/1372601625 learned_addr learned my addr 172.21.15.71:0/1372601625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c5600640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73c00d0f20 0x7f73c0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 -- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 msgr2=0x7f73c0158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 0x7f73c0158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 -- 172.21.15.71:0/1372601625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73c00d0f20 msgr2=0x7f73c0158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73c00d0f20 0x7f73c0158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 -- 172.21.15.71:0/1372601625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c015a820 con 0x7f73c015f990 2024-04-26T23:25:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c6000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73b800efc0 tx=0x7f73b8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8018030 con 0x7f73c015f990 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c0159d80 con 0x7f73c015f990 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b800cde0 con 0x7f73c015f990 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8003bc0 con 0x7f73c015f990 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01597c0 con 0x7f73c015f990 2024-04-26T23:25:50.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f73b801b070 con 0x7f73c015f990 2024-04-26T23:25:50.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f73b801db50 con 0x7f73c015f990 2024-04-26T23:25:50.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.410+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c006a720 con 0x7f73c015f990 2024-04-26T23:25:50.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.414+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f73b8022070 con 0x7f73c015f990 2024-04-26T23:25:50.474 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.470+0000 7f8db642a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:25:50.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.478+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63566f33-5a5d-48b5-b184-8d3d9a3bcd0b", "id": 4} v 0) -- 0x7f73c0074580 con 0x7f73c015f990 2024-04-26T23:25:50.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73bd600640 1 -- 172.21.15.71:0/1372601625 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63566f33-5a5d-48b5-b184-8d3d9a3bcd0b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f73b8010040 con 0x7f73c015f990 2024-04-26T23:25:50.488 INFO:teuthology.orchestra.run.smithi071.stdout:4 2024-04-26T23:25:50.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 msgr2=0x7f73c015fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73b800efc0 tx=0x7f73b8009f90 comp rx=0 tx=0).stop 2024-04-26T23:25:50.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 shutdown_connections 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73c015f990 0x7f73c015fe80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73c00d18c0 0x7f73c0158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 --2- 172.21.15.71:0/1372601625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73c00d0f20 0x7f73c0158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 >> 172.21.15.71:0/1372601625 conn(0x7f73c00d3020 msgr2=0x7f73c015d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 shutdown_connections 2024-04-26T23:25:50.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.486+0000 7f73c8000640 1 -- 172.21.15.71:0/1372601625 wait complete. 2024-04-26T23:25:50.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new dbe149e3-9a5c-4e70-b241-5d71142ab381 5 2024-04-26T23:25:50.539 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.538+0000 7f8db642a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:25:50.587 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.586+0000 7f7567f7b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:25:50.630 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.626+0000 7f8db642a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:25:50.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 Processor -- start 2024-04-26T23:25:50.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 -- start start 2024-04-26T23:25:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe40c06c3d0 0x7fe40c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe40c143140 0x7fe40c0d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c15dc40 con 0x7fe40c1406a0 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c0d09b0 con 0x7fe40c143140 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe410a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c15df20 con 0x7fe40c06c3d0 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe40c06c3d0 0x7fe40c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe401400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe40c1406a0 0x7fe40c06c7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47828/0 (socket says 172.21.15.71:47828) 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe401400640 1 -- 172.21.15.71:0/4088555659 learned_addr learned my addr 172.21.15.71:0/4088555659 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe40a800640 1 --2- 172.21.15.71:0/4088555659 >> v2:172.21.15.39:3300/0 conn(0x7fe40c143140 0x7fe40c0d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409e00640 1 -- 172.21.15.71:0/4088555659 >> v2:172.21.15.39:3300/0 conn(0x7fe40c143140 msgr2=0x7fe40c0d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409e00640 1 --2- 172.21.15.71:0/4088555659 >> v2:172.21.15.39:3300/0 conn(0x7fe40c143140 0x7fe40c0d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409e00640 1 -- 172.21.15.71:0/4088555659 >> v1:172.21.15.71:6789/0 conn(0x7fe40c1406a0 legacy=0x7fe40c06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409e00640 1 -- 172.21.15.71:0/4088555659 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c15e200 con 0x7fe40c06c3d0 2024-04-26T23:25:50.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.642+0000 7fe409400640 1 -- 172.21.15.71:0/4088555659 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953579734 0 0) 0x7fe40c15dc40 con 0x7fe40c1406a0 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe409e00640 1 --2- 172.21.15.71:0/4088555659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c15d630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe40c074390 tx=0x7fe3fc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca2be8e0e8dfd3e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe409400640 1 -- 172.21.15.71:0/4088555659 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0b0070 con 0x7fe40c06c3d0 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe409400640 1 -- 172.21.15.71:0/4088555659 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0ab600 con 0x7fe40c06c3d0 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe409400640 1 -- 172.21.15.71:0/4088555659 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0ab9d0 con 0x7fe40c06c3d0 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 -- 172.21.15.71:0/4088555659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 msgr2=0x7fe40c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 --2- 172.21.15.71:0/4088555659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c15d630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe40c074390 tx=0x7fe3fc01c480 comp rx=0 tx=0).stop 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 -- 172.21.15.71:0/4088555659 shutdown_connections 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 --2- 172.21.15.71:0/4088555659 >> v2:172.21.15.39:3300/0 conn(0x7fe40c143140 0x7fe40c0d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 --2- 172.21.15.71:0/4088555659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c15d630 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 -- 172.21.15.71:0/4088555659 >> 172.21.15.71:0/4088555659 conn(0x7fe40c0b3be0 msgr2=0x7fe40c0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 -- 172.21.15.71:0/4088555659 shutdown_connections 2024-04-26T23:25:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.646+0000 7fe410a00640 1 -- 172.21.15.71:0/4088555659 wait complete. 2024-04-26T23:25:50.653 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.650+0000 7f7567f7b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:25:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 Processor -- start 2024-04-26T23:25:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 -- start start 2024-04-26T23:25:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 0x7fe40c1fb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe40c143140 0x7fe40c1f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c169df0 con 0x7fe40c143140 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c169c70 con 0x7fe40c06c3d0 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe410a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c169f70 con 0x7fe40c1406a0 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe409e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe401400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 0x7fe40c1fb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe409e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47040/0 (socket says 172.21.15.71:47040) 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.650+0000 7fe409e00640 1 -- 172.21.15.71:0/3644154273 learned_addr learned my addr 172.21.15.71:0/3644154273 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe40a800640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe40c143140 0x7fe40c1f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 -- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 msgr2=0x7fe40c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 -- 172.21.15.71:0/3644154273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe40c143140 msgr2=0x7fe40c1f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe40c143140 0x7fe40c1f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 -- 172.21.15.71:0/3644154273 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c1fb8e0 con 0x7fe40c1406a0 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe401400640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 0x7fe40c1fb190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0730b0 tx=0x7fe3f400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40074e0 con 0x7fe40c1406a0 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f40047f0 con 0x7fe40c1406a0 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4004be0 con 0x7fe40c1406a0 2024-04-26T23:25:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c1fbbc0 con 0x7fe40c1406a0 2024-04-26T23:25:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c1f7850 con 0x7fe40c1406a0 2024-04-26T23:25:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3f4011070 con 0x7fe40c1406a0 2024-04-26T23:25:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe3f4004d80 con 0x7fe40c1406a0 2024-04-26T23:25:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.654+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c06a720 con 0x7fe40c1406a0 2024-04-26T23:25:50.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.658+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe3f401d3f0 con 0x7fe40c1406a0 2024-04-26T23:25:50.699 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.698+0000 7f8db642a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:25:50.718 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.714+0000 7f7567f7b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:25:50.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.726+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dbe149e3-9a5c-4e70-b241-5d71142ab381", "id": 5} v 0) -- 0x7fe40c1fc070 con 0x7fe40c1406a0 2024-04-26T23:25:50.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe402a00640 1 -- 172.21.15.71:0/3644154273 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbe149e3-9a5c-4e70-b241-5d71142ab381", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe3f401d5d0 con 0x7fe40c1406a0 2024-04-26T23:25:50.733 INFO:teuthology.orchestra.run.smithi071.stdout:5 2024-04-26T23:25:50.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 msgr2=0x7fe40c1fb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 0x7fe40c1fb190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0730b0 tx=0x7fe3f400c8c0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 shutdown_connections 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe40c143140 0x7fe40c1f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe40c1406a0 0x7fe40c1fb190 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 --2- 172.21.15.71:0/3644154273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe40c06c3d0 0x7fe40c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 >> 172.21.15.71:0/3644154273 conn(0x7fe40c0b3be0 msgr2=0x7fe40c0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 shutdown_connections 2024-04-26T23:25:50.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.730+0000 7fe410a00640 1 -- 172.21.15.71:0/3644154273 wait complete. 2024-04-26T23:25:50.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 8fa758eb-40db-4bff-9ff9-ba4c19112208 6 2024-04-26T23:25:50.812 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.810+0000 7f7567f7b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:25:50.870 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.866+0000 7f8db642a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:25:50.876 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.874+0000 7f7567f7b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:25:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 Processor -- start 2024-04-26T23:25:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 -- start start 2024-04-26T23:25:50.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f38780739e0 0x7f38780b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387815d4a0 con 0x7f387815d0c0 2024-04-26T23:25:50.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38780b5c10 con 0x7f38780b5420 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f387ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f38780b5ef0 con 0x7f38780739e0 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.930+0000 7f386fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f38780739e0 0x7f38780b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f387cc00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f38780b5420 0x7f3878070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47842/0 (socket says 172.21.15.71:47842) 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f387cc00640 1 -- 172.21.15.71:0/3643347074 learned_addr learned my addr 172.21.15.71:0/3643347074 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f386fe00640 1 -- 172.21.15.71:0/3643347074 >> v1:172.21.15.71:6789/0 conn(0x7f38780b5420 legacy=0x7f3878070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f386fe00640 1 -- 172.21.15.71:0/3643347074 >> v1:172.21.15.39:6789/0 conn(0x7f387815d0c0 legacy=0x7f38780732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f386fe00640 1 -- 172.21.15.71:0/3643347074 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387806f6a0 con 0x7f38780739e0 2024-04-26T23:25:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f386fe00640 1 --2- 172.21.15.71:0/3643347074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780739e0 0x7f38780b4ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38600097c0 tx=0x7f386001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deaf31b20515e85c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f3877400640 1 -- 172.21.15.71:0/3643347074 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600b0070 con 0x7f38780739e0 2024-04-26T23:25:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f3877400640 1 -- 172.21.15.71:0/3643347074 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38600ab600 con 0x7f38780739e0 2024-04-26T23:25:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.934+0000 7f3877400640 1 -- 172.21.15.71:0/3643347074 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600ab9d0 con 0x7f38780739e0 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- 172.21.15.71:0/3643347074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780739e0 msgr2=0x7f38780b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 --2- 172.21.15.71:0/3643347074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780739e0 0x7f38780b4ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38600097c0 tx=0x7f386001c410 comp rx=0 tx=0).stop 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- 172.21.15.71:0/3643347074 shutdown_connections 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 --2- 172.21.15.71:0/3643347074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780739e0 0x7f38780b4ee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- 172.21.15.71:0/3643347074 >> 172.21.15.71:0/3643347074 conn(0x7f38780b3be0 msgr2=0x7f38780b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- 172.21.15.71:0/3643347074 shutdown_connections 2024-04-26T23:25:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- 172.21.15.71:0/3643347074 wait complete. 2024-04-26T23:25:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 Processor -- start 2024-04-26T23:25:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- start start 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38780739e0 0x7f387814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 0x7f3878158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f38780714b0 con 0x7f387815d0c0 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3878071330 con 0x7f38780b5420 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3878169f00 con 0x7f38780739e0 2024-04-26T23:25:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f3877e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38780739e0 0x7f387814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47050/0 (socket says 172.21.15.71:47050) 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 -- 172.21.15.71:0/3545146971 learned_addr learned my addr 172.21.15.71:0/3545146971 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387cc00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 0x7f3878158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 -- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38780739e0 msgr2=0x7f387814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38780739e0 0x7f387814ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 -- 172.21.15.71:0/3545146971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 msgr2=0x7f3878158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 0x7f3878158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f386fe00640 1 -- 172.21.15.71:0/3545146971 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3878156b90 con 0x7f38780b5420 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.938+0000 7f387cc00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 0x7f3878158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f386fe00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae040 tx=0x7f38600191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600b8030 con 0x7f38780b5420 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38600b4410 con 0x7f38780b5420 2024-04-26T23:25:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600b0040 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3878156e30 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38780b0e10 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38600bb070 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f38600ab4c0 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387806a720 con 0x7f38780b5420 2024-04-26T23:25:50.945 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:50.942+0000 7f8db642a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:25:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:50.946+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f38600c2070 con 0x7f38780b5420 2024-04-26T23:25:50.971 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:50.970+0000 7f7567f7b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:25:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.010+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8fa758eb-40db-4bff-9ff9-ba4c19112208", "id": 6} v 0) -- 0x7f38780703d0 con 0x7f38780b5420 2024-04-26T23:25:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.018+0000 7f3874c00640 1 -- 172.21.15.71:0/3545146971 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fa758eb-40db-4bff-9ff9-ba4c19112208", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3860016090 con 0x7f38780b5420 2024-04-26T23:25:51.022 INFO:teuthology.orchestra.run.smithi071.stdout:6 2024-04-26T23:25:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 msgr2=0x7f3878158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae040 tx=0x7f38600191b0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 shutdown_connections 2024-04-26T23:25:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f387815d0c0 0x7f3878158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38780b5420 0x7f3878158860 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 --2- 172.21.15.71:0/3545146971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38780739e0 0x7f387814ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 >> 172.21.15.71:0/3545146971 conn(0x7f38780b3be0 msgr2=0x7f38781563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 shutdown_connections 2024-04-26T23:25:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.022+0000 7f387ec00640 1 -- 172.21.15.71:0/3545146971 wait complete. 2024-04-26T23:25:51.038 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:51.034+0000 7f7567f7b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:25:51.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 184cc56f-ebf8-4c18-bbac-b550582b5720 7 2024-04-26T23:25:51.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 Processor -- start 2024-04-26T23:25:51.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 -- start start 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd2bc0d04d0 0x7fd2bc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2bc0d5890 con 0x7fd2bc0d5410 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc0d0960 con 0x7fd2bc0d04d0 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2c2400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc0d1140 con 0x7fd2bc15f490 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48544/0 (socket says 172.21.15.71:48544) 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 -- 172.21.15.71:0/2660217894 learned_addr learned my addr 172.21.15.71:0/2660217894 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bbe00640 1 --2- 172.21.15.71:0/2660217894 >> v2:172.21.15.39:3300/0 conn(0x7fd2bc0d04d0 0x7fd2bc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 -- 172.21.15.71:0/2660217894 >> v2:172.21.15.39:3300/0 conn(0x7fd2bc0d04d0 msgr2=0x7fd2bc0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 --2- 172.21.15.71:0/2660217894 >> v2:172.21.15.39:3300/0 conn(0x7fd2bc0d04d0 0x7fd2bc0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 -- 172.21.15.71:0/2660217894 >> v1:172.21.15.39:6789/0 conn(0x7fd2bc0d5410 legacy=0x7fd2bc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.174+0000 7fd2bb400640 1 -- 172.21.15.71:0/2660217894 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc0d0b80 con 0x7fd2bc15f490 2024-04-26T23:25:51.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2bb400640 1 --2- 172.21.15.71:0/2660217894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009870 tx=0x7fd2ac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e8b61b5676131e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:51.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2baa00640 1 -- 172.21.15.71:0/2660217894 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0aa600 con 0x7fd2bc15f490 2024-04-26T23:25:51.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2baa00640 1 -- 172.21.15.71:0/2660217894 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0af070 con 0x7fd2bc15f490 2024-04-26T23:25:51.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2baa00640 1 -- 172.21.15.71:0/2660217894 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0aa9c0 con 0x7fd2bc15f490 2024-04-26T23:25:51.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 -- 172.21.15.71:0/2660217894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 msgr2=0x7fd2bc0d4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 --2- 172.21.15.71:0/2660217894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009870 tx=0x7fd2ac01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 -- 172.21.15.71:0/2660217894 shutdown_connections 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 --2- 172.21.15.71:0/2660217894 >> v2:172.21.15.39:3300/0 conn(0x7fd2bc0d04d0 0x7fd2bc0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 --2- 172.21.15.71:0/2660217894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc15f490 0x7fd2bc0d4ed0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 -- 172.21.15.71:0/2660217894 >> 172.21.15.71:0/2660217894 conn(0x7fd2bc08ebf0 msgr2=0x7fd2bc09e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 -- 172.21.15.71:0/2660217894 shutdown_connections 2024-04-26T23:25:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.178+0000 7fd2c2400640 1 -- 172.21.15.71:0/2660217894 wait complete. 2024-04-26T23:25:51.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 Processor -- start 2024-04-26T23:25:51.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- start start 2024-04-26T23:25:51.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2bc0d04d0 0x7fd2bc09f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2bc15f490 0x7fd2bc0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc15f9f0 con 0x7fd2bc15f490 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc15f870 con 0x7fd2bc0d04d0 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc0ca3f0 con 0x7fd2bc0d5410 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48546/0 (socket says 172.21.15.71:48546) 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 -- 172.21.15.71:0/1370195046 learned_addr learned my addr 172.21.15.71:0/1370195046 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2bb400640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2bc0d04d0 0x7fd2bc09f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2bbe00640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2bc15f490 0x7fd2bc0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 -- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2bc0d04d0 msgr2=0x7fd2bc09f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2bc0d04d0 0x7fd2bc09f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 -- 172.21.15.71:0/1370195046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2bc15f490 msgr2=0x7fd2bc0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2bc15f490 0x7fd2bc0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 -- 172.21.15.71:0/1370195046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc0b87a0 con 0x7fd2bc0d5410 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b2a00640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c420 tx=0x7fd2a400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40052d0 con 0x7fd2bc0d5410 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4005470 con 0x7fd2bc0d5410 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc0a1d60 con 0x7fd2bc0d5410 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007260 con 0x7fd2bc0d5410 2024-04-26T23:25:51.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc0a2320 con 0x7fd2bc0d5410 2024-04-26T23:25:51.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2a4007400 con 0x7fd2bc0d5410 2024-04-26T23:25:51.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd2a4011bf0 con 0x7fd2bc0d5410 2024-04-26T23:25:51.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.182+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc06a720 con 0x7fd2bc0d5410 2024-04-26T23:25:51.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.186+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd2bc0b87a0 con 0x7fd2bc0d5410 2024-04-26T23:25:51.215 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:51.210+0000 7f7567f7b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:25:51.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.270+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "184cc56f-ebf8-4c18-bbac-b550582b5720", "id": 7} v 0) -- 0x7fd2bc076080 con 0x7fd2bc0d5410 2024-04-26T23:25:51.288 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:51.286+0000 7f7567f7b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:25:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.286+0000 7fd2b3e00640 1 -- 172.21.15.71:0/1370195046 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "184cc56f-ebf8-4c18-bbac-b550582b5720", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd2a4003600 con 0x7fd2bc0d5410 2024-04-26T23:25:51.290 INFO:teuthology.orchestra.run.smithi071.stdout:7 2024-04-26T23:25:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 msgr2=0x7fd2bc0cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c420 tx=0x7fd2a400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 shutdown_connections 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2bc15f490 0x7fd2bc0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2bc0d5410 0x7fd2bc0cdc70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 --2- 172.21.15.71:0/1370195046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2bc0d04d0 0x7fd2bc09f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 >> 172.21.15.71:0/1370195046 conn(0x7fd2bc08ebf0 msgr2=0x7fd2bc15c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 shutdown_connections 2024-04-26T23:25:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:25:51.290+0000 7fd2c2400640 1 -- 172.21.15.71:0/1370195046 wait complete. 2024-04-26T23:25:51.323 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:25:51.324 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:25:51.327 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:25:51.327 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:25:51.327 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:25:51.330 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:25:51.331 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:25:51.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:25:51.334 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:25:51.334 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:25:51.334 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:25:51.338 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:25:51.338 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:25:51.338 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:25:51.341 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:25:51.342 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:25:51.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:25:51.345 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:25:51.345 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:25:51.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:25:51.348 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:25:51.348 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:25:51.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:25:51.351 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:25:51.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:25:51.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.530+0000 7f63d3600640 1 Processor -- start 2024-04-26T23:25:51.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.530+0000 7f63d3600640 1 -- start start 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d3600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63cc0d0280 0x7f63cc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d3600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc0d1230 con 0x7f63cc15f640 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d3600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc0d3e10 con 0x7f63cc06de60 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d3600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f63cc15fa20 con 0x7f63cc0d0280 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d0c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f63cc15f640 0x7f63cc0d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:45334/0 (socket says 172.21.15.39:45334) 2024-04-26T23:25:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63d0c00640 1 -- 172.21.15.39:0/704000629 learned_addr learned my addr 172.21.15.39:0/704000629 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63c3e00640 1 --2- 172.21.15.39:0/704000629 >> v2:172.21.15.71:3300/0 conn(0x7f63cc0d0280 0x7f63cc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776695328 0 0) 0x7f63cc0d1230 con 0x7f63cc15f640 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0003530 con 0x7f63cc15f640 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63c3e00640 1 -- 172.21.15.39:0/704000629 >> v1:172.21.15.71:6789/0 conn(0x7f63cc06de60 legacy=0x7f63cc0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504430619 0 0) 0x7f63cc0d3e10 con 0x7f63cc06de60 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63c3e00640 1 -- 172.21.15.39:0/704000629 >> v1:172.21.15.39:6789/0 conn(0x7f63cc15f640 legacy=0x7f63cc0d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.534+0000 7f63c3e00640 1 -- 172.21.15.39:0/704000629 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0d0780 con 0x7f63cc0d0280 2024-04-26T23:25:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63c3e00640 1 --2- 172.21.15.39:0/704000629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc06d780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63b40097c0 tx=0x7f63b401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e78791834cc548e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b40b0070 con 0x7f63cc0d0280 2024-04-26T23:25:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b40ab600 con 0x7f63cc0d0280 2024-04-26T23:25:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63cbe00640 1 -- 172.21.15.39:0/704000629 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b40ab9d0 con 0x7f63cc0d0280 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- 172.21.15.39:0/704000629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 msgr2=0x7f63cc06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 --2- 172.21.15.39:0/704000629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc06d780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63b40097c0 tx=0x7f63b401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- 172.21.15.39:0/704000629 shutdown_connections 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 --2- 172.21.15.39:0/704000629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc06d780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- 172.21.15.39:0/704000629 >> 172.21.15.39:0/704000629 conn(0x7f63cc0d2ff0 msgr2=0x7f63cc0d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- 172.21.15.39:0/704000629 shutdown_connections 2024-04-26T23:25:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- 172.21.15.39:0/704000629 wait complete. 2024-04-26T23:25:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 Processor -- start 2024-04-26T23:25:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- start start 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63cc06de60 0x7f63cc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc16d920 con 0x7f63cc15f640 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0d1b20 con 0x7f63cc0d0280 2024-04-26T23:25:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.538+0000 7f63d3600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f63cc16daa0 con 0x7f63cc06de60 2024-04-26T23:25:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55468/0 (socket says 172.21.15.39:55468) 2024-04-26T23:25:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 -- 172.21.15.39:0/1695207518 learned_addr learned my addr 172.21.15.39:0/1695207518 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d0c00640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63cc06de60 0x7f63cc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 -- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63cc06de60 msgr2=0x7f63cc15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63cc06de60 0x7f63cc15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 -- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 msgr2=0x7f63cc14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 -- 172.21.15.39:0/1695207518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc14f550 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c3e00640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d1600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c780 tx=0x7f63c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4003db0 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4005070 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005460 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc0c7d80 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc0c8340 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63c4005600 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f63c4012400 con 0x7f63cc15f640 2024-04-26T23:25:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.542+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc050740 con 0x7f63cc15f640 2024-04-26T23:25:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.546+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f63c400a640 con 0x7f63cc15f640 2024-04-26T23:25:51.586 INFO:tasks.ceph.mgr.x.smithi071.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:25:51.587 INFO:tasks.ceph.mgr.x.smithi071.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:25:51.587 INFO:tasks.ceph.mgr.x.smithi071.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:25:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63cc0d34d0 con 0x7f63cc15f640 2024-04-26T23:25:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63c9600640 1 -- 172.21.15.39:0/1695207518 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f63c400a820 con 0x7f63cc15f640 2024-04-26T23:25:51.606 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:25:51.606 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:25:51.275396+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:25:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 msgr2=0x7f63cc1f9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c780 tx=0x7f63c400cc40 comp rx=0 tx=0).stop 2024-04-26T23:25:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 shutdown_connections 2024-04-26T23:25:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63cc15f640 0x7f63cc1f9cb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63cc0d0280 0x7f63cc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 --2- 172.21.15.39:0/1695207518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63cc06de60 0x7f63cc15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:51.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.602+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 >> 172.21.15.39:0/1695207518 conn(0x7f63cc0d2ff0 msgr2=0x7f63cc0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:51.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.606+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 shutdown_connections 2024-04-26T23:25:51.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:25:51.606+0000 7f63d3600640 1 -- 172.21.15.39:0/1695207518 wait complete. 2024-04-26T23:25:51.627 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:25:51.627 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:25:51.634 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:51.630+0000 7f8db642a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:25:51.784 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:51.782+0000 7f8db642a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:25:51.954 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:51.950+0000 7f8db642a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:25:51.995 INFO:tasks.ceph.mgr.y.smithi039.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:25:51.995 INFO:tasks.ceph.mgr.y.smithi039.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:25:51.995 INFO:tasks.ceph.mgr.y.smithi039.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:25:51.999 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-04-26T23:25:51.998+0000 7f09fd5207c0 -1 Falling back to public interface 2024-04-26T23:25:52.004 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-04-26T23:25:52.002+0000 7f9e7a3637c0 -1 Falling back to public interface 2024-04-26T23:25:52.011 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-04-26T23:25:52.010+0000 7fad030cd7c0 -1 Falling back to public interface 2024-04-26T23:25:52.016 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-04-26T23:25:52.014+0000 7f46498c17c0 -1 Falling back to public interface 2024-04-26T23:25:52.016 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-04-26T23:25:52.014+0000 7fabf6dc27c0 -1 Falling back to public interface 2024-04-26T23:25:52.024 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-04-26T23:25:52.022+0000 7fc1bc10b7c0 -1 Falling back to public interface 2024-04-26T23:25:52.024 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-04-26T23:25:52.022+0000 7fc6aa5b67c0 -1 Falling back to public interface 2024-04-26T23:25:52.027 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-04-26T23:25:52.026+0000 7fad7c02b7c0 -1 Falling back to public interface 2024-04-26T23:25:52.028 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:52.026+0000 7f8db642a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:25:52.047 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:52.046+0000 7f7567f7b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:25:52.178 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:52.174+0000 7f8db642a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:25:52.203 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:52.198+0000 7f7567f7b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:25:52.434 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:25:52.504 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:52.502+0000 7f7567f7b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:25:52.565 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 Processor -- start 2024-04-26T23:25:52.566 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 -- start start 2024-04-26T23:25:52.567 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 0x7feb84070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:52.567 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7feb84160ac0 0x7feb84160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:52.567 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb84161490 con 0x7feb84148de0 2024-04-26T23:25:52.567 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7feb84160830 con 0x7feb84160ac0 2024-04-26T23:25:52.568 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb8a800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7feb8406d6d0 con 0x7feb840706b0 2024-04-26T23:25:52.568 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.562+0000 7feb83e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7feb84160ac0 0x7feb84160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:52.568 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb7be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 0x7feb84070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:52.568 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7feb84160ac0 0x7feb84160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55478/0 (socket says 172.21.15.39:55478) 2024-04-26T23:25:52.568 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 -- 172.21.15.39:0/1233398014 learned_addr learned my addr 172.21.15.39:0/1233398014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb82a00640 1 -- 172.21.15.39:0/1233398014 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585413627 0 0) 0x7feb84161490 con 0x7feb84148de0 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 -- 172.21.15.39:0/1233398014 >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 msgr2=0x7feb84070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 --2- 172.21.15.39:0/1233398014 >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 0x7feb84070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 -- 172.21.15.39:0/1233398014 >> v1:172.21.15.71:6789/0 conn(0x7feb84148de0 legacy=0x7feb8406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 -- 172.21.15.39:0/1233398014 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8406d9b0 con 0x7feb84160ac0 2024-04-26T23:25:52.569 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb7be00640 1 --2- 172.21.15.39:0/1233398014 >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 0x7feb84070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:25:52.570 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb83e00640 1 --2- 172.21.15.39:0/1233398014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84160ac0 0x7feb84160f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb840b8de0 tx=0x7feb7c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7a0d2d062f0a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:52.571 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb82a00640 1 -- 172.21.15.39:0/1233398014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0a57a0 con 0x7feb84160ac0 2024-04-26T23:25:52.571 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb82a00640 1 -- 172.21.15.39:0/1233398014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0a5940 con 0x7feb84160ac0 2024-04-26T23:25:52.571 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.566+0000 7feb82a00640 1 -- 172.21.15.39:0/1233398014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0a5d10 con 0x7feb84160ac0 2024-04-26T23:25:52.572 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- 172.21.15.39:0/1233398014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84160ac0 msgr2=0x7feb84160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:52.572 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- 172.21.15.39:0/1233398014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84160ac0 0x7feb84160f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb840b8de0 tx=0x7feb7c01c9f0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- 172.21.15.39:0/1233398014 shutdown_connections 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- 172.21.15.39:0/1233398014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84160ac0 0x7feb84160f50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- 172.21.15.39:0/1233398014 >> v2:172.21.15.71:3300/0 conn(0x7feb840706b0 0x7feb84070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- 172.21.15.39:0/1233398014 >> 172.21.15.39:0/1233398014 conn(0x7feb8406c710 msgr2=0x7feb840b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- 172.21.15.39:0/1233398014 shutdown_connections 2024-04-26T23:25:52.573 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- 172.21.15.39:0/1233398014 wait complete. 2024-04-26T23:25:52.577 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 Processor -- start 2024-04-26T23:25:52.577 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- start start 2024-04-26T23:25:52.577 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 0x7feb8415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:52.577 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:52.577 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb84160ac0 0x7feb8415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb84160450 con 0x7feb84148de0 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb841602d0 con 0x7feb840706b0 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb8a800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7feb841605d0 con 0x7feb84160ac0 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb83400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 0x7feb8415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55488/0 (socket says 172.21.15.39:55488) 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb83400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 0x7feb8415b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:51022/0 (socket says 172.21.15.39:51022) 2024-04-26T23:25:52.578 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 -- 172.21.15.39:0/755554751 learned_addr learned my addr 172.21.15.39:0/755554751 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb83e00640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb84160ac0 0x7feb8415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 -- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb84160ac0 msgr2=0x7feb8415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb84160ac0 0x7feb8415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 -- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 msgr2=0x7feb8415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 0x7feb8415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.570+0000 7feb7be00640 1 -- 172.21.15.39:0/755554751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb840cc460 con 0x7feb84148de0 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7be00640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00ebe0 tx=0x7feb6c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:52.579 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c017070 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c00cc30 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c013470 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb840cc740 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb840ccd00 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb6c01a070 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7feb6c01c4a0 con 0x7feb84148de0 2024-04-26T23:25:52.580 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb84069dc0 con 0x7feb84148de0 2024-04-26T23:25:52.581 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.574+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7feb6c013610 con 0x7feb84148de0 2024-04-26T23:25:52.583 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:52.582+0000 7f7567f7b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:25:52.638 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.634+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb840b6130 con 0x7feb84148de0 2024-04-26T23:25:52.640 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.634+0000 7feb7b400640 1 -- 172.21.15.39:0/755554751 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7feb6c0137f0 con 0x7feb84148de0 2024-04-26T23:25:52.641 INFO:teuthology.misc.health.smithi039.stdout: 2024-04-26T23:25:52.641 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:25:51.275396+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 msgr2=0x7feb8415c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00ebe0 tx=0x7feb6c00c520 comp rx=0 tx=0).stop 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 shutdown_connections 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb84160ac0 0x7feb8415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb84148de0 0x7feb8415c620 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 --2- 172.21.15.39:0/755554751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840706b0 0x7feb8415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 >> 172.21.15.39:0/755554751 conn(0x7feb8406c710 msgr2=0x7feb84162010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 shutdown_connections 2024-04-26T23:25:52.643 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:52.638+0000 7feb8a800640 1 -- 172.21.15.39:0/755554751 wait complete. 2024-04-26T23:25:52.657 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:25:52.746 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:52.742+0000 7f7567f7b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:25:52.865 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:52.862+0000 7f8db642a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:25:52.952 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:52.950+0000 7f8db642a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:25:53.153 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:53.150+0000 7f8db642a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:25:53.238 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:53.234+0000 7f8db642a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:25:53.560 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:53.558+0000 7f7567f7b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:25:53.564 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:53.562+0000 7f8db642a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:25:53.639 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:53.638+0000 7f8db642a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:25:53.652 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:53.650+0000 7f7567f7b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:25:53.869 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:53.866+0000 7f7567f7b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:25:53.958 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:53.954+0000 7f7567f7b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:25:54.305 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:54.302+0000 7f7567f7b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:25:54.380 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-04-26T23:25:54.378+0000 7f7567f7b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:25:54.663 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:54.662+0000 7f8d5ba00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:25:54.664 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:25:54.662+0000 7f8d5ba00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:25:55.861 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-04-26T23:25:55.858+0000 7f09fd5207c0 -1 osd.4 0 log_to_monitors true 2024-04-26T23:25:55.925 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-04-26T23:25:55.922+0000 7fad030cd7c0 -1 osd.7 0 log_to_monitors true 2024-04-26T23:25:55.927 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-04-26T23:25:55.926+0000 7fabf6dc27c0 -1 osd.1 0 log_to_monitors true 2024-04-26T23:25:55.986 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-04-26T23:25:55.982+0000 7f46498c17c0 -1 osd.5 0 log_to_monitors true 2024-04-26T23:25:56.001 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-04-26T23:25:55.998+0000 7fad7c02b7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T23:25:56.025 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-04-26T23:25:56.022+0000 7fc6aa5b67c0 -1 osd.3 0 log_to_monitors true 2024-04-26T23:25:56.062 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-04-26T23:25:56.058+0000 7f9e7a3637c0 -1 osd.0 0 log_to_monitors true 2024-04-26T23:25:56.089 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-04-26T23:25:56.086+0000 7fc1bc10b7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T23:25:59.464 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:25:59.666 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.662+0000 7fd711200640 1 Processor -- start 2024-04-26T23:25:59.666 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.662+0000 7fd711200640 1 -- start start 2024-04-26T23:25:59.667 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd711200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:36412/0 (socket says 172.21.15.39:36412) 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd711200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd70c073ca0 0x7fd70c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd711200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c0726a0 con 0x7fd70c0afce0 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd711200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd70c072940 con 0x7fd70c073ca0 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd711200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd70c072c20 con 0x7fd70c15c150 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 -- 172.21.15.39:0/2386113253 learned_addr learned my addr 172.21.15.39:0/2386113253 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:59.669 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70be00640 1 --2- 172.21.15.39:0/2386113253 >> v2:172.21.15.71:3300/0 conn(0x7fd70c073ca0 0x7fd70c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.677 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 -- 172.21.15.39:0/2386113253 >> v2:172.21.15.71:3300/0 conn(0x7fd70c073ca0 msgr2=0x7fd70c0b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:25:59.677 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 --2- 172.21.15.39:0/2386113253 >> v2:172.21.15.71:3300/0 conn(0x7fd70c073ca0 0x7fd70c0b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:59.678 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 -- 172.21.15.39:0/2386113253 >> v1:172.21.15.39:6789/0 conn(0x7fd70c0afce0 legacy=0x7fd70c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:59.678 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.666+0000 7fd70b400640 1 -- 172.21.15.39:0/2386113253 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c0af4e0 con 0x7fd70c15c150 2024-04-26T23:25:59.678 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd70b400640 1 --2- 172.21.15.39:0/2386113253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d150 tx=0x7fd6f401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68251a24971bef1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:59.678 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd70a000640 1 -- 172.21.15.39:0/2386113253 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400b2d0 con 0x7fd70c15c150 2024-04-26T23:25:59.678 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd70a000640 1 -- 172.21.15.39:0/2386113253 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f400b470 con 0x7fd70c15c150 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd70a000640 1 -- 172.21.15.39:0/2386113253 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40a7c70 con 0x7fd70c15c150 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 -- 172.21.15.39:0/2386113253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 msgr2=0x7fd70c0b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 --2- 172.21.15.39:0/2386113253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d150 tx=0x7fd6f401ec70 comp rx=0 tx=0).stop 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 -- 172.21.15.39:0/2386113253 shutdown_connections 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 --2- 172.21.15.39:0/2386113253 >> v2:172.21.15.71:3300/0 conn(0x7fd70c073ca0 0x7fd70c0b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 --2- 172.21.15.39:0/2386113253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c15c150 0x7fd70c0b0340 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d150 tx=0x7fd6f401ec70 comp rx=0 tx=0).stop 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 -- 172.21.15.39:0/2386113253 >> 172.21.15.39:0/2386113253 conn(0x7fd70c0b2c70 msgr2=0x7fd70c0b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:25:59.679 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 -- 172.21.15.39:0/2386113253 shutdown_connections 2024-04-26T23:25:59.680 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.674+0000 7fd711200640 1 -- 172.21.15.39:0/2386113253 wait complete. 2024-04-26T23:25:59.685 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.682+0000 7fd711200640 1 Processor -- start 2024-04-26T23:25:59.692 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.686+0000 7fd711200640 1 -- start start 2024-04-26T23:25:59.694 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.690+0000 7fd711200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.695 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.690+0000 7fd711200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 0x7fd70c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.696 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 0x7fd70c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.697 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 0x7fd70c152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55524/0 (socket says 172.21.15.39:55524) 2024-04-26T23:25:59.697 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.697 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:51078/0 (socket says 172.21.15.39:51078) 2024-04-26T23:25:59.697 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70aa00640 1 -- 172.21.15.39:0/1655389094 learned_addr learned my addr 172.21.15.39:0/1655389094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:25:59.697 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 0x7fd70c143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.698 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c06f1e0 con 0x7fd70c0afce0 2024-04-26T23:25:59.698 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70be00640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 0x7fd70c143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.698 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c06f060 con 0x7fd70c073ca0 2024-04-26T23:25:59.698 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd70c06f360 con 0x7fd70c14fba0 2024-04-26T23:25:59.702 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 -- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 msgr2=0x7fd70c143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:59.704 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 0x7fd70c143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:59.704 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 -- 172.21.15.39:0/1655389094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 msgr2=0x7fd70c152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 0x7fd70c152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.694+0000 7fd70b400640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c1500a0 con 0x7fd70c073ca0 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd70b400640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ad000 tx=0x7fd6f401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd70be00640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 0x7fd70c143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4009600 con 0x7fd70c073ca0 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f40097a0 con 0x7fd70c073ca0 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4009bd0 con 0x7fd70c073ca0 2024-04-26T23:25:59.705 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c152e90 con 0x7fd70c073ca0 2024-04-26T23:25:59.706 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.698+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1528a0 con 0x7fd70c073ca0 2024-04-26T23:25:59.706 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.702+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70c050740 con 0x7fd70c073ca0 2024-04-26T23:25:59.707 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.702+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fd6f40c0020 con 0x7fd70c073ca0 2024-04-26T23:25:59.707 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.702+0000 7fd703400640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 0x7fd6e806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:25:59.707 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.702+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fd6f4120660 con 0x7fd70c073ca0 2024-04-26T23:25:59.707 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.702+0000 7fd70aa00640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 0x7fd6e806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:25:59.708 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.706+0000 7fd70aa00640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 0x7fd6e806a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd70c166df0 tx=0x7fd6fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:25:59.732 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:25:59.730+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6f4018860 con 0x7fd70c073ca0 2024-04-26T23:25:59.964 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-04-26T23:25:59.962+0000 7fad76400640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:25:59.986 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-04-26T23:25:59.982+0000 7facfea00640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:26:00.004 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-04-26T23:26:00.002+0000 7fad6c400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.020 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-04-26T23:26:00.018+0000 7facf4000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.048 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-04-26T23:26:00.046+0000 7f09f8400640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:26:00.051 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-04-26T23:26:00.050+0000 7f4645200640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:26:00.076 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-04-26T23:26:00.074+0000 7f09ee400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.076 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-04-26T23:26:00.074+0000 7f463a800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.100 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.098+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd70c06ff60 con 0x7fd70c073ca0 2024-04-26T23:26:00.102 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.098+0000 7fd703400640 1 -- 172.21.15.39:0/1655389094 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fd6f40f1a70 con 0x7fd70c073ca0 2024-04-26T23:26:00.102 INFO:teuthology.misc.health.smithi039.stdout: 2024-04-26T23:26:00.102 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":12,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:25:57.705500+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 msgr2=0x7fd6e806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 0x7fd6e806a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd70c166df0 tx=0x7fd6fc009040 comp rx=0 tx=0).stop 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 msgr2=0x7fd70c153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ad000 tx=0x7fd6f401ba10 comp rx=0 tx=0).stop 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 shutdown_connections 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6e80682f0 0x7fd6e806a7b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd70c14fba0 0x7fd70c143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:00.108 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c0afce0 0x7fd70c152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:00.109 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 --2- 172.21.15.39:0/1655389094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c073ca0 0x7fd70c153970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:00.109 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 >> 172.21.15.39:0/1655389094 conn(0x7fd70c0b2c70 msgr2=0x7fd70c15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:00.109 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 shutdown_connections 2024-04-26T23:26:00.109 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:00.106+0000 7fd711200640 1 -- 172.21.15.39:0/1655389094 wait complete. 2024-04-26T23:26:00.138 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:26:00.328 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-04-26T23:26:00.326+0000 7fabf1c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:26:00.350 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-04-26T23:26:00.346+0000 7f9e75200640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:26:00.357 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-04-26T23:26:00.354+0000 7fc6a5400640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:26:00.364 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-04-26T23:26:00.362+0000 7fabe7c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.385 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-04-26T23:26:00.382+0000 7fc69b400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.386 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-04-26T23:26:00.382+0000 7f9e6b200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:00.410 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-04-26T23:26:00.406+0000 7fc1b7000640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:26:00.449 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-04-26T23:26:00.446+0000 7fc1ad000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:26:06.945 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:07.086 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.082+0000 7fb850a00640 1 Processor -- start 2024-04-26T23:26:07.086 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.082+0000 7fb850a00640 1 -- start start 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.082+0000 7fb850a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb84c0d2990 0x7fb84c072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.082+0000 7fb850a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c072a60 0x7fb84c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb850a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84c0d0c20 con 0x7fb84c142340 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb850a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb84c142720 con 0x7fb84c0d2990 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb850a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c072090 con 0x7fb84c072a60 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb84c0d2990 0x7fb84c072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb84c0d2990 0x7fb84c072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41208/0 (socket says 172.21.15.39:41208) 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 -- 172.21.15.39:0/3539897604 learned_addr learned my addr 172.21.15.39:0/3539897604 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:07.088 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb84a800640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c072a60 0x7fb84c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.089 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 -- 172.21.15.39:0/3539897604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c072a60 msgr2=0x7fb84c1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:07.089 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c072a60 0x7fb84c1429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.091 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 -- 172.21.15.39:0/3539897604 >> v1:172.21.15.71:6789/0 conn(0x7fb84c142340 legacy=0x7fb84c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.091 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 -- 172.21.15.39:0/3539897604 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c0d0e90 con 0x7fb84c0d2990 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb843e00640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c0d2990 0x7fb84c072520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97bf4936bfee82d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.086+0000 7fb849400640 1 -- 172.21.15.39:0/3539897604 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8340b2070 con 0x7fb84c0d2990 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb849400640 1 -- 172.21.15.39:0/3539897604 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8340a9070 con 0x7fb84c0d2990 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb849400640 1 -- 172.21.15.39:0/3539897604 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8340ad880 con 0x7fb84c0d2990 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- 172.21.15.39:0/3539897604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c0d2990 msgr2=0x7fb84c072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c0d2990 0x7fb84c072520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83401c560 comp rx=0 tx=0).stop 2024-04-26T23:26:07.092 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- 172.21.15.39:0/3539897604 shutdown_connections 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c072a60 0x7fb84c1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- 172.21.15.39:0/3539897604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c0d2990 0x7fb84c072520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- 172.21.15.39:0/3539897604 >> 172.21.15.39:0/3539897604 conn(0x7fb84c0d2fb0 msgr2=0x7fb84c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- 172.21.15.39:0/3539897604 shutdown_connections 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- 172.21.15.39:0/3539897604 wait complete. 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 Processor -- start 2024-04-26T23:26:07.093 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- start start 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb84c0d2990 0x7fb84c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c142340 0x7fb84c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c0b83d0 con 0x7fb84c072a60 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c0b8250 con 0x7fb84c0d2990 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb850a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c0b8550 con 0x7fb84c142340 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb849e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb849e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41210/0 (socket says 172.21.15.39:41210) 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb849e00640 1 -- 172.21.15.39:0/684207384 learned_addr learned my addr 172.21.15.39:0/684207384 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:07.096 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb843e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb84c0d2990 0x7fb84c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.090+0000 7fb84a800640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c142340 0x7fb84c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 -- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c142340 msgr2=0x7fb84c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c142340 0x7fb84c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 -- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb84c0d2990 msgr2=0x7fb84c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb84c0d2990 0x7fb84c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 -- 172.21.15.39:0/684207384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c0b3dc0 con 0x7fb84c072a60 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb849e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c3a0 tx=0x7fb83c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0052d0 con 0x7fb84c072a60 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb83c005470 con 0x7fb84c072a60 2024-04-26T23:26:07.097 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c007260 con 0x7fb84c072a60 2024-04-26T23:26:07.098 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c136b70 con 0x7fb84c072a60 2024-04-26T23:26:07.098 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c159170 con 0x7fb84c072a60 2024-04-26T23:26:07.098 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c069dc0 con 0x7fb84c072a60 2024-04-26T23:26:07.099 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb83c007400 con 0x7fb84c072a60 2024-04-26T23:26:07.099 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 0x7fb82806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.099 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.094+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb83c085a80 con 0x7fb84c072a60 2024-04-26T23:26:07.099 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.098+0000 7fb843e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 0x7fb82806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.100 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.098+0000 7fb843e00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 0x7fb82806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8340af000 tx=0x7fb834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.104 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.102+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb83c087e20 con 0x7fb84c072a60 2024-04-26T23:26:07.269 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.266+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb84c13abf0 con 0x7fb84c072a60 2024-04-26T23:26:07.270 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.266+0000 7fb842000640 1 -- 172.21.15.39:0/684207384 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7fb84c0b3dc0 con 0x7fb84c072a60 2024-04-26T23:26:07.270 INFO:teuthology.misc.health.smithi039.stdout: 2024-04-26T23:26:07.270 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":16,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:04.005566+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 msgr2=0x7fb82806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 0x7fb82806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8340af000 tx=0x7fb834008040 comp rx=0 tx=0).stop 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 msgr2=0x7fb84c0b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c3a0 tx=0x7fb83c00c860 comp rx=0 tx=0).stop 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 shutdown_connections 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb828068380 0x7fb82806a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb84c142340 0x7fb84c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.272 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb84c0d2990 0x7fb84c0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.273 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 --2- 172.21.15.39:0/684207384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c072a60 0x7fb84c0b4600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.273 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 >> 172.21.15.39:0/684207384 conn(0x7fb84c0d2fb0 msgr2=0x7fb84c0d3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.273 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 shutdown_connections 2024-04-26T23:26:07.273 INFO:teuthology.misc.health.smithi039.stderr:2024-04-26T23:26:07.270+0000 7fb850a00640 1 -- 172.21.15.39:0/684207384 wait complete. 2024-04-26T23:26:07.289 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:26:07.289 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:26:07.290 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:26:07.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:26:07.293 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:26:07.293 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:26:07.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:26:07.296 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:26:07.296 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:26:07.296 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:26:07.300 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:26:07.300 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:26:07.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:26:07.303 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:26:07.304 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:26:07.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:07.394 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:26:07.395 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:26:07.401 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-04-26T23:26:07.402 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-04-26T23:26:07.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 Processor -- start 2024-04-26T23:26:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 -- start start 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 0x7fecb809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb809c7a0 con 0x7fecb815d550 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fecb80c6be0 con 0x7fecb80d1640 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbfa00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fecb80d1b70 con 0x7fecb815d170 2024-04-26T23:26:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbda00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fecb815d550 0x7fecb80cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37334/0 (socket says 172.21.15.39:37334) 2024-04-26T23:26:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbda00640 1 -- 172.21.15.39:0/221979519 learned_addr learned my addr 172.21.15.39:0/221979519 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecafe00640 1 --2- 172.21.15.39:0/221979519 >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 0x7fecb809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbd000640 1 --2- 172.21.15.39:0/221979519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecb7e00640 1 -- 172.21.15.39:0/221979519 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435025590 0 0) 0x7fecb809c7a0 con 0x7fecb815d550 2024-04-26T23:26:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecb7e00640 1 -- 172.21.15.39:0/221979519 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec9c003530 con 0x7fecb815d550 2024-04-26T23:26:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbd000640 1 -- 172.21.15.39:0/221979519 >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 msgr2=0x7fecb809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbd000640 1 --2- 172.21.15.39:0/221979519 >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 0x7fecb809b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbd000640 1 -- 172.21.15.39:0/221979519 >> v1:172.21.15.39:6789/0 conn(0x7fecb815d550 legacy=0x7fecb80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecbd000640 1 -- 172.21.15.39:0/221979519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb80d1e50 con 0x7fecb815d170 2024-04-26T23:26:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.446+0000 7fecafe00640 1 --2- 172.21.15.39:0/221979519 >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 0x7fecb809b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbd000640 1 --2- 172.21.15.39:0/221979519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b56a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feca80097c0 tx=0x7feca801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac6390e6c82bd0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecb7e00640 1 -- 172.21.15.39:0/221979519 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80b2070 con 0x7fecb815d170 2024-04-26T23:26:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecb7e00640 1 -- 172.21.15.39:0/221979519 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca80ad640 con 0x7fecb815d170 2024-04-26T23:26:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecb7e00640 1 -- 172.21.15.39:0/221979519 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80ad9f0 con 0x7fecb815d170 2024-04-26T23:26:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 -- 172.21.15.39:0/221979519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 msgr2=0x7fecb80b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 --2- 172.21.15.39:0/221979519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b56a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feca80097c0 tx=0x7feca801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 -- 172.21.15.39:0/221979519 shutdown_connections 2024-04-26T23:26:07.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 --2- 172.21.15.39:0/221979519 >> v2:172.21.15.71:3300/0 conn(0x7fecb80d1640 0x7fecb809b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 --2- 172.21.15.39:0/221979519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b56a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 -- 172.21.15.39:0/221979519 >> 172.21.15.39:0/221979519 conn(0x7fecb80b4b80 msgr2=0x7fecb80b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 -- 172.21.15.39:0/221979519 shutdown_connections 2024-04-26T23:26:07.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.450+0000 7fecbfa00640 1 -- 172.21.15.39:0/221979519 wait complete. 2024-04-26T23:26:07.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 Processor -- start 2024-04-26T23:26:07.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- start start 2024-04-26T23:26:07.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecb80d1640 0x7fecb80a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fecb80ceac0 con 0x7fecb815d550 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecb809c330 con 0x7fecb80d1640 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fecb816a160 con 0x7fecb815d170 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41232/0 (socket says 172.21.15.39:41232) 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 -- 172.21.15.39:0/2520583254 learned_addr learned my addr 172.21.15.39:0/2520583254 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbd000640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecb80d1640 0x7fecb80a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecafe00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 -- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 msgr2=0x7fecb80b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 -- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecb80d1640 msgr2=0x7fecb80a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecb80d1640 0x7fecb80a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 -- 172.21.15.39:0/2520583254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb80b84b0 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbda00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecb000caa0 tx=0x7fecb000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0017070 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb000ac00 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb80b8790 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0012400 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.454+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb815db20 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb80b8cb0 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fecb001a070 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecb5600640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 0x7fec9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fecb00864d0 con 0x7fecb815d550 2024-04-26T23:26:07.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecbd000640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 0x7fec9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.458+0000 7fecbd000640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 0x7fec9406a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feca80af000 tx=0x7feca80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.462+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fecb80b8cb0 con 0x7fecb815d550 2024-04-26T23:26:07.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.626+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecb8050740 con 0x7fecb815d550 2024-04-26T23:26:07.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.626+0000 7fecb5600640 1 -- 172.21.15.39:0/2520583254 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7fecb0056d40 con 0x7fecb815d550 2024-04-26T23:26:07.630 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:07.630 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:04.005566+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 msgr2=0x7fec9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 0x7fec9406a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feca80af000 tx=0x7feca80a7070 comp rx=0 tx=0).stop 2024-04-26T23:26:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 msgr2=0x7fecb81fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecb000caa0 tx=0x7fecb000cf60 comp rx=0 tx=0).stop 2024-04-26T23:26:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 shutdown_connections 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fec94068380 0x7fec9406a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb815d550 0x7fecb81fb390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fecb815d170 0x7fecb80b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 --2- 172.21.15.39:0/2520583254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecb80d1640 0x7fecb80a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 >> 172.21.15.39:0/2520583254 conn(0x7fecb80b4b80 msgr2=0x7fecb80713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 shutdown_connections 2024-04-26T23:26:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.630+0000 7fecbfa00640 1 -- 172.21.15.39:0/2520583254 wait complete. 2024-04-26T23:26:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:07.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:07.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 Processor -- start 2024-04-26T23:26:07.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 -- start start 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9ac0b2050 0x7ff9ac15f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9ac0d1110 0x7ff9ac0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac0d2490 con 0x7ff9ac0b2050 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac0d06b0 con 0x7ff9ac0d1110 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9ab200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b2430 con 0x7ff9ac0cfb60 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9ac0b2050 0x7ff9ac15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9ac0b2050 0x7ff9ac15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41240/0 (socket says 172.21.15.39:41240) 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 -- 172.21.15.39:0/4133496666 learned_addr learned my addr 172.21.15.39:0/4133496666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9aa800640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9400640 1 --2- 172.21.15.39:0/4133496666 >> v2:172.21.15.71:3300/0 conn(0x7ff9ac0d1110 0x7ff9ac0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 -- 172.21.15.39:0/4133496666 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 msgr2=0x7ff9ac0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 -- 172.21.15.39:0/4133496666 >> v2:172.21.15.71:3300/0 conn(0x7ff9ac0d1110 msgr2=0x7ff9ac0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/4133496666 >> v2:172.21.15.71:3300/0 conn(0x7ff9ac0d1110 0x7ff9ac0cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.794+0000 7ff9a9e00640 1 -- 172.21.15.39:0/4133496666 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0d1880 con 0x7ff9ac0b2050 2024-04-26T23:26:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac15f770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b1f28e6cb5f4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9a8a00640 1 -- 172.21.15.39:0/4133496666 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b0070 con 0x7ff9ac0b2050 2024-04-26T23:26:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9a8a00640 1 -- 172.21.15.39:0/4133496666 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c0ab600 con 0x7ff9ac0b2050 2024-04-26T23:26:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9a8a00640 1 -- 172.21.15.39:0/4133496666 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0ab9d0 con 0x7ff9ac0b2050 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 -- 172.21.15.39:0/4133496666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 msgr2=0x7ff9ac15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac15f770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c01c340 comp rx=0 tx=0).stop 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 -- 172.21.15.39:0/4133496666 shutdown_connections 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 --2- 172.21.15.39:0/4133496666 >> v2:172.21.15.71:3300/0 conn(0x7ff9ac0d1110 0x7ff9ac0cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 --2- 172.21.15.39:0/4133496666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac15f770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 -- 172.21.15.39:0/4133496666 >> 172.21.15.39:0/4133496666 conn(0x7ff9ac0d2da0 msgr2=0x7ff9ac0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 -- 172.21.15.39:0/4133496666 shutdown_connections 2024-04-26T23:26:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.798+0000 7ff9ab200640 1 -- 172.21.15.39:0/4133496666 wait complete. 2024-04-26T23:26:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 Processor -- start 2024-04-26T23:26:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- start start 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 0x7ff9ac0c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac162d90 con 0x7ff9ac0b2050 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0d1520 con 0x7ff9ac0d1110 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac162f10 con 0x7ff9ac0cfb60 2024-04-26T23:26:07.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41250/0 (socket says 172.21.15.39:41250) 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 -- 172.21.15.39:0/177391516 learned_addr learned my addr 172.21.15.39:0/177391516 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9400640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9aa800640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 0x7ff9ac0c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 -- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 msgr2=0x7ff9ac150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 -- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 msgr2=0x7ff9ac0c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 0x7ff9ac0c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 -- 172.21.15.39:0/177391516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0c7000 con 0x7ff9ac0b2050 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9aa800640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 0x7ff9ac0c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a9e00640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0ae040 tx=0x7ff99c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b0040 con 0x7ff9ac0b2050 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c0bc070 con 0x7ff9ac0b2050 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b6680 con 0x7ff9ac0b2050 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac0c72e0 con 0x7ff9ac0b2050 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac0b0480 con 0x7ff9ac0b2050 2024-04-26T23:26:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.802+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac0b0680 con 0x7ff9ac0b2050 2024-04-26T23:26:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.806+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff99c0b6820 con 0x7ff9ac0b2050 2024-04-26T23:26:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.806+0000 7ff9a2000640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 0x7ff98c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.806+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff99c120860 con 0x7ff9ac0b2050 2024-04-26T23:26:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.806+0000 7ff9a9400640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 0x7ff98c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.806+0000 7ff9a9400640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 0x7ff98c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b4fa0 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.810+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff9ac0b0680 con 0x7ff9ac0b2050 2024-04-26T23:26:07.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9ac0506d0 con 0x7ff9ac0b2050 2024-04-26T23:26:07.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9a2000640 1 -- 172.21.15.39:0/177391516 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff9ac0cf230 con 0x7ff9ac0b2050 2024-04-26T23:26:07.980 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:07.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 msgr2=0x7ff98c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 0x7ff98c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b4fa0 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 msgr2=0x7ff9ac0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0ae040 tx=0x7ff99c01ab80 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 shutdown_connections 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff98c068380 0x7ff98c06a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9ac0d1110 0x7ff9ac0c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9ac0cfb60 0x7ff9ac150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 --2- 172.21.15.39:0/177391516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9ac0b2050 0x7ff9ac0c68d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 >> 172.21.15.39:0/177391516 conn(0x7ff9ac0d2da0 msgr2=0x7ff9ac15fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 shutdown_connections 2024-04-26T23:26:07.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:07.978+0000 7ff9ab200640 1 -- 172.21.15.39:0/177391516 wait complete. 2024-04-26T23:26:08.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:08.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.137+0000 7f8e99200640 1 Processor -- start 2024-04-26T23:26:08.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.137+0000 7f8e99200640 1 -- start start 2024-04-26T23:26:08.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e99200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e940cf2a0 0x7f8e9406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:08.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e99200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e94160060 con 0x7f8e9406fab0 2024-04-26T23:26:08.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e99200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e94160340 con 0x7f8e94145820 2024-04-26T23:26:08.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e99200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8e9406ff20 con 0x7f8e940cf2a0 2024-04-26T23:26:08.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e89400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e940cf2a0 0x7f8e9406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e92800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8e9406fab0 0x7f8e940cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37342/0 (socket says 172.21.15.39:37342) 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e92800640 1 -- 172.21.15.39:0/2940185229 learned_addr learned my addr 172.21.15.39:0/2940185229 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143996518 0 0) 0x7f8e94160060 con 0x7f8e9406fab0 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e78003530 con 0x7f8e9406fab0 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400004388 0 0) 0x7f8e94160340 con 0x7f8e94145820 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e89400640 1 -- 172.21.15.39:0/2940185229 >> v1:172.21.15.71:6789/0 conn(0x7f8e94145820 legacy=0x7f8e940b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e89400640 1 -- 172.21.15.39:0/2940185229 >> v1:172.21.15.39:6789/0 conn(0x7f8e9406fab0 legacy=0x7f8e940cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.141+0000 7f8e89400640 1 -- 172.21.15.39:0/2940185229 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e94160620 con 0x7f8e940cf2a0 2024-04-26T23:26:08.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e89400640 1 --2- 172.21.15.39:0/2940185229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e940cf2a0 0x7f8e9406f570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9171c6db43e0161 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:08.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0b0070 con 0x7f8e940cf2a0 2024-04-26T23:26:08.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0ab600 con 0x7f8e940cf2a0 2024-04-26T23:26:08.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91400640 1 -- 172.21.15.39:0/2940185229 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0ab9d0 con 0x7f8e940cf2a0 2024-04-26T23:26:08.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- 172.21.15.39:0/2940185229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e940cf2a0 msgr2=0x7f8e9406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 --2- 172.21.15.39:0/2940185229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e940cf2a0 0x7f8e9406f570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- 172.21.15.39:0/2940185229 shutdown_connections 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 --2- 172.21.15.39:0/2940185229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e940cf2a0 0x7f8e9406f570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- 172.21.15.39:0/2940185229 >> 172.21.15.39:0/2940185229 conn(0x7f8e940b2af0 msgr2=0x7f8e940b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- 172.21.15.39:0/2940185229 shutdown_connections 2024-04-26T23:26:08.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- 172.21.15.39:0/2940185229 wait complete. 2024-04-26T23:26:08.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 Processor -- start 2024-04-26T23:26:08.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- start start 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 0x7f8e94073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e94145820 0x7f8e940b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9415fdb0 con 0x7f8e9406fab0 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9415fc30 con 0x7f8e940cf2a0 2024-04-26T23:26:08.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e99200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8e940ce570 con 0x7f8e94145820 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41254/0 (socket says 172.21.15.39:41254) 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e91e00640 1 -- 172.21.15.39:0/2157805713 learned_addr learned my addr 172.21.15.39:0/2157805713 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.145+0000 7f8e92800640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e94145820 0x7f8e940b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e89400640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 0x7f8e94073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 -- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e94145820 msgr2=0x7f8e940b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e94145820 0x7f8e940b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 -- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 msgr2=0x7f8e94073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 0x7f8e94073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 -- 172.21.15.39:0/2157805713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e940727a0 con 0x7f8e9406fab0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e89400640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 0x7f8e94073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e91e00640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001ec0 tx=0x7f8e8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84017070 con 0x7f8e9406fab0 2024-04-26T23:26:08.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84003600 con 0x7f8e9406fab0 2024-04-26T23:26:08.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840039f0 con 0x7f8e9406fab0 2024-04-26T23:26:08.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e94072a80 con 0x7f8e9406fab0 2024-04-26T23:26:08.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e94073040 con 0x7f8e9406fab0 2024-04-26T23:26:08.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e94050740 con 0x7f8e9406fab0 2024-04-26T23:26:08.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e8401a070 con 0x7f8e9406fab0 2024-04-26T23:26:08.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 0x7f8e7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:08.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.149+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8e84085a50 con 0x7f8e9406fab0 2024-04-26T23:26:08.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.153+0000 7f8e89400640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 0x7f8e7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:08.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.153+0000 7f8e89400640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 0x7f8e7006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0ad000 tx=0x7f8e7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:08.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.153+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e84055c70 con 0x7f8e9406fab0 2024-04-26T23:26:08.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:26:08.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:26:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.357+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e94157df0 con 0x7f8e9406fab0 2024-04-26T23:26:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.357+0000 7f8e8aa00640 1 -- 172.21.15.39:0/2157805713 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f8e84059f70 con 0x7f8e9406fab0 2024-04-26T23:26:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:08.363 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:26:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 2 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 msgr2=0x7f8e7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 0x7f8e7006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0ad000 tx=0x7f8e7c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 msgr2=0x7f8e941578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001ec0 tx=0x7f8e8400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 shutdown_connections 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e70068380 0x7f8e7006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e94145820 0x7f8e940b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e940cf2a0 0x7f8e94073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 --2- 172.21.15.39:0/2157805713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e9406fab0 0x7f8e941578b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 >> 172.21.15.39:0/2157805713 conn(0x7f8e940b2af0 msgr2=0x7f8e940753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 shutdown_connections 2024-04-26T23:26:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:08.361+0000 7f8e99200640 1 -- 172.21.15.39:0/2157805713 wait complete. 2024-04-26T23:26:10.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:10.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.533+0000 7fb82e200640 1 Processor -- start 2024-04-26T23:26:10.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.533+0000 7fb82e200640 1 -- start start 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb82e200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8280cd810 0x7fb8280742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb82e200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 0x7fb82806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb82e200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8280d0550 con 0x7fb8280cfe00 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb82e200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb8280d0b10 con 0x7fb8280cd810 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb82e200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb82806e970 con 0x7fb8280cdbf0 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8280cd810 0x7fb8280742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb81ea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb8280cfe00 0x7fb828144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56428/0 (socket says 172.21.15.39:56428) 2024-04-26T23:26:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb81ea00640 1 -- 172.21.15.39:0/1322471519 learned_addr learned my addr 172.21.15.39:0/1322471519 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827e00640 1 --2- 172.21.15.39:0/1322471519 >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 0x7fb82806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 -- 172.21.15.39:0/1322471519 >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 msgr2=0x7fb82806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 --2- 172.21.15.39:0/1322471519 >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 0x7fb82806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 -- 172.21.15.39:0/1322471519 >> v1:172.21.15.39:6789/0 conn(0x7fb8280cfe00 legacy=0x7fb828144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 -- 172.21.15.39:0/1322471519 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8280d0830 con 0x7fb8280cd810 2024-04-26T23:26:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827e00640 1 --2- 172.21.15.39:0/1322471519 >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 0x7fb82806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.537+0000 7fb827400640 1 --2- 172.21.15.39:0/1322471519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cd810 0x7fb8280742f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8280719c0 tx=0x7fb81801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb99a463d9e4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb826a00640 1 -- 172.21.15.39:0/1322471519 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8180b0070 con 0x7fb8280cd810 2024-04-26T23:26:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb826a00640 1 -- 172.21.15.39:0/1322471519 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8180ab600 con 0x7fb8280cd810 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb826a00640 1 -- 172.21.15.39:0/1322471519 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8180ab9d0 con 0x7fb8280cd810 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- 172.21.15.39:0/1322471519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cd810 msgr2=0x7fb8280742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- 172.21.15.39:0/1322471519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cd810 0x7fb8280742f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8280719c0 tx=0x7fb81801c330 comp rx=0 tx=0).stop 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- 172.21.15.39:0/1322471519 shutdown_connections 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- 172.21.15.39:0/1322471519 >> v2:172.21.15.71:3300/0 conn(0x7fb8280cdbf0 0x7fb82806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- 172.21.15.39:0/1322471519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cd810 0x7fb8280742f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- 172.21.15.39:0/1322471519 >> 172.21.15.39:0/1322471519 conn(0x7fb8280b2af0 msgr2=0x7fb8280b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- 172.21.15.39:0/1322471519 shutdown_connections 2024-04-26T23:26:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- 172.21.15.39:0/1322471519 wait complete. 2024-04-26T23:26:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 Processor -- start 2024-04-26T23:26:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- start start 2024-04-26T23:26:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8280cd810 0x7fb82815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 0x7fb8281582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb828143d30 con 0x7fb8280cfe00 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb828143bb0 con 0x7fb8280cdbf0 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb82e200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb828169ef0 con 0x7fb8280cd810 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb827e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb827e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58854/0 (socket says 172.21.15.39:58854) 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.541+0000 7fb827e00640 1 -- 172.21.15.39:0/1495806896 learned_addr learned my addr 172.21.15.39:0/1495806896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81ea00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 0x7fb8281582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827400640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8280cd810 0x7fb82815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 -- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8280cd810 msgr2=0x7fb82815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8280cd810 0x7fb82815ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 -- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 msgr2=0x7fb8281582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 0x7fb8281582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 -- 172.21.15.39:0/1495806896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82815c6f0 con 0x7fb8280cfe00 2024-04-26T23:26:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81ea00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 0x7fb8281582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb827e00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb82000cef0 tx=0x7fb82000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82001a070 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82000d860 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82815ca30 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82000dc50 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82815d270 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb828050740 con 0x7fb8280cfe00 2024-04-26T23:26:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.545+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb82001d070 con 0x7fb8280cfe00 2024-04-26T23:26:10.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.549+0000 7fb81fe00640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 0x7fb80406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.549+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb820086f20 con 0x7fb8280cfe00 2024-04-26T23:26:10.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.549+0000 7fb827400640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 0x7fb80406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.549+0000 7fb827400640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 0x7fb80406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ad000 tx=0x7fb8180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.553+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb82815ca30 con 0x7fb8280cfe00 2024-04-26T23:26:10.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.753+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8280b1020 con 0x7fb8280cfe00 2024-04-26T23:26:10.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.753+0000 7fb81fe00640 1 -- 172.21.15.39:0/1495806896 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3858 (secure 0 0 0) 0x7fb820057200 con 0x7fb8280cfe00 2024-04-26T23:26:10.759 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:10.759 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:26:10.760 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2024-04-26T23:26:10.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 msgr2=0x7fb80406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 0x7fb80406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ad000 tx=0x7fb8180a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:10.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 msgr2=0x7fb828158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb82000cef0 tx=0x7fb82000a710 comp rx=0 tx=0).stop 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 shutdown_connections 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb804068380 0x7fb80406a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8280cfe00 0x7fb828158830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8280cdbf0 0x7fb8281582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 --2- 172.21.15.39:0/1495806896 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8280cd810 0x7fb82815ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 >> 172.21.15.39:0/1495806896 conn(0x7fb8280b2af0 msgr2=0x7fb8280d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 shutdown_connections 2024-04-26T23:26:10.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.757+0000 7fb82e200640 1 -- 172.21.15.39:0/1495806896 wait complete. 2024-04-26T23:26:10.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:10.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 Processor -- start 2024-04-26T23:26:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 -- start start 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 0x7f1b440b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4409c7a0 con 0x7f1b440d1640 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b440d1b70 con 0x7f1b4415d170 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4c400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1b440c6be0 con 0x7f1b4409c0f0 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4a400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1b440d1640 0x7f1b440c7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56436/0 (socket says 172.21.15.39:56436) 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b4a400640 1 -- 172.21.15.39:0/633742506 learned_addr learned my addr 172.21.15.39:0/633742506 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:10.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b49000640 1 --2- 172.21.15.39:0/633742506 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 0x7f1b440b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188782242 0 0) 0x7f1b4409c7a0 con 0x7f1b440d1640 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b2c003530 con 0x7f1b440d1640 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134598383 0 0) 0x7f1b440d1b70 con 0x7f1b4415d170 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4409c7a0 con 0x7f1b4415d170 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b49000640 1 -- 172.21.15.39:0/633742506 >> v1:172.21.15.71:6789/0 conn(0x7f1b4415d170 legacy=0x7f1b4409b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b49000640 1 -- 172.21.15.39:0/633742506 >> v1:172.21.15.39:6789/0 conn(0x7f1b440d1640 legacy=0x7f1b440c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.917+0000 7f1b49000640 1 -- 172.21.15.39:0/633742506 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b440d1e50 con 0x7f1b4409c0f0 2024-04-26T23:26:10.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b49000640 1 --2- 172.21.15.39:0/633742506 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 0x7f1b440b56a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b300097f0 tx=0x7f1b3001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=590a550806810e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300b1070 con 0x7f1b4409c0f0 2024-04-26T23:26:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b300ac630 con 0x7f1b4409c0f0 2024-04-26T23:26:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b43e00640 1 -- 172.21.15.39:0/633742506 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300a8050 con 0x7f1b4409c0f0 2024-04-26T23:26:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 -- 172.21.15.39:0/633742506 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 msgr2=0x7f1b440b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 --2- 172.21.15.39:0/633742506 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 0x7f1b440b56a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b300097f0 tx=0x7f1b3001c4e0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 -- 172.21.15.39:0/633742506 shutdown_connections 2024-04-26T23:26:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 --2- 172.21.15.39:0/633742506 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b4409c0f0 0x7f1b440b56a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 -- 172.21.15.39:0/633742506 >> 172.21.15.39:0/633742506 conn(0x7f1b440b4b80 msgr2=0x7f1b440b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 -- 172.21.15.39:0/633742506 shutdown_connections 2024-04-26T23:26:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.921+0000 7f1b4c400640 1 -- 172.21.15.39:0/633742506 wait complete. 2024-04-26T23:26:10.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 Processor -- start 2024-04-26T23:26:10.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- start start 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4409c0f0 0x7f1b441572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b440d1640 0x7f1b44165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440c8920 con 0x7f1b4415d170 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440c87a0 con 0x7f1b4409c0f0 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4416af60 con 0x7f1b440d1640 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58866/0 (socket says 172.21.15.39:58866) 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 -- 172.21.15.39:0/2914951236 learned_addr learned my addr 172.21.15.39:0/2914951236 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:10.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b49000640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b440d1640 0x7f1b44165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b49a00640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4409c0f0 0x7f1b441572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 -- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b440d1640 msgr2=0x7f1b44165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b440d1640 0x7f1b44165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 -- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4409c0f0 msgr2=0x7f1b441572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4409c0f0 0x7f1b441572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 -- 172.21.15.39:0/2914951236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4415ed80 con 0x7f1b4415d170 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4a400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00cba0 tx=0x7f1b3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c017070 con 0x7f1b4415d170 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00ace0 con 0x7f1b4415d170 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c012620 con 0x7f1b4415d170 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4415f060 con 0x7f1b4415d170 2024-04-26T23:26:10.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.925+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4415f900 con 0x7f1b4415d170 2024-04-26T23:26:10.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4415f450 con 0x7f1b4415d170 2024-04-26T23:26:10.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b3c01a070 con 0x7f1b4415d170 2024-04-26T23:26:10.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b41600640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 0x7f1b2406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:10.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1b3c086380 con 0x7f1b4415d170 2024-04-26T23:26:10.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b49a00640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 0x7f1b2406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:10.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.929+0000 7f1b49a00640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 0x7f1b2406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b380011f0 tx=0x7f1b38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:10.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:10.933+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1b3c0566b0 con 0x7f1b4415d170 2024-04-26T23:26:11.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.101+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b44050740 con 0x7f1b4415d170 2024-04-26T23:26:11.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.101+0000 7f1b41600640 1 -- 172.21.15.39:0/2914951236 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7f1b3c05a9b0 con 0x7f1b4415d170 2024-04-26T23:26:11.106 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:11.106 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:04.005566+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 msgr2=0x7f1b2406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 0x7f1b2406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b380011f0 tx=0x7f1b38009040 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 msgr2=0x7f1b4415c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00cba0 tx=0x7f1b3c00a430 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 shutdown_connections 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1b240683b0 0x7f1b2406a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4415d170 0x7f1b4415c090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b440d1640 0x7f1b44165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 --2- 172.21.15.39:0/2914951236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4409c0f0 0x7f1b441572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 >> 172.21.15.39:0/2914951236 conn(0x7f1b440b4b80 msgr2=0x7f1b4409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 shutdown_connections 2024-04-26T23:26:11.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.105+0000 7f1b4c400640 1 -- 172.21.15.39:0/2914951236 wait complete. 2024-04-26T23:26:11.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:11.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:11.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 Processor -- start 2024-04-26T23:26:11.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 -- start start 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4b1c0d18f0 0x7f4b1c0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1c06e500 con 0x7f4b1c161850 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1c06e7e0 con 0x7f4b1c140170 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b23e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1c06f110 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b21e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4b1c0d18f0 0x7f4b1c0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b20a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4b1c161850 0x7f4b1c0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56438/0 (socket says 172.21.15.39:56438) 2024-04-26T23:26:11.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b20a00640 1 -- 172.21.15.39:0/2905587017 learned_addr learned my addr 172.21.15.39:0/2905587017 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:11.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b21e00640 1 -- 172.21.15.39:0/2905587017 >> v1:172.21.15.71:6789/0 conn(0x7f4b1c140170 legacy=0x7f4b1c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b21e00640 1 -- 172.21.15.39:0/2905587017 >> v1:172.21.15.39:6789/0 conn(0x7f4b1c161850 legacy=0x7f4b1c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b21e00640 1 -- 172.21.15.39:0/2905587017 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c06eac0 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.269+0000 7f4b1be00640 1 -- 172.21.15.39:0/2905587017 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061173497 0 0) 0x7f4b1c06e500 con 0x7f4b1c161850 2024-04-26T23:26:11.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b21e00640 1 --2- 172.21.15.39:0/2905587017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c0d0700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009d90 tx=0x7f4b1401d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2398e23805f4b400 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b1be00640 1 -- 172.21.15.39:0/2905587017 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140b2070 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b1be00640 1 -- 172.21.15.39:0/2905587017 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b140a5990 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b1be00640 1 -- 172.21.15.39:0/2905587017 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140a5d60 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- 172.21.15.39:0/2905587017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c0d18f0 msgr2=0x7f4b1c0d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 --2- 172.21.15.39:0/2905587017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c0d0700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009d90 tx=0x7f4b1401d310 comp rx=0 tx=0).stop 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- 172.21.15.39:0/2905587017 shutdown_connections 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 --2- 172.21.15.39:0/2905587017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c0d0700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- 172.21.15.39:0/2905587017 >> 172.21.15.39:0/2905587017 conn(0x7f4b1c06c7d0 msgr2=0x7f4b1c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- 172.21.15.39:0/2905587017 shutdown_connections 2024-04-26T23:26:11.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- 172.21.15.39:0/2905587017 wait complete. 2024-04-26T23:26:11.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 Processor -- start 2024-04-26T23:26:11.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.273+0000 7f4b23e00640 1 -- start start 2024-04-26T23:26:11.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 0x7f4b1c1431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c16ab50 con 0x7f4b1c161850 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c16a9d0 con 0x7f4b1c0d18f0 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c16acd0 con 0x7f4b1c140170 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58882/0 (socket says 172.21.15.39:58882) 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 -- 172.21.15.39:0/1218731283 learned_addr learned my addr 172.21.15.39:0/1218731283 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21400640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b20a00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 0x7f4b1c1431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 -- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 msgr2=0x7f4b1c1431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 0x7f4b1c1431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 -- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 msgr2=0x7f4b1c150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 -- 172.21.15.39:0/1218731283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c1428b0 con 0x7f4b1c161850 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b20a00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 0x7f4b1c1431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21400640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b21e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b1401a4e0 tx=0x7f4b14019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140bc030 con 0x7f4b1c161850 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b140ad4c0 con 0x7f4b1c161850 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140b2040 con 0x7f4b1c161850 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c14fa70 con 0x7f4b1c161850 2024-04-26T23:26:11.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c150030 con 0x7f4b1c161850 2024-04-26T23:26:11.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.277+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1c06a720 con 0x7f4b1c161850 2024-04-26T23:26:11.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.281+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b140bf070 con 0x7f4b1c161850 2024-04-26T23:26:11.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.281+0000 7f4b19600640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 0x7f4afc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.281+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4b14120aa0 con 0x7f4b1c161850 2024-04-26T23:26:11.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.281+0000 7f4b21400640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 0x7f4afc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.281+0000 7f4b21400640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 0x7f4afc06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b10000f70 tx=0x7f4b10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.285+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4b14016560 con 0x7f4b1c161850 2024-04-26T23:26:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.449+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b1c06fdc0 con 0x7f4b1c161850 2024-04-26T23:26:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.449+0000 7f4b19600640 1 -- 172.21.15.39:0/1218731283 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f4b140f13e0 con 0x7f4b1c161850 2024-04-26T23:26:11.455 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:11.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 msgr2=0x7f4afc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 0x7f4afc06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b10000f70 tx=0x7f4b10009040 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 msgr2=0x7f4b1c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b1401a4e0 tx=0x7f4b14019650 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 shutdown_connections 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4afc0683b0 0x7f4afc06a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c161850 0x7f4b1c138a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c140170 0x7f4b1c1431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 --2- 172.21.15.39:0/1218731283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0d18f0 0x7f4b1c150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 >> 172.21.15.39:0/1218731283 conn(0x7f4b1c06c7d0 msgr2=0x7f4b1c154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 shutdown_connections 2024-04-26T23:26:11.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.453+0000 7f4b23e00640 1 -- 172.21.15.39:0/1218731283 wait complete. 2024-04-26T23:26:11.476 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:26:11.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 Processor -- start 2024-04-26T23:26:11.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 -- start start 2024-04-26T23:26:11.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1aa815d000 0x7f1aa806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa80cd750 0x7f1aa80cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa8160070 con 0x7f1aa806fd70 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa815d3e0 con 0x7f1aa815d000 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aacc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa8160900 con 0x7f1aa80cd750 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1aa815d000 0x7f1aa806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1a9d400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1aa806fd70 0x7f1aa815f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56444/0 (socket says 172.21.15.39:56444) 2024-04-26T23:26:11.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1a9d400640 1 -- 172.21.15.39:0/3690497614 learned_addr learned my addr 172.21.15.39:0/3690497614 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa6800640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa80cd750 0x7f1aa80cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5e00640 1 -- 172.21.15.39:0/3690497614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa80cd750 msgr2=0x7f1aa80cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5e00640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa80cd750 0x7f1aa80cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5e00640 1 -- 172.21.15.39:0/3690497614 >> v1:172.21.15.39:6789/0 conn(0x7f1aa806fd70 legacy=0x7f1aa815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5400640 1 -- 172.21.15.39:0/3690497614 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363757885 0 0) 0x7f1aa8160070 con 0x7f1aa806fd70 2024-04-26T23:26:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.613+0000 7f1aa5e00640 1 -- 172.21.15.39:0/3690497614 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8160340 con 0x7f1aa815d000 2024-04-26T23:26:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aa5e00640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa806ed90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097c0 tx=0x7f1a9801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15e172b8b114be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aa5400640 1 -- 172.21.15.39:0/3690497614 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a980b0070 con 0x7f1aa815d000 2024-04-26T23:26:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aa5400640 1 -- 172.21.15.39:0/3690497614 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a980ab600 con 0x7f1aa815d000 2024-04-26T23:26:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aa5400640 1 -- 172.21.15.39:0/3690497614 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a980ab9d0 con 0x7f1aa815d000 2024-04-26T23:26:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 -- 172.21.15.39:0/3690497614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 msgr2=0x7f1aa806ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa806ed90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097c0 tx=0x7f1a9801c380 comp rx=0 tx=0).stop 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 -- 172.21.15.39:0/3690497614 shutdown_connections 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa80cd750 0x7f1aa80cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3690497614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa806ed90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 -- 172.21.15.39:0/3690497614 >> 172.21.15.39:0/3690497614 conn(0x7f1aa80b2af0 msgr2=0x7f1aa80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 -- 172.21.15.39:0/3690497614 shutdown_connections 2024-04-26T23:26:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.617+0000 7f1aacc00640 1 -- 172.21.15.39:0/3690497614 wait complete. 2024-04-26T23:26:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 Processor -- start 2024-04-26T23:26:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- start start 2024-04-26T23:26:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa806fd70 0x7f1aa815bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 0x7f1aa8155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa806f450 con 0x7f1aa815d000 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa806f2d0 con 0x7f1aa80cd750 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa80cf4f0 con 0x7f1aa806fd70 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58896/0 (socket says 172.21.15.39:58896) 2024-04-26T23:26:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 -- 172.21.15.39:0/3573520339 learned_addr learned my addr 172.21.15.39:0/3573520339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa5e00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa806fd70 0x7f1aa815bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1a9d400640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 0x7f1aa8155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 -- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa806fd70 msgr2=0x7f1aa815bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa806fd70 0x7f1aa815bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 -- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 msgr2=0x7f1aa8155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 0x7f1aa8155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 -- 172.21.15.39:0/3573520339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa814dc10 con 0x7f1aa815d000 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1a9d400640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 0x7f1aa8155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aa6800640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0007e70 tx=0x7f1aa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0014620 con 0x7f1aa815d000 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa0019070 con 0x7f1aa815d000 2024-04-26T23:26:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0014a20 con 0x7f1aa815d000 2024-04-26T23:26:11.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa814def0 con 0x7f1aa815d000 2024-04-26T23:26:11.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa815c0b0 con 0x7f1aa815d000 2024-04-26T23:26:11.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.621+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa8050740 con 0x7f1aa815d000 2024-04-26T23:26:11.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.625+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1aa0014bc0 con 0x7f1aa815d000 2024-04-26T23:26:11.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.625+0000 7f1a9ea00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.625+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1aa0086e90 con 0x7f1aa815d000 2024-04-26T23:26:11.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.625+0000 7f1aa5e00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.625+0000 7f1aa5e00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 0x7f1a8406a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a980ad000 tx=0x7f1a980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.629+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1aa0011260 con 0x7f1aa815d000 2024-04-26T23:26:11.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1aa814e0c0 con 0x7f1aa815d000 2024-04-26T23:26:11.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1a9ea00640 1 -- 172.21.15.39:0/3573520339 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f1aa0057830 con 0x7f1aa815d000 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-04-26T23:26:11.802 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:26:11.803 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:26:11.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 msgr2=0x7f1a8406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 0x7f1a8406a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a980ad000 tx=0x7f1a980a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 msgr2=0x7f1aa8155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0007e70 tx=0x7f1aa000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 shutdown_connections 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1aa815d000 0x7f1aa8155660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1aa80cd750 0x7f1aa8155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 --2- 172.21.15.39:0/3573520339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1aa806fd70 0x7f1aa815bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.797+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 >> 172.21.15.39:0/3573520339 conn(0x7f1aa80b2af0 msgr2=0x7f1aa80b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.801+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 shutdown_connections 2024-04-26T23:26:11.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.801+0000 7f1aacc00640 1 -- 172.21.15.39:0/3573520339 wait complete. 2024-04-26T23:26:11.823 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:26:11.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:26:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 Processor -- start 2024-04-26T23:26:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 -- start start 2024-04-26T23:26:11.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f740b4280 con 0x7f1f741468a0 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7406edd0 con 0x7f1f741613d0 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7c000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1f74072620 con 0x7f1f740b3df0 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:56362/0 (socket says 172.21.15.39:56362) 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7a000640 1 -- 172.21.15.39:0/1514656316 learned_addr learned my addr 172.21.15.39:0/1514656316 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:42774/0 (socket says 172.21.15.39:42774) 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 -- 172.21.15.39:0/1514656316 >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 msgr2=0x7f1f740b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 --2- 172.21.15.39:0/1514656316 >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 -- 172.21.15.39:0/1514656316 >> v1:172.21.15.71:6789/0 conn(0x7f1f741468a0 legacy=0x7f1f74160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f78c00640 1 -- 172.21.15.39:0/1514656316 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7406f020 con 0x7f1f740b3df0 2024-04-26T23:26:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.965+0000 7f1f7a000640 1 --2- 172.21.15.39:0/1514656316 >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:11.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f78c00640 1 --2- 172.21.15.39:0/1514656316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb1e52209acffe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f73e00640 1 -- 172.21.15.39:0/1514656316 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600b0070 con 0x7f1f740b3df0 2024-04-26T23:26:11.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f73e00640 1 -- 172.21.15.39:0/1514656316 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f600ab600 con 0x7f1f740b3df0 2024-04-26T23:26:11.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f73e00640 1 -- 172.21.15.39:0/1514656316 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600ab9d0 con 0x7f1f740b3df0 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 -- 172.21.15.39:0/1514656316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 msgr2=0x7f1f74074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 --2- 172.21.15.39:0/1514656316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c380 comp rx=0 tx=0).stop 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 -- 172.21.15.39:0/1514656316 shutdown_connections 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 --2- 172.21.15.39:0/1514656316 >> v2:172.21.15.71:3300/0 conn(0x7f1f741613d0 0x7f1f740b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 --2- 172.21.15.39:0/1514656316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f740b3df0 0x7f1f74074180 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 -- 172.21.15.39:0/1514656316 >> 172.21.15.39:0/1514656316 conn(0x7f1f740b2cc0 msgr2=0x7f1f740b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 -- 172.21.15.39:0/1514656316 shutdown_connections 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.969+0000 7f1f7c000640 1 -- 172.21.15.39:0/1514656316 wait complete. 2024-04-26T23:26:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 Processor -- start 2024-04-26T23:26:11.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- start start 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f741468a0 0x7f1f7413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f740aef40 0x7f1f7413e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74073440 con 0x7f1f741613d0 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740732c0 con 0x7f1f740aef40 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1f740735c0 con 0x7f1f741468a0 2024-04-26T23:26:11.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58900/0 (socket says 172.21.15.39:58900) 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 -- 172.21.15.39:0/945703305 learned_addr learned my addr 172.21.15.39:0/945703305 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7a000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f740aef40 0x7f1f7413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f79600640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f741468a0 0x7f1f7413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 -- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f741468a0 msgr2=0x7f1f7413c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f741468a0 0x7f1f7413c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 -- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f740aef40 msgr2=0x7f1f7413e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f740aef40 0x7f1f7413e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:11.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 -- 172.21.15.39:0/945703305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7413f1a0 con 0x7f1f741613d0 2024-04-26T23:26:11.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f78c00640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f60019fb0 tx=0x7f1f60019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600b8020 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f600b4410 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600b0040 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7413f480 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.973+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f74143fd0 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f740af350 con 0x7f1f741613d0 2024-04-26T23:26:11.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f600bb020 con 0x7f1f741613d0 2024-04-26T23:26:11.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f71600640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 0x7f1f5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:11.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1f60120070 con 0x7f1f741613d0 2024-04-26T23:26:11.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f79600640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 0x7f1f5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:11.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.977+0000 7f1f79600640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 0x7f1f5406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000f70 tx=0x7f1f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:11.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:11.981+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f740af350 con 0x7f1f741613d0 2024-04-26T23:26:12.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.149+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1f74050740 con 0x7f1f741613d0 2024-04-26T23:26:12.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.689+0000 7f1f71600640 1 -- 172.21.15.39:0/945703305 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f1f600c2030 con 0x7f1f741613d0 2024-04-26T23:26:12.695 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-04-26T23:26:12.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 msgr2=0x7f1f5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 0x7f1f5406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000f70 tx=0x7f1f68009040 comp rx=0 tx=0).stop 2024-04-26T23:26:12.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 msgr2=0x7f1f740aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f60019fb0 tx=0x7f1f60019120 comp rx=0 tx=0).stop 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 shutdown_connections 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f54068380 0x7f1f5406a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f740aef40 0x7f1f7413e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f741613d0 0x7f1f740aea00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 --2- 172.21.15.39:0/945703305 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f741468a0 0x7f1f7413c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 >> 172.21.15.39:0/945703305 conn(0x7f1f740b2cc0 msgr2=0x7f1f7406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 shutdown_connections 2024-04-26T23:26:12.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.693+0000 7f1f7c000640 1 -- 172.21.15.39:0/945703305 wait complete. 2024-04-26T23:26:12.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:26:12.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 Processor -- start 2024-04-26T23:26:12.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 -- start start 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff80406cae0 0x7ff804073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff804070200 con 0x7ff804160530 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff804073320 con 0x7ff804160150 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff809000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff804073970 con 0x7ff80406cae0 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff7f9400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff804160530 0x7ff80406c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56446/0 (socket says 172.21.15.39:56446) 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff7f9400640 1 -- 172.21.15.39:0/733335460 learned_addr learned my addr 172.21.15.39:0/733335460 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:12.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff802800640 1 --2- 172.21.15.39:0/733335460 >> v2:172.21.15.71:3300/0 conn(0x7ff80406cae0 0x7ff804073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249689638 0 0) 0x7ff804070200 con 0x7ff804160530 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e8003530 con 0x7ff804160530 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696202216 0 0) 0x7ff7e8003530 con 0x7ff804160530 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 >> v2:172.21.15.71:3300/0 conn(0x7ff80406cae0 msgr2=0x7ff804073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 --2- 172.21.15.39:0/733335460 >> v2:172.21.15.71:3300/0 conn(0x7ff80406cae0 0x7ff804073e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 >> v1:172.21.15.71:6789/0 conn(0x7ff804160150 legacy=0x7ff80406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff804073600 con 0x7ff804160530 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7ff7ec001680 con 0x7ff804160530 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 >> v1:172.21.15.39:6789/0 conn(0x7ff804160530 legacy=0x7ff80406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7e80039c0 0x7ff7e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e8004810 0x7ff7e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 0x7ff7e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff804073970 con 0x7ff7e80039c0 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e800c170 con 0x7ff7e80051d0 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e800c370 con 0x7ff7e8004810 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff801e00640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7e80039c0 0x7ff7e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff802800640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 0x7ff7e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.869+0000 7ff7f9400640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e8004810 0x7ff7e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 -- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e8004810 msgr2=0x7ff7e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e8004810 0x7ff7e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 -- 172.21.15.39:0/733335460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7e80039c0 msgr2=0x7ff7e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:12.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7e80039c0 0x7ff7e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 -- 172.21.15.39:0/733335460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e8003530 con 0x7ff7e80051d0 2024-04-26T23:26:12.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 -- 172.21.15.39:0/733335460 reap_dead start 2024-04-26T23:26:12.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff802800640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 0x7ff7e800b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8040731a0 tx=0x7ff7fc01cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f80fda1fd1cc3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:12.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0b2070 con 0x7ff7e80051d0 2024-04-26T23:26:12.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc0a5b70 con 0x7ff7e80051d0 2024-04-26T23:26:12.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff801400640 1 -- 172.21.15.39:0/733335460 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc009c10 con 0x7ff7e80051d0 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff809000640 1 -- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 msgr2=0x7ff7e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.873+0000 7ff809000640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 0x7ff7e800b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8040731a0 tx=0x7ff7fc01cbe0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- 172.21.15.39:0/733335460 shutdown_connections 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 --2- 172.21.15.39:0/733335460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e80051d0 0x7ff7e800b9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- 172.21.15.39:0/733335460 >> 172.21.15.39:0/733335460 conn(0x7ff80406dfd0 msgr2=0x7ff8040b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- 172.21.15.39:0/733335460 shutdown_connections 2024-04-26T23:26:12.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- 172.21.15.39:0/733335460 wait complete. 2024-04-26T23:26:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 Processor -- start 2024-04-26T23:26:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- start start 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e80051d0 0x7ff80413c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff804153fa0 0x7ff8040b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff804074170 con 0x7ff80414de80 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff804073ff0 con 0x7ff804153fa0 2024-04-26T23:26:12.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff809000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff80406c3d0 con 0x7ff7e80051d0 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff801e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e80051d0 0x7ff80413c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58922/0 (socket says 172.21.15.39:58922) 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 -- 172.21.15.39:0/3714921235 learned_addr learned my addr 172.21.15.39:0/3714921235 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff802800640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff804153fa0 0x7ff8040b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 -- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e80051d0 msgr2=0x7ff80413c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e80051d0 0x7ff80413c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 -- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff804153fa0 msgr2=0x7ff8040b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff804153fa0 0x7ff8040b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 -- 172.21.15.39:0/3714921235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff804156130 con 0x7ff80414de80 2024-04-26T23:26:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.877+0000 7ff7f9400640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec004ed0 tx=0x7ff7ec007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00f7b0 con 0x7ff80414de80 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ec018070 con 0x7ff80414de80 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00fbd0 con 0x7ff80414de80 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff804155b70 con 0x7ff80414de80 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8041537a0 con 0x7ff80414de80 2024-04-26T23:26:12.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff80406a720 con 0x7ff80414de80 2024-04-26T23:26:12.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7ec01d460 con 0x7ff80414de80 2024-04-26T23:26:12.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 0x7ff7e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:12.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7ff7ec087120 con 0x7ff80414de80 2024-04-26T23:26:12.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.881+0000 7ff801e00640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 0x7ff7e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:12.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.885+0000 7ff801e00640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 0x7ff7e006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8040b10f0 tx=0x7ff7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:12.885+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff7ec0572e0 con 0x7ff80414de80 2024-04-26T23:26:13.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.053+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff8040b6810 con 0x7ff80414de80 2024-04-26T23:26:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.697+0000 7ff7faa00640 1 -- 172.21.15.39:0/3714921235 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7ff7ec05b5e0 con 0x7ff80414de80 2024-04-26T23:26:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 msgr2=0x7ff7e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 0x7ff7e006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8040b10f0 tx=0x7ff7f4009040 comp rx=0 tx=0).stop 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 msgr2=0x7ff804155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec004ed0 tx=0x7ff7ec007430 comp rx=0 tx=0).stop 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 shutdown_connections 2024-04-26T23:26:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7e0068380 0x7ff7e006a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff804153fa0 0x7ff8040b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80414de80 0x7ff804155040 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 --2- 172.21.15.39:0/3714921235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7e80051d0 0x7ff80413c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 >> 172.21.15.39:0/3714921235 conn(0x7ff80406dfd0 msgr2=0x7ff804161600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 shutdown_connections 2024-04-26T23:26:13.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.701+0000 7ff809000640 1 -- 172.21.15.39:0/3714921235 wait complete. 2024-04-26T23:26:13.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:26:13.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 Processor -- start 2024-04-26T23:26:13.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 -- start start 2024-04-26T23:26:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ac8140170 0x7f1ac815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ac815e340 0x7f1ac80d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8161850 0x7f1ac80d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac806f110 con 0x7f1ac8140170 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac806e500 con 0x7f1ac815e340 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1acd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac806e7e0 con 0x7f1ac8161850 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ac8140170 0x7f1ac815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ac8140170 0x7f1ac815de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58924/0 (socket says 172.21.15.39:58924) 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 -- 172.21.15.39:0/999469714 learned_addr learned my addr 172.21.15.39:0/999469714 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac7400640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8161850 0x7f1ac80d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1abfe00640 1 --2- 172.21.15.39:0/999469714 >> v2:172.21.15.71:3300/0 conn(0x7f1ac815e340 0x7f1ac80d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 -- 172.21.15.39:0/999469714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8161850 msgr2=0x7f1ac80d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:13.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8161850 0x7f1ac80d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 -- 172.21.15.39:0/999469714 >> v2:172.21.15.71:3300/0 conn(0x7f1ac815e340 msgr2=0x7f1ac80d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:13.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/999469714 >> v2:172.21.15.71:3300/0 conn(0x7f1ac815e340 0x7f1ac80d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.889+0000 7f1ac6a00640 1 -- 172.21.15.39:0/999469714 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac806eac0 con 0x7f1ac8140170 2024-04-26T23:26:13.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8140170 0x7f1ac815de00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8072270 tx=0x7f1ab801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b10d5637044470 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:13.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1ac6000640 1 -- 172.21.15.39:0/999469714 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80ab640 con 0x7f1ac8140170 2024-04-26T23:26:13.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1ac6000640 1 -- 172.21.15.39:0/999469714 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab80b0070 con 0x7f1ac8140170 2024-04-26T23:26:13.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1ac6000640 1 -- 172.21.15.39:0/999469714 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80aba00 con 0x7f1ac8140170 2024-04-26T23:26:13.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 -- 172.21.15.39:0/999469714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8140170 msgr2=0x7f1ac815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:13.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8140170 0x7f1ac815de00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8072270 tx=0x7f1ab801c460 comp rx=0 tx=0).stop 2024-04-26T23:26:13.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 -- 172.21.15.39:0/999469714 shutdown_connections 2024-04-26T23:26:13.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8161850 0x7f1ac80d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 --2- 172.21.15.39:0/999469714 >> v2:172.21.15.71:3300/0 conn(0x7f1ac815e340 0x7f1ac80d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 --2- 172.21.15.39:0/999469714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8140170 0x7f1ac815de00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 -- 172.21.15.39:0/999469714 >> 172.21.15.39:0/999469714 conn(0x7f1ac806c7d0 msgr2=0x7f1ac806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 -- 172.21.15.39:0/999469714 shutdown_connections 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.893+0000 7f1acd800640 1 -- 172.21.15.39:0/999469714 wait complete. 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 Processor -- start 2024-04-26T23:26:13.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- start start 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8140170 0x7f1ac815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ac815e340 0x7f1ac8156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac81432a0 con 0x7f1ac8161850 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac8143120 con 0x7f1ac815e340 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac8143420 con 0x7f1ac8140170 2024-04-26T23:26:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58938/0 (socket says 172.21.15.39:58938) 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 -- 172.21.15.39:0/1631952435 learned_addr learned my addr 172.21.15.39:0/1631952435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1abfe00640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ac815e340 0x7f1ac8156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8140170 0x7f1ac815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 -- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8140170 msgr2=0x7f1ac815fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8140170 0x7f1ac815fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 -- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ac815e340 msgr2=0x7f1ac8156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ac815e340 0x7f1ac8156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:13.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 -- 172.21.15.39:0/1631952435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac8141830 con 0x7f1ac8161850 2024-04-26T23:26:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1ac7400640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009cb0 tx=0x7f1ac000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0018020 con 0x7f1ac8161850 2024-04-26T23:26:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac0014480 con 0x7f1ac8161850 2024-04-26T23:26:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac8141b90 con 0x7f1ac8161850 2024-04-26T23:26:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0014870 con 0x7f1ac8161850 2024-04-26T23:26:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac815f200 con 0x7f1ac8161850 2024-04-26T23:26:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.897+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac806a720 con 0x7f1ac8161850 2024-04-26T23:26:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.901+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ac001b020 con 0x7f1ac8161850 2024-04-26T23:26:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.901+0000 7f1abea00640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.901+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f1ac0087690 con 0x7f1ac8161850 2024-04-26T23:26:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.901+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.901+0000 7f1ac6a00640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 0x7f1aa406a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80af000 tx=0x7f1ab80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:13.905+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1ac0022020 con 0x7f1ac8161850 2024-04-26T23:26:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.105+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1ac8160910 con 0x7f1ac8161850 2024-04-26T23:26:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1abea00640 1 -- 172.21.15.39:0/1631952435 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1ac0010040 con 0x7f1ac8161850 2024-04-26T23:26:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 msgr2=0x7f1aa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 0x7f1aa406a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80af000 tx=0x7f1ab80a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 msgr2=0x7f1ac813b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009cb0 tx=0x7f1ac000c490 comp rx=0 tx=0).stop 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 shutdown_connections 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8161850 0x7f1ac813b7f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ac815e340 0x7f1ac8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 --2- 172.21.15.39:0/1631952435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ac8140170 0x7f1ac815fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.701+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 >> 172.21.15.39:0/1631952435 conn(0x7f1ac806c7d0 msgr2=0x7f1ac815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:14.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.705+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 shutdown_connections 2024-04-26T23:26:14.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.705+0000 7f1acd800640 1 -- 172.21.15.39:0/1631952435 wait complete. 2024-04-26T23:26:14.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:14.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.885+0000 7fe4f5e00640 1 Processor -- start 2024-04-26T23:26:14.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.885+0000 7fe4f5e00640 1 -- start start 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4f006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4f5e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f0074750 con 0x7fe4f00cd810 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4f5e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f00d0290 con 0x7fe4f00742f0 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4f5e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f00d0b10 con 0x7fe4f00cfe00 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4eea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe4f00cd810 0x7fe4f0144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56462/0 (socket says 172.21.15.39:56462) 2024-04-26T23:26:14.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4eea00640 1 -- 172.21.15.39:0/3254092257 learned_addr learned my addr 172.21.15.39:0/3254092257 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:14.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ef400640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4f006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120180764 0 0) 0x7fe4f0074750 con 0x7fe4f00cd810 2024-04-26T23:26:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d4003530 con 0x7fe4f00cd810 2024-04-26T23:26:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401293035 0 0) 0x7fe4f00d0290 con 0x7fe4f00742f0 2024-04-26T23:26:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f0074750 con 0x7fe4f00742f0 2024-04-26T23:26:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291817080 0 0) 0x7fe4d4003530 con 0x7fe4f00cd810 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 msgr2=0x7fe4f006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4f006ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 >> v1:172.21.15.71:6789/0 conn(0x7fe4f00742f0 legacy=0x7fe4f00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00d0550 con 0x7fe4f00cd810 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fe4e0001680 con 0x7fe4f00cd810 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 >> v1:172.21.15.39:6789/0 conn(0x7fe4f00cd810 legacy=0x7fe4f0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4003b80 0x7fe4d4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4d4004810 0x7fe4d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4d40051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00d0b10 con 0x7fe4d4004810 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d400bb10 con 0x7fe4d4003b80 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d400bd10 con 0x7fe4f00cfe00 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4d4004810 0x7fe4d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4eea00640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4003b80 0x7fe4d4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ef400640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4d40051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 -- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 msgr2=0x7fe4d40051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4d40051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 -- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4003b80 msgr2=0x7fe4d4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4003b80 0x7fe4d4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4e6000640 1 -- 172.21.15.39:0/3254092257 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d4003530 con 0x7fe4d4004810 2024-04-26T23:26:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.889+0000 7fe4ef400640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f00cfe00 0x7fe4d40051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4e6000640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4d4004810 0x7fe4d4004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80018d0 tx=0x7fe4d801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7411f4033d1012d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8001520 con 0x7fe4d4004810 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80052f0 con 0x7fe4d4004810 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4ee000640 1 -- 172.21.15.39:0/3254092257 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8003840 con 0x7fe4d4004810 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 -- 172.21.15.39:0/3254092257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4d4004810 msgr2=0x7fe4d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/3254092257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4d4004810 0x7fe4d4004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80018d0 tx=0x7fe4d801c580 comp rx=0 tx=0).stop 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4ef400640 1 -- 172.21.15.39:0/3254092257 reap_dead start 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 -- 172.21.15.39:0/3254092257 shutdown_connections 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 -- 172.21.15.39:0/3254092257 >> 172.21.15.39:0/3254092257 conn(0x7fe4f00b2af0 msgr2=0x7fe4f00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 -- 172.21.15.39:0/3254092257 shutdown_connections 2024-04-26T23:26:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.893+0000 7fe4f5e00640 1 -- 172.21.15.39:0/3254092257 wait complete. 2024-04-26T23:26:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 Processor -- start 2024-04-26T23:26:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- start start 2024-04-26T23:26:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4004810 0x7fe4f0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f01598e0 0x7fe4f0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006f770 con 0x7fe4f013e420 2024-04-26T23:26:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006f5f0 con 0x7fe4d4004810 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f006f8f0 con 0x7fe4f01598e0 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58970/0 (socket says 172.21.15.39:58970) 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 -- 172.21.15.39:0/463775091 learned_addr learned my addr 172.21.15.39:0/463775091 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4e6000640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f01598e0 0x7fe4f0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4eea00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4004810 0x7fe4f0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 -- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f01598e0 msgr2=0x7fe4f0159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f01598e0 0x7fe4f0159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 -- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4004810 msgr2=0x7fe4f0158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4004810 0x7fe4f0158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 -- 172.21.15.39:0/463775091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f013f0e0 con 0x7fe4f013e420 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4ef400640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00b37e0 tx=0x7fe4e800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e801c070 con 0x7fe4f013e420 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8017400 con 0x7fe4f013e420 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f013f3c0 con 0x7fe4f013e420 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80177d0 con 0x7fe4f013e420 2024-04-26T23:26:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f013f980 con 0x7fe4f013e420 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.897+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f0050740 con 0x7fe4f013e420 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.901+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4e801f070 con 0x7fe4f013e420 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.901+0000 7fe4e7e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 0x7fe4cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.901+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fe4e8086a30 con 0x7fe4f013e420 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.901+0000 7fe4eea00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 0x7fe4cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.901+0000 7fe4eea00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 0x7fe4cc06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007b50 tx=0x7fe4e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:14.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:14.905+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4e8012070 con 0x7fe4f013e420 2024-04-26T23:26:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.073+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4f00d0290 con 0x7fe4f013e420 2024-04-26T23:26:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.073+0000 7fe4e7e00640 1 -- 172.21.15.39:0/463775091 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16558 (secure 0 0 0) 0x7fe4e805be20 con 0x7fe4f013e420 2024-04-26T23:26:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:15.078 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":19,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:14.110544+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:15.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 msgr2=0x7fe4cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 0x7fe4cc06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007b50 tx=0x7fe4e0009040 comp rx=0 tx=0).stop 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 msgr2=0x7fe4f013e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00b37e0 tx=0x7fe4e800f4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 shutdown_connections 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4cc0683b0 0x7fe4cc06a870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4f013e420 0x7fe4f013e8a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4f01598e0 0x7fe4f0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 --2- 172.21.15.39:0/463775091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4d4004810 0x7fe4f0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 >> 172.21.15.39:0/463775091 conn(0x7fe4f00b2af0 msgr2=0x7fe4f00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:15.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 shutdown_connections 2024-04-26T23:26:15.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.077+0000 7fe4f5e00640 1 -- 172.21.15.39:0/463775091 wait complete. 2024-04-26T23:26:15.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:15.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 Processor -- start 2024-04-26T23:26:15.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 -- start start 2024-04-26T23:26:15.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f86f815f340 0x7f86f80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86f80b5710 0x7f86f809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f86f80d26a0 con 0x7f86f80b5710 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f86f80ce140 con 0x7f86f815f340 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f8700800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f86f80cd810 con 0x7f86f815f720 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86f80b5710 0x7f86f809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86f80b5710 0x7f86f809b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58972/0 (socket says 172.21.15.39:58972) 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 -- 172.21.15.39:0/2149467236 learned_addr learned my addr 172.21.15.39:0/2149467236 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fde00640 1 --2- 172.21.15.39:0/2149467236 >> v2:172.21.15.71:3300/0 conn(0x7f86f815f340 0x7f86f80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fe800640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 -- 172.21.15.39:0/2149467236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 msgr2=0x7f86f809bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f809bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 -- 172.21.15.39:0/2149467236 >> v2:172.21.15.71:3300/0 conn(0x7f86f815f340 msgr2=0x7f86f80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 --2- 172.21.15.39:0/2149467236 >> v2:172.21.15.71:3300/0 conn(0x7f86f815f340 0x7f86f80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.237+0000 7f86fd400640 1 -- 172.21.15.39:0/2149467236 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f80cdaf0 con 0x7f86f80b5710 2024-04-26T23:26:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f86fd400640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f80b5710 0x7f86f809b9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86f8074870 tx=0x7f86e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5051b19b058100ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f86fca00640 1 -- 172.21.15.39:0/2149467236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80ab640 con 0x7f86f80b5710 2024-04-26T23:26:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f86fca00640 1 -- 172.21.15.39:0/2149467236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e80b0070 con 0x7f86f80b5710 2024-04-26T23:26:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f86fca00640 1 -- 172.21.15.39:0/2149467236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80aba00 con 0x7f86f80b5710 2024-04-26T23:26:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 -- 172.21.15.39:0/2149467236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f80b5710 msgr2=0x7f86f809b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f80b5710 0x7f86f809b9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86f8074870 tx=0x7f86e801c460 comp rx=0 tx=0).stop 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 -- 172.21.15.39:0/2149467236 shutdown_connections 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 --2- 172.21.15.39:0/2149467236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f80b5710 0x7f86f809b9e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 --2- 172.21.15.39:0/2149467236 >> v2:172.21.15.71:3300/0 conn(0x7f86f815f340 0x7f86f80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 -- 172.21.15.39:0/2149467236 >> 172.21.15.39:0/2149467236 conn(0x7f86f80b4b80 msgr2=0x7f86f80b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 -- 172.21.15.39:0/2149467236 shutdown_connections 2024-04-26T23:26:15.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.241+0000 7f8700800640 1 -- 172.21.15.39:0/2149467236 wait complete. 2024-04-26T23:26:15.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 Processor -- start 2024-04-26T23:26:15.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- start start 2024-04-26T23:26:15.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 0x7f86f80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f8159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86f80b8ab0 con 0x7f86f815f340 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86f80b8c30 con 0x7f86f80b5710 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f86f80b8db0 con 0x7f86f815f720 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58982/0 (socket says 172.21.15.39:58982) 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 -- 172.21.15.39:0/1775911024 learned_addr learned my addr 172.21.15.39:0/1775911024 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fe800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fde00640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 0x7f86f80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 -- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 msgr2=0x7f86f8159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f8159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 -- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 msgr2=0x7f86f80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 0x7f86f80ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 -- 172.21.15.39:0/1775911024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f80cd030 con 0x7f86f815f340 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fde00640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 0x7f86f80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86fd400640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86e801ab10 tx=0x7f86e801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80abdb0 con 0x7f86f815f340 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e80be3f0 con 0x7f86f815f340 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80be7e0 con 0x7f86f815f340 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f81586a0 con 0x7f86f815f340 2024-04-26T23:26:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f8158c60 con 0x7f86f815f340 2024-04-26T23:26:15.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.245+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f8050740 con 0x7f86f815f340 2024-04-26T23:26:15.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.249+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86e80b43f0 con 0x7f86f815f340 2024-04-26T23:26:15.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.249+0000 7f86f2000640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 0x7f86dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.249+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f86e8120b20 con 0x7f86f815f340 2024-04-26T23:26:15.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.249+0000 7f86fde00640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 0x7f86dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.249+0000 7f86fde00640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 0x7f86dc06a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009bb0 tx=0x7f86ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.253+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86e8016110 con 0x7f86f815f340 2024-04-26T23:26:15.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.421+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86f806edf0 con 0x7f86f815f340 2024-04-26T23:26:15.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.421+0000 7f86f2000640 1 -- 172.21.15.39:0/1775911024 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16558 (secure 0 0 0) 0x7f86e80f09f0 con 0x7f86f815f340 2024-04-26T23:26:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:15.427 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":19,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:14.110544+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:15.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 msgr2=0x7f86dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 0x7f86dc06a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009bb0 tx=0x7f86ec008040 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 msgr2=0x7f86f80b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86e801ab10 tx=0x7f86e801aca0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 shutdown_connections 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f86dc068380 0x7f86dc06a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86f815f720 0x7f86f8159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f815f340 0x7f86f80b64e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 --2- 172.21.15.39:0/1775911024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f80b5710 0x7f86f80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 >> 172.21.15.39:0/1775911024 conn(0x7f86f80b4b80 msgr2=0x7f86f80d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 shutdown_connections 2024-04-26T23:26:15.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.425+0000 7f8700800640 1 -- 172.21.15.39:0/1775911024 wait complete. 2024-04-26T23:26:15.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:26:15.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 Processor -- start 2024-04-26T23:26:15.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 -- start start 2024-04-26T23:26:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e9015d240 0x7f9e900d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e900b40e0 0x7f9e900b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e900b4770 con 0x7f9e900d1940 2024-04-26T23:26:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9015d620 con 0x7f9e900b40e0 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e95a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9e900b4530 con 0x7f9e9015d240 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e900b40e0 0x7f9e900b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e900b40e0 0x7f9e900b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58988/0 (socket says 172.21.15.39:58988) 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 -- 172.21.15.39:0/1992510478 learned_addr learned my addr 172.21.15.39:0/1992510478 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8ea00640 1 --2- 172.21.15.39:0/1992510478 >> v2:172.21.15.71:3300/0 conn(0x7f9e9015d240 0x7f9e900d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 -- 172.21.15.39:0/1992510478 >> v2:172.21.15.71:3300/0 conn(0x7f9e9015d240 msgr2=0x7f9e900d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 --2- 172.21.15.39:0/1992510478 >> v2:172.21.15.71:3300/0 conn(0x7f9e9015d240 0x7f9e900d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 -- 172.21.15.39:0/1992510478 >> v1:172.21.15.71:6789/0 conn(0x7f9e900d1940 legacy=0x7f9e900b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.589+0000 7f9e8f400640 1 -- 172.21.15.39:0/1992510478 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900aff80 con 0x7f9e900b40e0 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e8f400640 1 --2- 172.21.15.39:0/1992510478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900b40e0 0x7f9e900b0a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009e50 tx=0x7f9e8801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6498ddd8cdb79983 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e8e000640 1 -- 172.21.15.39:0/1992510478 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880a5620 con 0x7f9e900b40e0 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e8e000640 1 -- 172.21.15.39:0/1992510478 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e880a57c0 con 0x7f9e900b40e0 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e8e000640 1 -- 172.21.15.39:0/1992510478 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880a5b90 con 0x7f9e900b40e0 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 -- 172.21.15.39:0/1992510478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900b40e0 msgr2=0x7f9e900b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 --2- 172.21.15.39:0/1992510478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900b40e0 0x7f9e900b0a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009e50 tx=0x7f9e8801c960 comp rx=0 tx=0).stop 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 -- 172.21.15.39:0/1992510478 shutdown_connections 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 --2- 172.21.15.39:0/1992510478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900b40e0 0x7f9e900b0a60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 --2- 172.21.15.39:0/1992510478 >> v2:172.21.15.71:3300/0 conn(0x7f9e9015d240 0x7f9e900d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 -- 172.21.15.39:0/1992510478 >> 172.21.15.39:0/1992510478 conn(0x7f9e900d3040 msgr2=0x7f9e900d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:15.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 -- 172.21.15.39:0/1992510478 shutdown_connections 2024-04-26T23:26:15.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 -- 172.21.15.39:0/1992510478 wait complete. 2024-04-26T23:26:15.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.593+0000 7f9e95a00640 1 Processor -- start 2024-04-26T23:26:15.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- start start 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e900b40e0 0x7f9e90152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9015d240 0x7f9e90159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e900b1b80 con 0x7f9e900d1940 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e900b1a00 con 0x7f9e9015d240 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9e900b1d00 con 0x7f9e900b40e0 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59000/0 (socket says 172.21.15.39:59000) 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 -- 172.21.15.39:0/602496012 learned_addr learned my addr 172.21.15.39:0/602496012 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e8ea00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e900b40e0 0x7f9e90152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e8f400640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9015d240 0x7f9e90159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 -- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e900b40e0 msgr2=0x7f9e90152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e900b40e0 0x7f9e90152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 -- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9015d240 msgr2=0x7f9e90159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9015d240 0x7f9e90159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 -- 172.21.15.39:0/602496012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e90158b30 con 0x7f9e900d1940 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e87e00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c370 tx=0x7f9e7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780052d0 con 0x7f9e900d1940 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e90158df0 con 0x7f9e900d1940 2024-04-26T23:26:15.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e78005470 con 0x7f9e900d1940 2024-04-26T23:26:15.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78007260 con 0x7f9e900d1940 2024-04-26T23:26:15.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e901593b0 con 0x7f9e900d1940 2024-04-26T23:26:15.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.597+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9006a720 con 0x7f9e900d1940 2024-04-26T23:26:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.601+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e78007400 con 0x7f9e900d1940 2024-04-26T23:26:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.601+0000 7f9e86a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.601+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9e78085f10 con 0x7f9e900d1940 2024-04-26T23:26:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.601+0000 7f9e8ea00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.601+0000 7f9e8ea00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 0x7f9e6c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e900a1000 tx=0x7f9e80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:15.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.605+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e78056440 con 0x7f9e900d1940 2024-04-26T23:26:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:15.813+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9e900c9ad0 con 0x7f9e900d1940 2024-04-26T23:26:16.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.725+0000 7f9e86a00640 1 -- 172.21.15.39:0/602496012 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f9e78055d40 con 0x7f9e900d1940 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 msgr2=0x7f9e6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 0x7f9e6c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e900a1000 tx=0x7f9e80008040 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 msgr2=0x7f9e90153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c370 tx=0x7f9e7800c830 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 shutdown_connections 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9015d240 0x7f9e90159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e900d1940 0x7f9e90153550 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 --2- 172.21.15.39:0/602496012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e900b40e0 0x7f9e90152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 >> 172.21.15.39:0/602496012 conn(0x7f9e900d3040 msgr2=0x7f9e900d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:16.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 shutdown_connections 2024-04-26T23:26:16.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.729+0000 7f9e95a00640 1 -- 172.21.15.39:0/602496012 wait complete. 2024-04-26T23:26:16.755 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:26:16.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:26:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.897+0000 7f25ba400640 1 Processor -- start 2024-04-26T23:26:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.897+0000 7f25ba400640 1 -- start start 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25ba400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f25b41458d0 0x7f25b40b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25ba400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25b40ce5e0 0x7f25b40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25ba400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b4072180 con 0x7f25b4073400 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25ba400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f25b40739a0 con 0x7f25b41458d0 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25ba400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f25b4073c80 con 0x7f25b40ce5e0 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f25b41458d0 0x7f25b40b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f25b41458d0 0x7f25b40b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59010/0 (socket says 172.21.15.39:59010) 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 -- 172.21.15.39:0/1609484839 learned_addr learned my addr 172.21.15.39:0/1609484839 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3e00640 1 --2- 172.21.15.39:0/1609484839 >> v2:172.21.15.71:3300/0 conn(0x7f25b40ce5e0 0x7f25b40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 -- 172.21.15.39:0/1609484839 >> v2:172.21.15.71:3300/0 conn(0x7f25b40ce5e0 msgr2=0x7f25b40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 --2- 172.21.15.39:0/1609484839 >> v2:172.21.15.71:3300/0 conn(0x7f25b40ce5e0 0x7f25b40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 -- 172.21.15.39:0/1609484839 >> v1:172.21.15.71:6789/0 conn(0x7f25b4073400 legacy=0x7f25b4072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 -- 172.21.15.39:0/1609484839 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b4145cb0 con 0x7f25b41458d0 2024-04-26T23:26:16.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.901+0000 7f25b3400640 1 --2- 172.21.15.39:0/1609484839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b41458d0 0x7f25b40b4890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25a400bb10 tx=0x7f25a401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b0bb2e12e006de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:16.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25b2a00640 1 -- 172.21.15.39:0/1609484839 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40b4070 con 0x7f25b41458d0 2024-04-26T23:26:16.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25b2a00640 1 -- 172.21.15.39:0/1609484839 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a40a7b40 con 0x7f25b41458d0 2024-04-26T23:26:16.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25b2a00640 1 -- 172.21.15.39:0/1609484839 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40af440 con 0x7f25b41458d0 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- 172.21.15.39:0/1609484839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b41458d0 msgr2=0x7f25b40b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- 172.21.15.39:0/1609484839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b41458d0 0x7f25b40b4890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25a400bb10 tx=0x7f25a401eb60 comp rx=0 tx=0).stop 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- 172.21.15.39:0/1609484839 shutdown_connections 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- 172.21.15.39:0/1609484839 >> v2:172.21.15.71:3300/0 conn(0x7f25b40ce5e0 0x7f25b40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- 172.21.15.39:0/1609484839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b41458d0 0x7f25b40b4890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- 172.21.15.39:0/1609484839 >> 172.21.15.39:0/1609484839 conn(0x7f25b406c7d0 msgr2=0x7f25b406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- 172.21.15.39:0/1609484839 shutdown_connections 2024-04-26T23:26:16.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- 172.21.15.39:0/1609484839 wait complete. 2024-04-26T23:26:16.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 Processor -- start 2024-04-26T23:26:16.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- start start 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25b4073400 0x7f25b4137af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 0x7f25b4140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f25b406ec70 con 0x7f25b40ce5e0 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4073230 con 0x7f25b41458d0 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25ba400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f25b406edf0 con 0x7f25b4073400 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25abe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25abe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59014/0 (socket says 172.21.15.39:59014) 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25abe00640 1 -- 172.21.15.39:0/1781134840 learned_addr learned my addr 172.21.15.39:0/1781134840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.905+0000 7f25b3400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25b4073400 0x7f25b4137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25b3e00640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 0x7f25b4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 -- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25b4073400 msgr2=0x7f25b4137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25b4073400 0x7f25b4137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 -- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 msgr2=0x7f25b4140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 0x7f25b4140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 -- 172.21.15.39:0/1781134840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b41f8d40 con 0x7f25b40ce5e0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25b3e00640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 0x7f25b4140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25abe00640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c450 tx=0x7f259c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c016020 con 0x7f25b40ce5e0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c0052d0 con 0x7f25b40ce5e0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c007260 con 0x7f25b40ce5e0 2024-04-26T23:26:16.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b41f9020 con 0x7f25b40ce5e0 2024-04-26T23:26:16.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b413a140 con 0x7f25b40ce5e0 2024-04-26T23:26:16.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b406a720 con 0x7f25b40ce5e0 2024-04-26T23:26:16.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f259c007400 con 0x7f25b40ce5e0 2024-04-26T23:26:16.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 0x7f259006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:16.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.909+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f259c086190 con 0x7f25b40ce5e0 2024-04-26T23:26:16.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.913+0000 7f25b3400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 0x7f259006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:16.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.913+0000 7f25b3400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 0x7f259006a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b1000 tx=0x7f25a40a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:16.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:16.913+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f259c020020 con 0x7f25b40ce5e0 2024-04-26T23:26:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.113+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25b40b50b0 con 0x7f25b40ce5e0 2024-04-26T23:26:17.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ab400640 1 -- 172.21.15.39:0/1781134840 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f259c005480 con 0x7f25b40ce5e0 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 msgr2=0x7f259006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 0x7f259006a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b1000 tx=0x7f25a40a9070 comp rx=0 tx=0).stop 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 msgr2=0x7f25b41f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c450 tx=0x7f259c00c910 comp rx=0 tx=0).stop 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 shutdown_connections 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f25900683d0 0x7f259006a890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25b41458d0 0x7f25b4140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25b40ce5e0 0x7f25b41f8240 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 --2- 172.21.15.39:0/1781134840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25b4073400 0x7f25b4137af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 >> 172.21.15.39:0/1781134840 conn(0x7f25b406c7d0 msgr2=0x7f25b40b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 shutdown_connections 2024-04-26T23:26:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.733+0000 7f25ba400640 1 -- 172.21.15.39:0/1781134840 wait complete. 2024-04-26T23:26:17.760 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:26:17.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:17.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.897+0000 7f00cf600640 1 Processor -- start 2024-04-26T23:26:17.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.897+0000 7f00cf600640 1 -- start start 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.897+0000 7f00cf600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00c8145820 0x7f00c80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.897+0000 7f00cf600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 0x7f00c80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00cf600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c8160060 con 0x7f00c806f570 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00cf600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f00c80cd5c0 con 0x7f00c8145820 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00cf600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f00c8160340 con 0x7f00c80b4950 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00cd600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f00c806f570 0x7f00c80cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56468/0 (socket says 172.21.15.39:56468) 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00cd600640 1 -- 172.21.15.39:0/3053427827 learned_addr learned my addr 172.21.15.39:0/3053427827 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 --2- 172.21.15.39:0/3053427827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 0x7f00c80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00ccc00640 1 --2- 172.21.15.39:0/3053427827 >> v2:172.21.15.71:3300/0 conn(0x7f00c8145820 0x7f00c80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7400640 1 -- 172.21.15.39:0/3053427827 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997888150 0 0) 0x7f00c8160060 con 0x7f00c806f570 2024-04-26T23:26:17.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7400640 1 -- 172.21.15.39:0/3053427827 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b0003530 con 0x7f00c806f570 2024-04-26T23:26:17.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 -- 172.21.15.39:0/3053427827 >> v2:172.21.15.71:3300/0 conn(0x7f00c8145820 msgr2=0x7f00c80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:17.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 --2- 172.21.15.39:0/3053427827 >> v2:172.21.15.71:3300/0 conn(0x7f00c8145820 0x7f00c80cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 -- 172.21.15.39:0/3053427827 >> v1:172.21.15.39:6789/0 conn(0x7f00c806f570 legacy=0x7f00c80cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 -- 172.21.15.39:0/3053427827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c8160620 con 0x7f00c80b4950 2024-04-26T23:26:17.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.901+0000 7f00c7e00640 1 --2- 172.21.15.39:0/3053427827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 0x7f00c80b4d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b40097c0 tx=0x7f00b401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed44d0d6cce8c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:17.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7400640 1 -- 172.21.15.39:0/3053427827 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40b2070 con 0x7f00c80b4950 2024-04-26T23:26:17.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7400640 1 -- 172.21.15.39:0/3053427827 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40ad640 con 0x7f00c80b4950 2024-04-26T23:26:17.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7400640 1 -- 172.21.15.39:0/3053427827 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40ad9f0 con 0x7f00c80b4950 2024-04-26T23:26:17.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- 172.21.15.39:0/3053427827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 msgr2=0x7f00c80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- 172.21.15.39:0/3053427827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 0x7f00c80b4d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b40097c0 tx=0x7f00b401c470 comp rx=0 tx=0).stop 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- 172.21.15.39:0/3053427827 shutdown_connections 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- 172.21.15.39:0/3053427827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c80b4950 0x7f00c80b4d70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- 172.21.15.39:0/3053427827 >> v2:172.21.15.71:3300/0 conn(0x7f00c8145820 0x7f00c80cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- 172.21.15.39:0/3053427827 >> 172.21.15.39:0/3053427827 conn(0x7f00c80b2af0 msgr2=0x7f00c80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- 172.21.15.39:0/3053427827 shutdown_connections 2024-04-26T23:26:17.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- 172.21.15.39:0/3053427827 wait complete. 2024-04-26T23:26:17.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 Processor -- start 2024-04-26T23:26:17.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- start start 2024-04-26T23:26:17.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c806f570 0x7f00c813ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00c8145820 0x7f00c8072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815fdb0 con 0x7f00c80b4950 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815fc30 con 0x7f00c8145820 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cf600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f00c80ce570 con 0x7f00c806f570 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59030/0 (socket says 172.21.15.39:59030) 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00c7e00640 1 -- 172.21.15.39:0/947342373 learned_addr learned my addr 172.21.15.39:0/947342373 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00ccc00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c806f570 0x7f00c813ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.905+0000 7f00cd600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00c8145820 0x7f00c8072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 -- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c806f570 msgr2=0x7f00c813ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c806f570 0x7f00c813ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 -- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00c8145820 msgr2=0x7f00c8072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00c8145820 0x7f00c8072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 -- 172.21.15.39:0/947342373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c813b220 con 0x7f00c80b4950 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c7e00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:17.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40bc070 con 0x7f00c80b4950 2024-04-26T23:26:17.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40ad9f0 con 0x7f00c80b4950 2024-04-26T23:26:17.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40b2040 con 0x7f00c80b4950 2024-04-26T23:26:17.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c80726a0 con 0x7f00c80b4950 2024-04-26T23:26:17.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c80b18f0 con 0x7f00c80b4950 2024-04-26T23:26:17.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c8075c00 con 0x7f00c80b4950 2024-04-26T23:26:17.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00b4003620 con 0x7f00c80b4950 2024-04-26T23:26:17.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 0x7f00a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:17.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00b411fca0 con 0x7f00c80b4950 2024-04-26T23:26:17.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.909+0000 7f00ccc00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 0x7f00a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:17.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.913+0000 7f00ccc00640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 0x7f00a806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009ac0 tx=0x7f00bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:17.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:17.913+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00b4016090 con 0x7f00c80b4950 2024-04-26T23:26:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.117+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c8050740 con 0x7f00c80b4950 2024-04-26T23:26:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.117+0000 7f00c4c00640 1 -- 172.21.15.39:0/947342373 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f00b40efca0 con 0x7f00c80b4950 2024-04-26T23:26:18.124 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:18.124 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:18.124 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:18.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 msgr2=0x7f00a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 0x7f00a806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009ac0 tx=0x7f00bc009190 comp rx=0 tx=0).stop 2024-04-26T23:26:18.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 msgr2=0x7f00c8073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b4019210 comp rx=0 tx=0).stop 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 shutdown_connections 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f00a8068380 0x7f00a806a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00c8145820 0x7f00c8072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00c80b4950 0x7f00c8073b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 --2- 172.21.15.39:0/947342373 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f00c806f570 0x7f00c813ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 >> 172.21.15.39:0/947342373 conn(0x7f00c80b2af0 msgr2=0x7f00c8156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:18.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 shutdown_connections 2024-04-26T23:26:18.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.121+0000 7f00cf600640 1 -- 172.21.15.39:0/947342373 wait complete. 2024-04-26T23:26:18.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.281+0000 7f8588000640 1 Processor -- start 2024-04-26T23:26:18.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.281+0000 7f8588000640 1 -- start start 2024-04-26T23:26:18.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8588000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 0x7f858006f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8588000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8588000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8580160060 con 0x7f8580145820 2024-04-26T23:26:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8588000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f85800cd5c0 con 0x7f85800cf2a0 2024-04-26T23:26:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8588000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8580160340 con 0x7f858006fab0 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8584c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 0x7f858006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:42912/0 (socket says 172.21.15.39:42912) 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 -- 172.21.15.39:0/3178964849 learned_addr learned my addr 172.21.15.39:0/3178964849 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 -- 172.21.15.39:0/3178964849 >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 msgr2=0x7f858006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 --2- 172.21.15.39:0/3178964849 >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 0x7f858006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 -- 172.21.15.39:0/3178964849 >> v1:172.21.15.71:6789/0 conn(0x7f8580145820 legacy=0x7f85800b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 -- 172.21.15.39:0/3178964849 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580160620 con 0x7f858006fab0 2024-04-26T23:26:18.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8584c00640 1 --2- 172.21.15.39:0/3178964849 >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 0x7f858006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:18.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.285+0000 7f8586000640 1 --2- 172.21.15.39:0/3178964849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f857800d150 tx=0x7f857801ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=878fdc9dcd7c316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f857fe00640 1 -- 172.21.15.39:0/3178964849 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857800b2d0 con 0x7f858006fab0 2024-04-26T23:26:18.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f857fe00640 1 -- 172.21.15.39:0/3178964849 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857800b470 con 0x7f858006fab0 2024-04-26T23:26:18.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f857fe00640 1 -- 172.21.15.39:0/3178964849 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780a7b20 con 0x7f858006fab0 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- 172.21.15.39:0/3178964849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 msgr2=0x7f85800cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- 172.21.15.39:0/3178964849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f857800d150 tx=0x7f857801ec30 comp rx=0 tx=0).stop 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- 172.21.15.39:0/3178964849 shutdown_connections 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- 172.21.15.39:0/3178964849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f858006fab0 0x7f85800cda50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- 172.21.15.39:0/3178964849 >> v2:172.21.15.71:3300/0 conn(0x7f85800cf2a0 0x7f858006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- 172.21.15.39:0/3178964849 >> 172.21.15.39:0/3178964849 conn(0x7f85800b2af0 msgr2=0x7f85800b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- 172.21.15.39:0/3178964849 shutdown_connections 2024-04-26T23:26:18.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- 172.21.15.39:0/3178964849 wait complete. 2024-04-26T23:26:18.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 Processor -- start 2024-04-26T23:26:18.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- start start 2024-04-26T23:26:18.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 0x7f858013bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 0x7f8580143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 0x7f85801408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f858015fdb0 con 0x7f8580145820 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f858015fc30 con 0x7f858006fab0 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.289+0000 7f8588000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f858006e460 con 0x7f85800cf2a0 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 0x7f85801408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8585600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 0x7f858013bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8585600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 0x7f858013bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:56518/0 (socket says 172.21.15.39:56518) 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8585600640 1 -- 172.21.15.39:0/1133512706 learned_addr learned my addr 172.21.15.39:0/1133512706 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:18.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8584c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 0x7f8580143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 -- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 msgr2=0x7f8580143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 0x7f8580143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 -- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 msgr2=0x7f858013bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 0x7f858013bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 -- 172.21.15.39:0/1133512706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580143a80 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8584c00640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 0x7f8580143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8586000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 0x7f85801408f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85780ad000 tx=0x7f857801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780bd020 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578009820 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8580143d60 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578009c10 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580144320 con 0x7f8580145820 2024-04-26T23:26:18.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580050740 con 0x7f8580145820 2024-04-26T23:26:18.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.293+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85780c0070 con 0x7f8580145820 2024-04-26T23:26:18.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.297+0000 7f857d600640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 0x7f856006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.297+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8578120cd0 con 0x7f8580145820 2024-04-26T23:26:18.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.297+0000 7f8585600640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 0x7f856006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.297+0000 7f8585600640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 0x7f856006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8574007fd0 tx=0x7f8574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.301+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8578018820 con 0x7f8580145820 2024-04-26T23:26:18.414 INFO:tasks.ceph.mds.b.smithi071.stderr:2024-04-26T23:26:18.409+0000 7fb823600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:26:18.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85801594b0 con 0x7f8580145820 2024-04-26T23:26:18.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f857d600640 1 -- 172.21.15.39:0/1133512706 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f85780f0c60 con 0x7f8580145820 2024-04-26T23:26:18.473 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:18.473 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:18.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 msgr2=0x7f856006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 0x7f856006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8574007fd0 tx=0x7f8574009040 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 msgr2=0x7f85801408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 0x7f85801408f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85780ad000 tx=0x7f857801b9d0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 shutdown_connections 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8560068380 0x7f856006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8580145820 0x7f85801408f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85800cf2a0 0x7f8580143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 --2- 172.21.15.39:0/1133512706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858006fab0 0x7f858013bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 >> 172.21.15.39:0/1133512706 conn(0x7f85800b2af0 msgr2=0x7f8580158720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 shutdown_connections 2024-04-26T23:26:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.469+0000 7f8588000640 1 -- 172.21.15.39:0/1133512706 wait complete. 2024-04-26T23:26:18.496 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:26:18.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:26:18.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 Processor -- start 2024-04-26T23:26:18.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 -- start start 2024-04-26T23:26:18.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fb80cd810 0x7f3fb80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3fb80cdbf0 0x7f3fb806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb80d0550 con 0x7f3fb80cfe00 2024-04-26T23:26:18.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb80d0b10 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbf000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb806e970 con 0x7f3fb80cd810 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3fb80cdbf0 0x7f3fb806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3fb80cdbf0 0x7f3fb806ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59038/0 (socket says 172.21.15.39:59038) 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 -- 172.21.15.39:0/12554068 learned_addr learned my addr 172.21.15.39:0/12554068 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fb7e00640 1 --2- 172.21.15.39:0/12554068 >> v2:172.21.15.71:3300/0 conn(0x7f3fb80cd810 0x7f3fb80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 -- 172.21.15.39:0/12554068 >> v2:172.21.15.71:3300/0 conn(0x7f3fb80cd810 msgr2=0x7f3fb80742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 --2- 172.21.15.39:0/12554068 >> v2:172.21.15.71:3300/0 conn(0x7f3fb80cd810 0x7f3fb80742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 -- 172.21.15.39:0/12554068 >> v1:172.21.15.71:6789/0 conn(0x7f3fb80cfe00 legacy=0x7f3fb8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:18.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.633+0000 7f3fbd000640 1 -- 172.21.15.39:0/12554068 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb80d0830 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbd000640 1 --2- 172.21.15.39:0/12554068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cdbf0 0x7f3fb806ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1eb0 tx=0x7f3fb001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffac0d5ff297d624 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fb7400640 1 -- 172.21.15.39:0/12554068 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00b0070 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fb7400640 1 -- 172.21.15.39:0/12554068 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb00ab600 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fb7400640 1 -- 172.21.15.39:0/12554068 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00ab9d0 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 -- 172.21.15.39:0/12554068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cdbf0 msgr2=0x7f3fb806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 --2- 172.21.15.39:0/12554068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cdbf0 0x7f3fb806ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1eb0 tx=0x7f3fb001c390 comp rx=0 tx=0).stop 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 -- 172.21.15.39:0/12554068 shutdown_connections 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 --2- 172.21.15.39:0/12554068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cdbf0 0x7f3fb806ee00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 --2- 172.21.15.39:0/12554068 >> v2:172.21.15.71:3300/0 conn(0x7f3fb80cd810 0x7f3fb80742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 -- 172.21.15.39:0/12554068 >> 172.21.15.39:0/12554068 conn(0x7f3fb80b2af0 msgr2=0x7f3fb80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 -- 172.21.15.39:0/12554068 shutdown_connections 2024-04-26T23:26:18.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.637+0000 7f3fbf000640 1 -- 172.21.15.39:0/12554068 wait complete. 2024-04-26T23:26:18.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 Processor -- start 2024-04-26T23:26:18.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- start start 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3fb80cdbf0 0x7f3fb81428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fb80cfe00 0x7f3fb815f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb8143d30 con 0x7f3fb80cd810 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb8143bb0 con 0x7f3fb80cfe00 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb8169ef0 con 0x7f3fb80cdbf0 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59040/0 (socket says 172.21.15.39:59040) 2024-04-26T23:26:18.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 -- 172.21.15.39:0/1756580961 learned_addr learned my addr 172.21.15.39:0/1756580961 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbd000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fb80cfe00 0x7f3fb815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3faf400640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3fb80cdbf0 0x7f3fb81428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 -- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3fb80cdbf0 msgr2=0x7f3fb81428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3fb80cdbf0 0x7f3fb81428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 -- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fb80cfe00 msgr2=0x7f3fb815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fb80cfe00 0x7f3fb815f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 -- 172.21.15.39:0/1756580961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb815da40 con 0x7f3fb80cd810 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb7e00640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d830 tx=0x7f3fa800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800b6c0 con 0x7f3fb80cd810 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa8019070 con 0x7f3fb80cd810 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800ba60 con 0x7f3fb80cd810 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb815dd20 con 0x7f3fb80cd810 2024-04-26T23:26:18.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb80b5d10 con 0x7f3fb80cd810 2024-04-26T23:26:18.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.641+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb8050740 con 0x7f3fb80cd810 2024-04-26T23:26:18.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.645+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3fa801e460 con 0x7f3fb80cd810 2024-04-26T23:26:18.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.645+0000 7f3fb4c00640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 0x7f3f9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:18.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.645+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3fa8086ff0 con 0x7f3fb80cd810 2024-04-26T23:26:18.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.645+0000 7f3faf400640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 0x7f3f9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:18.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.645+0000 7f3faf400640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 0x7f3f9406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fb815d580 tx=0x7f3fa00094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:18.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.649+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3fa80575b0 con 0x7f3fb80cd810 2024-04-26T23:26:18.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.813+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fb80b2510 con 0x7f3f94068380 2024-04-26T23:26:18.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.821+0000 7f3fb4c00640 1 -- 172.21.15.39:0/1756580961 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f3fb80b2510 con 0x7f3f94068380 2024-04-26T23:26:18.826 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:18.830 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 msgr2=0x7f3f9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 0x7f3f9406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fb815d580 tx=0x7f3fa00094d0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 msgr2=0x7f3fb815e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d830 tx=0x7f3fa800dcf0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 shutdown_connections 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f94068380 0x7f3f9406a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fb80cfe00 0x7f3fb815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3fb80cdbf0 0x7f3fb81428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 --2- 172.21.15.39:0/1756580961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb80cd810 0x7f3fb815e800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:18.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 >> 172.21.15.39:0/1756580961 conn(0x7f3fb80b2af0 msgr2=0x7f3fb815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:18.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 shutdown_connections 2024-04-26T23:26:18.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:18.825+0000 7f3fbf000640 1 -- 172.21.15.39:0/1756580961 wait complete. 2024-04-26T23:26:18.849 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T23:26:17.657868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227344,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747376,"statfs":{"total":773094113280,"available":772861313024,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.962545"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736763+0000","last_change":"2024-04-26T23:26:14.750190+0000","last_active":"2024-04-26T23:26:15.736763+0000","last_peered":"2024-04-26T23:26:15.736763+0000","last_clean":"2024-04-26T23:26:15.736763+0000","last_became_active":"2024-04-26T23:26:14.749862+0000","last_became_peered":"2024-04-26T23:26:14.749862+0000","last_unstale":"2024-04-26T23:26:15.736763+0000","last_undegraded":"2024-04-26T23:26:15.736763+0000","last_fullsized":"2024-04-26T23:26:15.736763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723865+0000","last_change":"2024-04-26T23:26:14.724978+0000","last_active":"2024-04-26T23:26:15.723865+0000","last_peered":"2024-04-26T23:26:15.723865+0000","last_clean":"2024-04-26T23:26:15.723865+0000","last_became_active":"2024-04-26T23:26:14.724385+0000","last_became_peered":"2024-04-26T23:26:14.724385+0000","last_unstale":"2024-04-26T23:26:15.723865+0000","last_undegraded":"2024-04-26T23:26:15.723865+0000","last_fullsized":"2024-04-26T23:26:15.723865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736625+0000","last_change":"2024-04-26T23:26:14.724918+0000","last_active":"2024-04-26T23:26:15.736625+0000","last_peered":"2024-04-26T23:26:15.736625+0000","last_clean":"2024-04-26T23:26:15.736625+0000","last_became_active":"2024-04-26T23:26:14.724588+0000","last_became_peered":"2024-04-26T23:26:14.724588+0000","last_unstale":"2024-04-26T23:26:15.736625+0000","last_undegraded":"2024-04-26T23:26:15.736625+0000","last_fullsized":"2024-04-26T23:26:15.736625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725084+0000","last_change":"2024-04-26T23:26:14.723378+0000","last_active":"2024-04-26T23:26:15.725084+0000","last_peered":"2024-04-26T23:26:15.725084+0000","last_clean":"2024-04-26T23:26:15.725084+0000","last_became_active":"2024-04-26T23:26:14.722888+0000","last_became_peered":"2024-04-26T23:26:14.722888+0000","last_unstale":"2024-04-26T23:26:15.725084+0000","last_undegraded":"2024-04-26T23:26:15.725084+0000","last_fullsized":"2024-04-26T23:26:15.725084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736482+0000","last_change":"2024-04-26T23:26:14.733728+0000","last_active":"2024-04-26T23:26:15.736482+0000","last_peered":"2024-04-26T23:26:15.736482+0000","last_clean":"2024-04-26T23:26:15.736482+0000","last_became_active":"2024-04-26T23:26:14.733044+0000","last_became_peered":"2024-04-26T23:26:14.733044+0000","last_unstale":"2024-04-26T23:26:15.736482+0000","last_undegraded":"2024-04-26T23:26:15.736482+0000","last_fullsized":"2024-04-26T23:26:15.736482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725262+0000","last_change":"2024-04-26T23:26:14.724291+0000","last_active":"2024-04-26T23:26:15.725262+0000","last_peered":"2024-04-26T23:26:15.725262+0000","last_clean":"2024-04-26T23:26:15.725262+0000","last_became_active":"2024-04-26T23:26:14.724038+0000","last_became_peered":"2024-04-26T23:26:14.724038+0000","last_unstale":"2024-04-26T23:26:15.725262+0000","last_undegraded":"2024-04-26T23:26:15.725262+0000","last_fullsized":"2024-04-26T23:26:15.725262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736072+0000","last_change":"2024-04-26T23:26:14.728422+0000","last_active":"2024-04-26T23:26:15.736072+0000","last_peered":"2024-04-26T23:26:15.736072+0000","last_clean":"2024-04-26T23:26:15.736072+0000","last_became_active":"2024-04-26T23:26:14.728014+0000","last_became_peered":"2024-04-26T23:26:14.728014+0000","last_unstale":"2024-04-26T23:26:15.736072+0000","last_undegraded":"2024-04-26T23:26:15.736072+0000","last_fullsized":"2024-04-26T23:26:15.736072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735326+0000","last_change":"2024-04-26T23:26:14.720678+0000","last_active":"2024-04-26T23:26:15.735326+0000","last_peered":"2024-04-26T23:26:15.735326+0000","last_clean":"2024-04-26T23:26:15.735326+0000","last_became_active":"2024-04-26T23:26:14.720413+0000","last_became_peered":"2024-04-26T23:26:14.720413+0000","last_unstale":"2024-04-26T23:26:15.735326+0000","last_undegraded":"2024-04-26T23:26:15.735326+0000","last_fullsized":"2024-04-26T23:26:15.735326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736984+0000","last_change":"2024-04-26T23:26:14.746576+0000","last_active":"2024-04-26T23:26:15.736984+0000","last_peered":"2024-04-26T23:26:15.736984+0000","last_clean":"2024-04-26T23:26:15.736984+0000","last_became_active":"2024-04-26T23:26:14.745710+0000","last_became_peered":"2024-04-26T23:26:14.745710+0000","last_unstale":"2024-04-26T23:26:15.736984+0000","last_undegraded":"2024-04-26T23:26:15.736984+0000","last_fullsized":"2024-04-26T23:26:15.736984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:04.796305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735909+0000","last_change":"2024-04-26T23:26:14.736993+0000","last_active":"2024-04-26T23:26:15.735909+0000","last_peered":"2024-04-26T23:26:15.735909+0000","last_clean":"2024-04-26T23:26:15.735909+0000","last_became_active":"2024-04-26T23:26:14.736555+0000","last_became_peered":"2024-04-26T23:26:14.736555+0000","last_unstale":"2024-04-26T23:26:15.735909+0000","last_undegraded":"2024-04-26T23:26:15.735909+0000","last_fullsized":"2024-04-26T23:26:15.735909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735781+0000","last_change":"2024-04-26T23:26:14.738192+0000","last_active":"2024-04-26T23:26:15.735781+0000","last_peered":"2024-04-26T23:26:15.735781+0000","last_clean":"2024-04-26T23:26:15.735781+0000","last_became_active":"2024-04-26T23:26:14.735778+0000","last_became_peered":"2024-04-26T23:26:14.735778+0000","last_unstale":"2024-04-26T23:26:15.735781+0000","last_undegraded":"2024-04-26T23:26:15.735781+0000","last_fullsized":"2024-04-26T23:26:15.735781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723687+0000","last_change":"2024-04-26T23:26:14.746898+0000","last_active":"2024-04-26T23:26:15.723687+0000","last_peered":"2024-04-26T23:26:15.723687+0000","last_clean":"2024-04-26T23:26:15.723687+0000","last_became_active":"2024-04-26T23:26:14.743251+0000","last_became_peered":"2024-04-26T23:26:14.743251+0000","last_unstale":"2024-04-26T23:26:15.723687+0000","last_undegraded":"2024-04-26T23:26:15.723687+0000","last_fullsized":"2024-04-26T23:26:15.723687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:20.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737227+0000","last_change":"2024-04-26T23:26:14.740463+0000","last_active":"2024-04-26T23:26:15.737227+0000","last_peered":"2024-04-26T23:26:15.737227+0000","last_clean":"2024-04-26T23:26:15.737227+0000","last_became_active":"2024-04-26T23:26:14.740150+0000","last_became_peered":"2024-04-26T23:26:14.740150+0000","last_unstale":"2024-04-26T23:26:15.737227+0000","last_undegraded":"2024-04-26T23:26:15.737227+0000","last_fullsized":"2024-04-26T23:26:15.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736130+0000","last_change":"2024-04-26T23:26:14.728712+0000","last_active":"2024-04-26T23:26:15.736130+0000","last_peered":"2024-04-26T23:26:15.736130+0000","last_clean":"2024-04-26T23:26:15.736130+0000","last_became_active":"2024-04-26T23:26:14.728390+0000","last_became_peered":"2024-04-26T23:26:14.728390+0000","last_unstale":"2024-04-26T23:26:15.736130+0000","last_undegraded":"2024-04-26T23:26:15.736130+0000","last_fullsized":"2024-04-26T23:26:15.736130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:50.776227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723349+0000","last_change":"2024-04-26T23:26:14.739193+0000","last_active":"2024-04-26T23:26:15.723349+0000","last_peered":"2024-04-26T23:26:15.723349+0000","last_clean":"2024-04-26T23:26:15.723349+0000","last_became_active":"2024-04-26T23:26:14.739006+0000","last_became_peered":"2024-04-26T23:26:14.739006+0000","last_unstale":"2024-04-26T23:26:15.723349+0000","last_undegraded":"2024-04-26T23:26:15.723349+0000","last_fullsized":"2024-04-26T23:26:15.723349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723007+0000","last_change":"2024-04-26T23:26:14.732502+0000","last_active":"2024-04-26T23:26:15.723007+0000","last_peered":"2024-04-26T23:26:15.723007+0000","last_clean":"2024-04-26T23:26:15.723007+0000","last_became_active":"2024-04-26T23:26:14.732194+0000","last_became_peered":"2024-04-26T23:26:14.732194+0000","last_unstale":"2024-04-26T23:26:15.723007+0000","last_undegraded":"2024-04-26T23:26:15.723007+0000","last_fullsized":"2024-04-26T23:26:15.723007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724541+0000","last_change":"2024-04-26T23:26:14.742132+0000","last_active":"2024-04-26T23:26:15.724541+0000","last_peered":"2024-04-26T23:26:15.724541+0000","last_clean":"2024-04-26T23:26:15.724541+0000","last_became_active":"2024-04-26T23:26:14.741783+0000","last_became_peered":"2024-04-26T23:26:14.741783+0000","last_unstale":"2024-04-26T23:26:15.724541+0000","last_undegraded":"2024-04-26T23:26:15.724541+0000","last_fullsized":"2024-04-26T23:26:15.724541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:14.735635+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:14.735055+0000","last_became_peered":"2024-04-26T23:26:14.735055+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736912+0000","last_change":"2024-04-26T23:26:14.732726+0000","last_active":"2024-04-26T23:26:15.736912+0000","last_peered":"2024-04-26T23:26:15.736912+0000","last_clean":"2024-04-26T23:26:15.736912+0000","last_became_active":"2024-04-26T23:26:14.732453+0000","last_became_peered":"2024-04-26T23:26:14.732453+0000","last_unstale":"2024-04-26T23:26:15.736912+0000","last_undegraded":"2024-04-26T23:26:15.736912+0000","last_fullsized":"2024-04-26T23:26:15.736912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:26.906820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735761+0000","last_change":"2024-04-26T23:26:14.739109+0000","last_active":"2024-04-26T23:26:15.735761+0000","last_peered":"2024-04-26T23:26:15.735761+0000","last_clean":"2024-04-26T23:26:15.735761+0000","last_became_active":"2024-04-26T23:26:14.738756+0000","last_became_peered":"2024-04-26T23:26:14.738756+0000","last_unstale":"2024-04-26T23:26:15.735761+0000","last_undegraded":"2024-04-26T23:26:15.735761+0000","last_fullsized":"2024-04-26T23:26:15.735761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736250+0000","last_change":"2024-04-26T23:26:14.743573+0000","last_active":"2024-04-26T23:26:15.736250+0000","last_peered":"2024-04-26T23:26:15.736250+0000","last_clean":"2024-04-26T23:26:15.736250+0000","last_became_active":"2024-04-26T23:26:14.743307+0000","last_became_peered":"2024-04-26T23:26:14.743307+0000","last_unstale":"2024-04-26T23:26:15.736250+0000","last_undegraded":"2024-04-26T23:26:15.736250+0000","last_fullsized":"2024-04-26T23:26:15.736250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724521+0000","last_change":"2024-04-26T23:26:14.735001+0000","last_active":"2024-04-26T23:26:15.724521+0000","last_peered":"2024-04-26T23:26:15.724521+0000","last_clean":"2024-04-26T23:26:15.724521+0000","last_became_active":"2024-04-26T23:26:14.734736+0000","last_became_peered":"2024-04-26T23:26:14.734736+0000","last_unstale":"2024-04-26T23:26:15.724521+0000","last_undegraded":"2024-04-26T23:26:15.724521+0000","last_fullsized":"2024-04-26T23:26:15.724521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735364+0000","last_change":"2024-04-26T23:26:14.740226+0000","last_active":"2024-04-26T23:26:15.735364+0000","last_peered":"2024-04-26T23:26:15.735364+0000","last_clean":"2024-04-26T23:26:15.735364+0000","last_became_active":"2024-04-26T23:26:14.739943+0000","last_became_peered":"2024-04-26T23:26:14.739943+0000","last_unstale":"2024-04-26T23:26:15.735364+0000","last_undegraded":"2024-04-26T23:26:15.735364+0000","last_fullsized":"2024-04-26T23:26:15.735364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723048+0000","last_change":"2024-04-26T23:26:14.724087+0000","last_active":"2024-04-26T23:26:15.723048+0000","last_peered":"2024-04-26T23:26:15.723048+0000","last_clean":"2024-04-26T23:26:15.723048+0000","last_became_active":"2024-04-26T23:26:14.723715+0000","last_became_peered":"2024-04-26T23:26:14.723715+0000","last_unstale":"2024-04-26T23:26:15.723048+0000","last_undegraded":"2024-04-26T23:26:15.723048+0000","last_fullsized":"2024-04-26T23:26:15.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737556+0000","last_change":"2024-04-26T23:26:14.736545+0000","last_active":"2024-04-26T23:26:15.737556+0000","last_peered":"2024-04-26T23:26:15.737556+0000","last_clean":"2024-04-26T23:26:15.737556+0000","last_became_active":"2024-04-26T23:26:14.736290+0000","last_became_peered":"2024-04-26T23:26:14.736290+0000","last_unstale":"2024-04-26T23:26:15.737556+0000","last_undegraded":"2024-04-26T23:26:15.737556+0000","last_fullsized":"2024-04-26T23:26:15.737556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736017+0000","last_change":"2024-04-26T23:26:14.748640+0000","last_active":"2024-04-26T23:26:15.736017+0000","last_peered":"2024-04-26T23:26:15.736017+0000","last_clean":"2024-04-26T23:26:15.736017+0000","last_became_active":"2024-04-26T23:26:14.747387+0000","last_became_peered":"2024-04-26T23:26:14.747387+0000","last_unstale":"2024-04-26T23:26:15.736017+0000","last_undegraded":"2024-04-26T23:26:15.736017+0000","last_fullsized":"2024-04-26T23:26:15.736017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723738+0000","last_change":"2024-04-26T23:26:14.737597+0000","last_active":"2024-04-26T23:26:15.723738+0000","last_peered":"2024-04-26T23:26:15.723738+0000","last_clean":"2024-04-26T23:26:15.723738+0000","last_became_active":"2024-04-26T23:26:14.735590+0000","last_became_peered":"2024-04-26T23:26:14.735590+0000","last_unstale":"2024-04-26T23:26:15.723738+0000","last_undegraded":"2024-04-26T23:26:15.723738+0000","last_fullsized":"2024-04-26T23:26:15.723738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737377+0000","last_change":"2024-04-26T23:26:14.736063+0000","last_active":"2024-04-26T23:26:15.737377+0000","last_peered":"2024-04-26T23:26:15.737377+0000","last_clean":"2024-04-26T23:26:15.737377+0000","last_became_active":"2024-04-26T23:26:14.735857+0000","last_became_peered":"2024-04-26T23:26:14.735857+0000","last_unstale":"2024-04-26T23:26:15.737377+0000","last_undegraded":"2024-04-26T23:26:15.737377+0000","last_fullsized":"2024-04-26T23:26:15.737377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736401+0000","last_change":"2024-04-26T23:26:14.723733+0000","last_active":"2024-04-26T23:26:15.736401+0000","last_peered":"2024-04-26T23:26:15.736401+0000","last_clean":"2024-04-26T23:26:15.736401+0000","last_became_active":"2024-04-26T23:26:14.723459+0000","last_became_peered":"2024-04-26T23:26:14.723459+0000","last_unstale":"2024-04-26T23:26:15.736401+0000","last_undegraded":"2024-04-26T23:26:15.736401+0000","last_fullsized":"2024-04-26T23:26:15.736401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724727+0000","last_change":"2024-04-26T23:26:14.722556+0000","last_active":"2024-04-26T23:26:15.724727+0000","last_peered":"2024-04-26T23:26:15.724727+0000","last_clean":"2024-04-26T23:26:15.724727+0000","last_became_active":"2024-04-26T23:26:14.722259+0000","last_became_peered":"2024-04-26T23:26:14.722259+0000","last_unstale":"2024-04-26T23:26:15.724727+0000","last_undegraded":"2024-04-26T23:26:15.724727+0000","last_fullsized":"2024-04-26T23:26:15.724727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735569+0000","last_change":"2024-04-26T23:26:14.732537+0000","last_active":"2024-04-26T23:26:15.735569+0000","last_peered":"2024-04-26T23:26:15.735569+0000","last_clean":"2024-04-26T23:26:15.735569+0000","last_became_active":"2024-04-26T23:26:14.732051+0000","last_became_peered":"2024-04-26T23:26:14.732051+0000","last_unstale":"2024-04-26T23:26:15.735569+0000","last_undegraded":"2024-04-26T23:26:15.735569+0000","last_fullsized":"2024-04-26T23:26:15.735569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735547+0000","last_change":"2024-04-26T23:26:14.731655+0000","last_active":"2024-04-26T23:26:15.735547+0000","last_peered":"2024-04-26T23:26:15.735547+0000","last_clean":"2024-04-26T23:26:15.735547+0000","last_became_active":"2024-04-26T23:26:14.731379+0000","last_became_peered":"2024-04-26T23:26:14.731379+0000","last_unstale":"2024-04-26T23:26:15.735547+0000","last_undegraded":"2024-04-26T23:26:15.735547+0000","last_fullsized":"2024-04-26T23:26:15.735547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723549+0000","last_change":"2024-04-26T23:26:14.733290+0000","last_active":"2024-04-26T23:26:15.723549+0000","last_peered":"2024-04-26T23:26:15.723549+0000","last_clean":"2024-04-26T23:26:15.723549+0000","last_became_active":"2024-04-26T23:26:14.732863+0000","last_became_peered":"2024-04-26T23:26:14.732863+0000","last_unstale":"2024-04-26T23:26:15.723549+0000","last_undegraded":"2024-04-26T23:26:15.723549+0000","last_fullsized":"2024-04-26T23:26:15.723549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:36.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737262+0000","last_change":"2024-04-26T23:26:13.724097+0000","last_active":"2024-04-26T23:26:15.737262+0000","last_peered":"2024-04-26T23:26:15.737262+0000","last_clean":"2024-04-26T23:26:15.737262+0000","last_became_active":"2024-04-26T23:26:13.723161+0000","last_became_peered":"2024-04-26T23:26:13.723161+0000","last_unstale":"2024-04-26T23:26:15.737262+0000","last_undegraded":"2024-04-26T23:26:15.737262+0000","last_fullsized":"2024-04-26T23:26:15.737262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736414+0000","last_change":"2024-04-26T23:26:14.727155+0000","last_active":"2024-04-26T23:26:15.736414+0000","last_peered":"2024-04-26T23:26:15.736414+0000","last_clean":"2024-04-26T23:26:15.736414+0000","last_became_active":"2024-04-26T23:26:14.726867+0000","last_became_peered":"2024-04-26T23:26:14.726867+0000","last_unstale":"2024-04-26T23:26:15.736414+0000","last_undegraded":"2024-04-26T23:26:15.736414+0000","last_fullsized":"2024-04-26T23:26:15.736414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735577+0000","last_change":"2024-04-26T23:26:13.729977+0000","last_active":"2024-04-26T23:26:15.735577+0000","last_peered":"2024-04-26T23:26:15.735577+0000","last_clean":"2024-04-26T23:26:15.735577+0000","last_became_active":"2024-04-26T23:26:13.728795+0000","last_became_peered":"2024-04-26T23:26:13.728795+0000","last_unstale":"2024-04-26T23:26:15.735577+0000","last_undegraded":"2024-04-26T23:26:15.735577+0000","last_fullsized":"2024-04-26T23:26:15.735577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736357+0000","last_change":"2024-04-26T23:26:13.730567+0000","last_active":"2024-04-26T23:26:15.736357+0000","last_peered":"2024-04-26T23:26:15.736357+0000","last_clean":"2024-04-26T23:26:15.736357+0000","last_became_active":"2024-04-26T23:26:13.730321+0000","last_became_peered":"2024-04-26T23:26:13.730321+0000","last_unstale":"2024-04-26T23:26:15.736357+0000","last_undegraded":"2024-04-26T23:26:15.736357+0000","last_fullsized":"2024-04-26T23:26:15.736357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735371+0000","last_change":"2024-04-26T23:26:14.733324+0000","last_active":"2024-04-26T23:26:15.735371+0000","last_peered":"2024-04-26T23:26:15.735371+0000","last_clean":"2024-04-26T23:26:15.735371+0000","last_became_active":"2024-04-26T23:26:14.733059+0000","last_became_peered":"2024-04-26T23:26:14.733059+0000","last_unstale":"2024-04-26T23:26:15.735371+0000","last_undegraded":"2024-04-26T23:26:15.735371+0000","last_fullsized":"2024-04-26T23:26:15.735371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723137+0000","last_change":"2024-04-26T23:26:13.714305+0000","last_active":"2024-04-26T23:26:15.723137+0000","last_peered":"2024-04-26T23:26:15.723137+0000","last_clean":"2024-04-26T23:26:15.723137+0000","last_became_active":"2024-04-26T23:26:13.713944+0000","last_became_peered":"2024-04-26T23:26:13.713944+0000","last_unstale":"2024-04-26T23:26:15.723137+0000","last_undegraded":"2024-04-26T23:26:15.723137+0000","last_fullsized":"2024-04-26T23:26:15.723137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:14.729913+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:14.729650+0000","last_became_peered":"2024-04-26T23:26:14.729650+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735790+0000","last_change":"2024-04-26T23:26:13.735343+0000","last_active":"2024-04-26T23:26:15.735790+0000","last_peered":"2024-04-26T23:26:15.735790+0000","last_clean":"2024-04-26T23:26:15.735790+0000","last_became_active":"2024-04-26T23:26:13.734994+0000","last_became_peered":"2024-04-26T23:26:13.734994+0000","last_unstale":"2024-04-26T23:26:15.735790+0000","last_undegraded":"2024-04-26T23:26:15.735790+0000","last_fullsized":"2024-04-26T23:26:15.735790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724315+0000","last_change":"2024-04-26T23:26:14.742311+0000","last_active":"2024-04-26T23:26:15.724315+0000","last_peered":"2024-04-26T23:26:15.724315+0000","last_clean":"2024-04-26T23:26:15.724315+0000","last_became_active":"2024-04-26T23:26:14.742033+0000","last_became_peered":"2024-04-26T23:26:14.742033+0000","last_unstale":"2024-04-26T23:26:15.724315+0000","last_undegraded":"2024-04-26T23:26:15.724315+0000","last_fullsized":"2024-04-26T23:26:15.724315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724308+0000","last_change":"2024-04-26T23:26:13.733199+0000","last_active":"2024-04-26T23:26:15.724308+0000","last_peered":"2024-04-26T23:26:15.724308+0000","last_clean":"2024-04-26T23:26:15.724308+0000","last_became_active":"2024-04-26T23:26:13.732940+0000","last_became_peered":"2024-04-26T23:26:13.732940+0000","last_unstale":"2024-04-26T23:26:15.724308+0000","last_undegraded":"2024-04-26T23:26:15.724308+0000","last_fullsized":"2024-04-26T23:26:15.724308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736800+0000","last_change":"2024-04-26T23:26:14.729724+0000","last_active":"2024-04-26T23:26:15.736800+0000","last_peered":"2024-04-26T23:26:15.736800+0000","last_clean":"2024-04-26T23:26:15.736800+0000","last_became_active":"2024-04-26T23:26:14.729430+0000","last_became_peered":"2024-04-26T23:26:14.729430+0000","last_unstale":"2024-04-26T23:26:15.736800+0000","last_undegraded":"2024-04-26T23:26:15.736800+0000","last_fullsized":"2024-04-26T23:26:15.736800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723725+0000","last_change":"2024-04-26T23:26:13.724763+0000","last_active":"2024-04-26T23:26:15.723725+0000","last_peered":"2024-04-26T23:26:15.723725+0000","last_clean":"2024-04-26T23:26:15.723725+0000","last_became_active":"2024-04-26T23:26:13.724483+0000","last_became_peered":"2024-04-26T23:26:13.724483+0000","last_unstale":"2024-04-26T23:26:15.723725+0000","last_undegraded":"2024-04-26T23:26:15.723725+0000","last_fullsized":"2024-04-26T23:26:15.723725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723791+0000","last_change":"2024-04-26T23:26:14.733025+0000","last_active":"2024-04-26T23:26:15.723791+0000","last_peered":"2024-04-26T23:26:15.723791+0000","last_clean":"2024-04-26T23:26:15.723791+0000","last_became_active":"2024-04-26T23:26:14.732739+0000","last_became_peered":"2024-04-26T23:26:14.732739+0000","last_unstale":"2024-04-26T23:26:15.723791+0000","last_undegraded":"2024-04-26T23:26:15.723791+0000","last_fullsized":"2024-04-26T23:26:15.723791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735689+0000","last_change":"2024-04-26T23:26:13.729905+0000","last_active":"2024-04-26T23:26:15.735689+0000","last_peered":"2024-04-26T23:26:15.735689+0000","last_clean":"2024-04-26T23:26:15.735689+0000","last_became_active":"2024-04-26T23:26:13.729641+0000","last_became_peered":"2024-04-26T23:26:13.729641+0000","last_unstale":"2024-04-26T23:26:15.735689+0000","last_undegraded":"2024-04-26T23:26:15.735689+0000","last_fullsized":"2024-04-26T23:26:15.735689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736765+0000","last_change":"2024-04-26T23:26:14.744333+0000","last_active":"2024-04-26T23:26:15.736765+0000","last_peered":"2024-04-26T23:26:15.736765+0000","last_clean":"2024-04-26T23:26:15.736765+0000","last_became_active":"2024-04-26T23:26:14.741477+0000","last_became_peered":"2024-04-26T23:26:14.741477+0000","last_unstale":"2024-04-26T23:26:15.736765+0000","last_undegraded":"2024-04-26T23:26:15.736765+0000","last_fullsized":"2024-04-26T23:26:15.736765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736523+0000","last_change":"2024-04-26T23:26:13.724495+0000","last_active":"2024-04-26T23:26:15.736523+0000","last_peered":"2024-04-26T23:26:15.736523+0000","last_clean":"2024-04-26T23:26:15.736523+0000","last_became_active":"2024-04-26T23:26:13.722127+0000","last_became_peered":"2024-04-26T23:26:13.722127+0000","last_unstale":"2024-04-26T23:26:15.736523+0000","last_undegraded":"2024-04-26T23:26:15.736523+0000","last_fullsized":"2024-04-26T23:26:15.736523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736199+0000","last_change":"2024-04-26T23:26:14.730136+0000","last_active":"2024-04-26T23:26:15.736199+0000","last_peered":"2024-04-26T23:26:15.736199+0000","last_clean":"2024-04-26T23:26:15.736199+0000","last_became_active":"2024-04-26T23:26:14.729903+0000","last_became_peered":"2024-04-26T23:26:14.729903+0000","last_unstale":"2024-04-26T23:26:15.736199+0000","last_undegraded":"2024-04-26T23:26:15.736199+0000","last_fullsized":"2024-04-26T23:26:15.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724823+0000","last_change":"2024-04-26T23:26:13.730110+0000","last_active":"2024-04-26T23:26:15.724823+0000","last_peered":"2024-04-26T23:26:15.724823+0000","last_clean":"2024-04-26T23:26:15.724823+0000","last_became_active":"2024-04-26T23:26:13.729806+0000","last_became_peered":"2024-04-26T23:26:13.729806+0000","last_unstale":"2024-04-26T23:26:15.724823+0000","last_undegraded":"2024-04-26T23:26:15.724823+0000","last_fullsized":"2024-04-26T23:26:15.724823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736577+0000","last_change":"2024-04-26T23:26:14.739556+0000","last_active":"2024-04-26T23:26:15.736577+0000","last_peered":"2024-04-26T23:26:15.736577+0000","last_clean":"2024-04-26T23:26:15.736577+0000","last_became_active":"2024-04-26T23:26:14.739201+0000","last_became_peered":"2024-04-26T23:26:14.739201+0000","last_unstale":"2024-04-26T23:26:15.736577+0000","last_undegraded":"2024-04-26T23:26:15.736577+0000","last_fullsized":"2024-04-26T23:26:15.736577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735986+0000","last_change":"2024-04-26T23:26:13.736521+0000","last_active":"2024-04-26T23:26:15.735986+0000","last_peered":"2024-04-26T23:26:15.735986+0000","last_clean":"2024-04-26T23:26:15.735986+0000","last_became_active":"2024-04-26T23:26:13.736233+0000","last_became_peered":"2024-04-26T23:26:13.736233+0000","last_unstale":"2024-04-26T23:26:15.735986+0000","last_undegraded":"2024-04-26T23:26:15.735986+0000","last_fullsized":"2024-04-26T23:26:15.735986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735936+0000","last_change":"2024-04-26T23:26:14.731078+0000","last_active":"2024-04-26T23:26:15.735936+0000","last_peered":"2024-04-26T23:26:15.735936+0000","last_clean":"2024-04-26T23:26:15.735936+0000","last_became_active":"2024-04-26T23:26:14.730526+0000","last_became_peered":"2024-04-26T23:26:14.730526+0000","last_unstale":"2024-04-26T23:26:15.735936+0000","last_undegraded":"2024-04-26T23:26:15.735936+0000","last_fullsized":"2024-04-26T23:26:15.735936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735491+0000","last_change":"2024-04-26T23:26:13.720259+0000","last_active":"2024-04-26T23:26:15.735491+0000","last_peered":"2024-04-26T23:26:15.735491+0000","last_clean":"2024-04-26T23:26:15.735491+0000","last_became_active":"2024-04-26T23:26:13.719993+0000","last_became_peered":"2024-04-26T23:26:13.719993+0000","last_unstale":"2024-04-26T23:26:15.735491+0000","last_undegraded":"2024-04-26T23:26:15.735491+0000","last_fullsized":"2024-04-26T23:26:15.735491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736174+0000","last_change":"2024-04-26T23:26:14.744189+0000","last_active":"2024-04-26T23:26:15.736174+0000","last_peered":"2024-04-26T23:26:15.736174+0000","last_clean":"2024-04-26T23:26:15.736174+0000","last_became_active":"2024-04-26T23:26:14.742691+0000","last_became_peered":"2024-04-26T23:26:14.742691+0000","last_unstale":"2024-04-26T23:26:15.736174+0000","last_undegraded":"2024-04-26T23:26:15.736174+0000","last_fullsized":"2024-04-26T23:26:15.736174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725515+0000","last_change":"2024-04-26T23:26:13.722716+0000","last_active":"2024-04-26T23:26:15.725515+0000","last_peered":"2024-04-26T23:26:15.725515+0000","last_clean":"2024-04-26T23:26:15.725515+0000","last_became_active":"2024-04-26T23:26:13.722282+0000","last_became_peered":"2024-04-26T23:26:13.722282+0000","last_unstale":"2024-04-26T23:26:15.725515+0000","last_undegraded":"2024-04-26T23:26:15.725515+0000","last_fullsized":"2024-04-26T23:26:15.725515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:03.302571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736807+0000","last_change":"2024-04-26T23:26:14.745739+0000","last_active":"2024-04-26T23:26:15.736807+0000","last_peered":"2024-04-26T23:26:15.736807+0000","last_clean":"2024-04-26T23:26:15.736807+0000","last_became_active":"2024-04-26T23:26:14.745393+0000","last_became_peered":"2024-04-26T23:26:14.745393+0000","last_unstale":"2024-04-26T23:26:15.736807+0000","last_undegraded":"2024-04-26T23:26:15.736807+0000","last_fullsized":"2024-04-26T23:26:15.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736102+0000","last_change":"2024-04-26T23:26:13.720970+0000","last_active":"2024-04-26T23:26:15.736102+0000","last_peered":"2024-04-26T23:26:15.736102+0000","last_clean":"2024-04-26T23:26:15.736102+0000","last_became_active":"2024-04-26T23:26:13.720659+0000","last_became_peered":"2024-04-26T23:26:13.720659+0000","last_unstale":"2024-04-26T23:26:15.736102+0000","last_undegraded":"2024-04-26T23:26:15.736102+0000","last_fullsized":"2024-04-26T23:26:15.736102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736992+0000","last_change":"2024-04-26T23:26:14.746831+0000","last_active":"2024-04-26T23:26:15.736992+0000","last_peered":"2024-04-26T23:26:15.736992+0000","last_clean":"2024-04-26T23:26:15.736992+0000","last_became_active":"2024-04-26T23:26:14.746189+0000","last_became_peered":"2024-04-26T23:26:14.746189+0000","last_unstale":"2024-04-26T23:26:15.736992+0000","last_undegraded":"2024-04-26T23:26:15.736992+0000","last_fullsized":"2024-04-26T23:26:15.736992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:58.384739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723835+0000","last_change":"2024-04-26T23:26:13.716047+0000","last_active":"2024-04-26T23:26:15.723835+0000","last_peered":"2024-04-26T23:26:15.723835+0000","last_clean":"2024-04-26T23:26:15.723835+0000","last_became_active":"2024-04-26T23:26:13.715774+0000","last_became_peered":"2024-04-26T23:26:13.715774+0000","last_unstale":"2024-04-26T23:26:15.723835+0000","last_undegraded":"2024-04-26T23:26:15.723835+0000","last_fullsized":"2024-04-26T23:26:15.723835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725303+0000","last_change":"2024-04-26T23:26:14.723161+0000","last_active":"2024-04-26T23:26:15.725303+0000","last_peered":"2024-04-26T23:26:15.725303+0000","last_clean":"2024-04-26T23:26:15.725303+0000","last_became_active":"2024-04-26T23:26:14.722467+0000","last_became_peered":"2024-04-26T23:26:14.722467+0000","last_unstale":"2024-04-26T23:26:15.725303+0000","last_undegraded":"2024-04-26T23:26:15.725303+0000","last_fullsized":"2024-04-26T23:26:15.725303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735933+0000","last_change":"2024-04-26T23:26:13.723125+0000","last_active":"2024-04-26T23:26:15.735933+0000","last_peered":"2024-04-26T23:26:15.735933+0000","last_clean":"2024-04-26T23:26:15.735933+0000","last_became_active":"2024-04-26T23:26:13.722807+0000","last_became_peered":"2024-04-26T23:26:13.722807+0000","last_unstale":"2024-04-26T23:26:15.735933+0000","last_undegraded":"2024-04-26T23:26:15.735933+0000","last_fullsized":"2024-04-26T23:26:15.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736740+0000","last_change":"2024-04-26T23:26:14.736690+0000","last_active":"2024-04-26T23:26:15.736740+0000","last_peered":"2024-04-26T23:26:15.736740+0000","last_clean":"2024-04-26T23:26:15.736740+0000","last_became_active":"2024-04-26T23:26:14.736316+0000","last_became_peered":"2024-04-26T23:26:14.736316+0000","last_unstale":"2024-04-26T23:26:15.736740+0000","last_undegraded":"2024-04-26T23:26:15.736740+0000","last_fullsized":"2024-04-26T23:26:15.736740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736227+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:26:15.736227+0000","last_peered":"2024-04-26T23:26:15.736227+0000","last_clean":"2024-04-26T23:26:15.736227+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:26:15.736227+0000","last_undegraded":"2024-04-26T23:26:15.736227+0000","last_fullsized":"2024-04-26T23:26:15.736227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723256+0000","last_change":"2024-04-26T23:26:13.722340+0000","last_active":"2024-04-26T23:26:15.723256+0000","last_peered":"2024-04-26T23:26:15.723256+0000","last_clean":"2024-04-26T23:26:15.723256+0000","last_became_active":"2024-04-26T23:26:13.721645+0000","last_became_peered":"2024-04-26T23:26:13.721645+0000","last_unstale":"2024-04-26T23:26:15.723256+0000","last_undegraded":"2024-04-26T23:26:15.723256+0000","last_fullsized":"2024-04-26T23:26:15.723256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736573+0000","last_change":"2024-04-26T23:26:14.733211+0000","last_active":"2024-04-26T23:26:15.736573+0000","last_peered":"2024-04-26T23:26:15.736573+0000","last_clean":"2024-04-26T23:26:15.736573+0000","last_became_active":"2024-04-26T23:26:14.732931+0000","last_became_peered":"2024-04-26T23:26:14.732931+0000","last_unstale":"2024-04-26T23:26:15.736573+0000","last_undegraded":"2024-04-26T23:26:15.736573+0000","last_fullsized":"2024-04-26T23:26:15.736573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:13.726362+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:13.725944+0000","last_became_peered":"2024-04-26T23:26:13.725944+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735941+0000","last_change":"2024-04-26T23:26:14.715493+0000","last_active":"2024-04-26T23:26:15.735941+0000","last_peered":"2024-04-26T23:26:15.735941+0000","last_clean":"2024-04-26T23:26:15.735941+0000","last_became_active":"2024-04-26T23:26:14.715120+0000","last_became_peered":"2024-04-26T23:26:14.715120+0000","last_unstale":"2024-04-26T23:26:15.735941+0000","last_undegraded":"2024-04-26T23:26:15.735941+0000","last_fullsized":"2024-04-26T23:26:15.735941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:14.575559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735840+0000","last_change":"2024-04-26T23:26:13.718666+0000","last_active":"2024-04-26T23:26:15.735840+0000","last_peered":"2024-04-26T23:26:15.735840+0000","last_clean":"2024-04-26T23:26:15.735840+0000","last_became_active":"2024-04-26T23:26:13.718352+0000","last_became_peered":"2024-04-26T23:26:13.718352+0000","last_unstale":"2024-04-26T23:26:15.735840+0000","last_undegraded":"2024-04-26T23:26:15.735840+0000","last_fullsized":"2024-04-26T23:26:15.735840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723353+0000","last_change":"2024-04-26T23:26:14.731553+0000","last_active":"2024-04-26T23:26:15.723353+0000","last_peered":"2024-04-26T23:26:15.723353+0000","last_clean":"2024-04-26T23:26:15.723353+0000","last_became_active":"2024-04-26T23:26:14.730918+0000","last_became_peered":"2024-04-26T23:26:14.730918+0000","last_unstale":"2024-04-26T23:26:15.723353+0000","last_undegraded":"2024-04-26T23:26:15.723353+0000","last_fullsized":"2024-04-26T23:26:15.723353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724912+0000","last_change":"2024-04-26T23:26:13.727250+0000","last_active":"2024-04-26T23:26:15.724912+0000","last_peered":"2024-04-26T23:26:15.724912+0000","last_clean":"2024-04-26T23:26:15.724912+0000","last_became_active":"2024-04-26T23:26:13.726714+0000","last_became_peered":"2024-04-26T23:26:13.726714+0000","last_unstale":"2024-04-26T23:26:15.724912+0000","last_undegraded":"2024-04-26T23:26:15.724912+0000","last_fullsized":"2024-04-26T23:26:15.724912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724072+0000","last_change":"2024-04-26T23:26:14.730947+0000","last_active":"2024-04-26T23:26:15.724072+0000","last_peered":"2024-04-26T23:26:15.724072+0000","last_clean":"2024-04-26T23:26:15.724072+0000","last_became_active":"2024-04-26T23:26:14.730626+0000","last_became_peered":"2024-04-26T23:26:14.730626+0000","last_unstale":"2024-04-26T23:26:15.724072+0000","last_undegraded":"2024-04-26T23:26:15.724072+0000","last_fullsized":"2024-04-26T23:26:15.724072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723662+0000","last_change":"2024-04-26T23:26:13.723935+0000","last_active":"2024-04-26T23:26:15.723662+0000","last_peered":"2024-04-26T23:26:15.723662+0000","last_clean":"2024-04-26T23:26:15.723662+0000","last_became_active":"2024-04-26T23:26:13.723536+0000","last_became_peered":"2024-04-26T23:26:13.723536+0000","last_unstale":"2024-04-26T23:26:15.723662+0000","last_undegraded":"2024-04-26T23:26:15.723662+0000","last_fullsized":"2024-04-26T23:26:15.723662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723671+0000","last_change":"2024-04-26T23:26:14.725964+0000","last_active":"2024-04-26T23:26:15.723671+0000","last_peered":"2024-04-26T23:26:15.723671+0000","last_clean":"2024-04-26T23:26:15.723671+0000","last_became_active":"2024-04-26T23:26:14.724935+0000","last_became_peered":"2024-04-26T23:26:14.724935+0000","last_unstale":"2024-04-26T23:26:15.723671+0000","last_undegraded":"2024-04-26T23:26:15.723671+0000","last_fullsized":"2024-04-26T23:26:15.723671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736960+0000","last_change":"2024-04-26T23:26:13.728354+0000","last_active":"2024-04-26T23:26:15.736960+0000","last_peered":"2024-04-26T23:26:15.736960+0000","last_clean":"2024-04-26T23:26:15.736960+0000","last_became_active":"2024-04-26T23:26:13.727416+0000","last_became_peered":"2024-04-26T23:26:13.727416+0000","last_unstale":"2024-04-26T23:26:15.736960+0000","last_undegraded":"2024-04-26T23:26:15.736960+0000","last_fullsized":"2024-04-26T23:26:15.736960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:22.327383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723520+0000","last_change":"2024-04-26T23:26:14.728202+0000","last_active":"2024-04-26T23:26:15.723520+0000","last_peered":"2024-04-26T23:26:15.723520+0000","last_clean":"2024-04-26T23:26:15.723520+0000","last_became_active":"2024-04-26T23:26:14.725745+0000","last_became_peered":"2024-04-26T23:26:14.725745+0000","last_unstale":"2024-04-26T23:26:15.723520+0000","last_undegraded":"2024-04-26T23:26:15.723520+0000","last_fullsized":"2024-04-26T23:26:15.723520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723857+0000","last_change":"2024-04-26T23:26:13.734188+0000","last_active":"2024-04-26T23:26:15.723857+0000","last_peered":"2024-04-26T23:26:15.723857+0000","last_clean":"2024-04-26T23:26:15.723857+0000","last_became_active":"2024-04-26T23:26:13.733977+0000","last_became_peered":"2024-04-26T23:26:13.733977+0000","last_unstale":"2024-04-26T23:26:15.723857+0000","last_undegraded":"2024-04-26T23:26:15.723857+0000","last_fullsized":"2024-04-26T23:26:15.723857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737564+0000","last_change":"2024-04-26T23:26:14.743925+0000","last_active":"2024-04-26T23:26:15.737564+0000","last_peered":"2024-04-26T23:26:15.737564+0000","last_clean":"2024-04-26T23:26:15.737564+0000","last_became_active":"2024-04-26T23:26:14.743638+0000","last_became_peered":"2024-04-26T23:26:14.743638+0000","last_unstale":"2024-04-26T23:26:15.737564+0000","last_undegraded":"2024-04-26T23:26:15.737564+0000","last_fullsized":"2024-04-26T23:26:15.737564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735918+0000","last_change":"2024-04-26T23:26:13.734100+0000","last_active":"2024-04-26T23:26:15.735918+0000","last_peered":"2024-04-26T23:26:15.735918+0000","last_clean":"2024-04-26T23:26:15.735918+0000","last_became_active":"2024-04-26T23:26:13.733667+0000","last_became_peered":"2024-04-26T23:26:13.733667+0000","last_unstale":"2024-04-26T23:26:15.735918+0000","last_undegraded":"2024-04-26T23:26:15.735918+0000","last_fullsized":"2024-04-26T23:26:15.735918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736866+0000","last_change":"2024-04-26T23:26:14.734618+0000","last_active":"2024-04-26T23:26:15.736866+0000","last_peered":"2024-04-26T23:26:15.736866+0000","last_clean":"2024-04-26T23:26:15.736866+0000","last_became_active":"2024-04-26T23:26:14.734369+0000","last_became_peered":"2024-04-26T23:26:14.734369+0000","last_unstale":"2024-04-26T23:26:15.736866+0000","last_undegraded":"2024-04-26T23:26:15.736866+0000","last_fullsized":"2024-04-26T23:26:15.736866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736054+0000","last_change":"2024-04-26T23:26:13.730845+0000","last_active":"2024-04-26T23:26:15.736054+0000","last_peered":"2024-04-26T23:26:15.736054+0000","last_clean":"2024-04-26T23:26:15.736054+0000","last_became_active":"2024-04-26T23:26:13.730510+0000","last_became_peered":"2024-04-26T23:26:13.730510+0000","last_unstale":"2024-04-26T23:26:15.736054+0000","last_undegraded":"2024-04-26T23:26:15.736054+0000","last_fullsized":"2024-04-26T23:26:15.736054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723134+0000","last_change":"2024-04-26T23:26:14.729756+0000","last_active":"2024-04-26T23:26:15.723134+0000","last_peered":"2024-04-26T23:26:15.723134+0000","last_clean":"2024-04-26T23:26:15.723134+0000","last_became_active":"2024-04-26T23:26:14.729469+0000","last_became_peered":"2024-04-26T23:26:14.729469+0000","last_unstale":"2024-04-26T23:26:15.723134+0000","last_undegraded":"2024-04-26T23:26:15.723134+0000","last_fullsized":"2024-04-26T23:26:15.723134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:40.724145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723464+0000","last_change":"2024-04-26T23:26:13.732419+0000","last_active":"2024-04-26T23:26:15.723464+0000","last_peered":"2024-04-26T23:26:15.723464+0000","last_clean":"2024-04-26T23:26:15.723464+0000","last_became_active":"2024-04-26T23:26:13.732075+0000","last_became_peered":"2024-04-26T23:26:13.732075+0000","last_unstale":"2024-04-26T23:26:15.723464+0000","last_undegraded":"2024-04-26T23:26:15.723464+0000","last_fullsized":"2024-04-26T23:26:15.723464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735487+0000","last_change":"2024-04-26T23:26:14.734658+0000","last_active":"2024-04-26T23:26:15.735487+0000","last_peered":"2024-04-26T23:26:15.735487+0000","last_clean":"2024-04-26T23:26:15.735487+0000","last_became_active":"2024-04-26T23:26:14.734365+0000","last_became_peered":"2024-04-26T23:26:14.734365+0000","last_unstale":"2024-04-26T23:26:15.735487+0000","last_undegraded":"2024-04-26T23:26:15.735487+0000","last_fullsized":"2024-04-26T23:26:15.735487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:13.717076+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:13.716768+0000","last_became_peered":"2024-04-26T23:26:13.716768+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737169+0000","last_change":"2024-04-26T23:26:14.739852+0000","last_active":"2024-04-26T23:26:15.737169+0000","last_peered":"2024-04-26T23:26:15.737169+0000","last_clean":"2024-04-26T23:26:15.737169+0000","last_became_active":"2024-04-26T23:26:14.732086+0000","last_became_peered":"2024-04-26T23:26:14.732086+0000","last_unstale":"2024-04-26T23:26:15.737169+0000","last_undegraded":"2024-04-26T23:26:15.737169+0000","last_fullsized":"2024-04-26T23:26:15.737169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736729+0000","last_change":"2024-04-26T23:26:13.725980+0000","last_active":"2024-04-26T23:26:15.736729+0000","last_peered":"2024-04-26T23:26:15.736729+0000","last_clean":"2024-04-26T23:26:15.736729+0000","last_became_active":"2024-04-26T23:26:13.725692+0000","last_became_peered":"2024-04-26T23:26:13.725692+0000","last_unstale":"2024-04-26T23:26:15.736729+0000","last_undegraded":"2024-04-26T23:26:15.736729+0000","last_fullsized":"2024-04-26T23:26:15.736729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735910+0000","last_change":"2024-04-26T23:26:14.735387+0000","last_active":"2024-04-26T23:26:15.735910+0000","last_peered":"2024-04-26T23:26:15.735910+0000","last_clean":"2024-04-26T23:26:15.735910+0000","last_became_active":"2024-04-26T23:26:14.735036+0000","last_became_peered":"2024-04-26T23:26:14.735036+0000","last_unstale":"2024-04-26T23:26:15.735910+0000","last_undegraded":"2024-04-26T23:26:15.735910+0000","last_fullsized":"2024-04-26T23:26:15.735910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723581+0000","last_change":"2024-04-26T23:26:14.736310+0000","last_active":"2024-04-26T23:26:15.723581+0000","last_peered":"2024-04-26T23:26:15.723581+0000","last_clean":"2024-04-26T23:26:15.723581+0000","last_became_active":"2024-04-26T23:26:14.735927+0000","last_became_peered":"2024-04-26T23:26:14.735927+0000","last_unstale":"2024-04-26T23:26:15.723581+0000","last_undegraded":"2024-04-26T23:26:15.723581+0000","last_fullsized":"2024-04-26T23:26:15.723581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736622+0000","last_change":"2024-04-26T23:26:13.725017+0000","last_active":"2024-04-26T23:26:15.736622+0000","last_peered":"2024-04-26T23:26:15.736622+0000","last_clean":"2024-04-26T23:26:15.736622+0000","last_became_active":"2024-04-26T23:26:13.724363+0000","last_became_peered":"2024-04-26T23:26:13.724363+0000","last_unstale":"2024-04-26T23:26:15.736622+0000","last_undegraded":"2024-04-26T23:26:15.736622+0000","last_fullsized":"2024-04-26T23:26:15.736622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:46.949014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725323+0000","last_change":"2024-04-26T23:26:14.744041+0000","last_active":"2024-04-26T23:26:15.725323+0000","last_peered":"2024-04-26T23:26:15.725323+0000","last_clean":"2024-04-26T23:26:15.725323+0000","last_became_active":"2024-04-26T23:26:14.743726+0000","last_became_peered":"2024-04-26T23:26:14.743726+0000","last_unstale":"2024-04-26T23:26:15.725323+0000","last_undegraded":"2024-04-26T23:26:15.725323+0000","last_fullsized":"2024-04-26T23:26:15.725323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736853+0000","last_change":"2024-04-26T23:26:13.737149+0000","last_active":"2024-04-26T23:26:15.736853+0000","last_peered":"2024-04-26T23:26:15.736853+0000","last_clean":"2024-04-26T23:26:15.736853+0000","last_became_active":"2024-04-26T23:26:13.736573+0000","last_became_peered":"2024-04-26T23:26:13.736573+0000","last_unstale":"2024-04-26T23:26:15.736853+0000","last_undegraded":"2024-04-26T23:26:15.736853+0000","last_fullsized":"2024-04-26T23:26:15.736853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:50.948166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736769+0000","last_change":"2024-04-26T23:26:14.722451+0000","last_active":"2024-04-26T23:26:15.736769+0000","last_peered":"2024-04-26T23:26:15.736769+0000","last_clean":"2024-04-26T23:26:15.736769+0000","last_became_active":"2024-04-26T23:26:14.719570+0000","last_became_peered":"2024-04-26T23:26:14.719570+0000","last_unstale":"2024-04-26T23:26:15.736769+0000","last_undegraded":"2024-04-26T23:26:15.736769+0000","last_fullsized":"2024-04-26T23:26:15.736769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737451+0000","last_change":"2024-04-26T23:26:13.729916+0000","last_active":"2024-04-26T23:26:15.737451+0000","last_peered":"2024-04-26T23:26:15.737451+0000","last_clean":"2024-04-26T23:26:15.737451+0000","last_became_active":"2024-04-26T23:26:13.729382+0000","last_became_peered":"2024-04-26T23:26:13.729382+0000","last_unstale":"2024-04-26T23:26:15.737451+0000","last_undegraded":"2024-04-26T23:26:15.737451+0000","last_fullsized":"2024-04-26T23:26:15.737451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737423+0000","last_change":"2024-04-26T23:26:14.734991+0000","last_active":"2024-04-26T23:26:15.737423+0000","last_peered":"2024-04-26T23:26:15.737423+0000","last_clean":"2024-04-26T23:26:15.737423+0000","last_became_active":"2024-04-26T23:26:14.734727+0000","last_became_peered":"2024-04-26T23:26:14.734727+0000","last_unstale":"2024-04-26T23:26:15.737423+0000","last_undegraded":"2024-04-26T23:26:15.737423+0000","last_fullsized":"2024-04-26T23:26:15.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736858+0000","last_change":"2024-04-26T23:26:13.732964+0000","last_active":"2024-04-26T23:26:15.736858+0000","last_peered":"2024-04-26T23:26:15.736858+0000","last_clean":"2024-04-26T23:26:15.736858+0000","last_became_active":"2024-04-26T23:26:13.732485+0000","last_became_peered":"2024-04-26T23:26:13.732485+0000","last_unstale":"2024-04-26T23:26:15.736858+0000","last_undegraded":"2024-04-26T23:26:15.736858+0000","last_fullsized":"2024-04-26T23:26:15.736858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:26:18.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:26:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.025+0000 7fe120200640 1 Processor -- start 2024-04-26T23:26:19.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.025+0000 7fe120200640 1 -- start start 2024-04-26T23:26:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe120200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1180b4b10 0x7fe1180b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe120200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe118163ce0 con 0x7fe11815f500 2024-04-26T23:26:19.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe120200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1180d0dd0 con 0x7fe1180b6240 2024-04-26T23:26:19.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe120200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe1180d1390 con 0x7fe1180b4b10 2024-04-26T23:26:19.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11d800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe11815f500 0x7fe1180d27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56470/0 (socket says 172.21.15.39:56470) 2024-04-26T23:26:19.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11d800640 1 -- 172.21.15.39:0/3456507330 learned_addr learned my addr 172.21.15.39:0/3456507330 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:19.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11ce00640 1 --2- 172.21.15.39:0/3456507330 >> v2:172.21.15.39:3300/0 conn(0x7fe1180b4b10 0x7fe1180b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe117e00640 1 -- 172.21.15.39:0/3456507330 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682406371 0 0) 0x7fe118163ce0 con 0x7fe11815f500 2024-04-26T23:26:19.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe117e00640 1 -- 172.21.15.39:0/3456507330 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe100003530 con 0x7fe11815f500 2024-04-26T23:26:19.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11ce00640 1 -- 172.21.15.39:0/3456507330 >> v1:172.21.15.71:6789/0 conn(0x7fe1180b6240 legacy=0x7fe1180b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11ce00640 1 -- 172.21.15.39:0/3456507330 >> v1:172.21.15.39:6789/0 conn(0x7fe11815f500 legacy=0x7fe1180d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.029+0000 7fe11ce00640 1 -- 172.21.15.39:0/3456507330 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1180d10b0 con 0x7fe1180b4b10 2024-04-26T23:26:19.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe11ce00640 1 --2- 172.21.15.39:0/3456507330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe1180b4fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1040097c0 tx=0x7fe10401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5988d920eaa63f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe117e00640 1 -- 172.21.15.39:0/3456507330 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1040b0070 con 0x7fe1180b4b10 2024-04-26T23:26:19.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe117e00640 1 -- 172.21.15.39:0/3456507330 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1040ab600 con 0x7fe1180b4b10 2024-04-26T23:26:19.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe117e00640 1 -- 172.21.15.39:0/3456507330 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1040ab9d0 con 0x7fe1180b4b10 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- 172.21.15.39:0/3456507330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 msgr2=0x7fe1180b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 --2- 172.21.15.39:0/3456507330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe1180b4fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1040097c0 tx=0x7fe10401c380 comp rx=0 tx=0).stop 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- 172.21.15.39:0/3456507330 shutdown_connections 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 --2- 172.21.15.39:0/3456507330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe1180b4fa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- 172.21.15.39:0/3456507330 >> 172.21.15.39:0/3456507330 conn(0x7fe118068140 msgr2=0x7fe118068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- 172.21.15.39:0/3456507330 shutdown_connections 2024-04-26T23:26:19.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- 172.21.15.39:0/3456507330 wait complete. 2024-04-26T23:26:19.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 Processor -- start 2024-04-26T23:26:19.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- start start 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1180b6240 0x7fe11815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe11815f500 0x7fe1181525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe11816d670 con 0x7fe1180b4b10 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe11816d4f0 con 0x7fe1180b6240 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe120200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe11816d7f0 con 0x7fe11815f500 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe11d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe11d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59052/0 (socket says 172.21.15.39:59052) 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.033+0000 7fe11d800640 1 -- 172.21.15.39:0/3049564673 learned_addr learned my addr 172.21.15.39:0/3049564673 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11e200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe11815f500 0x7fe1181525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11ce00640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1180b6240 0x7fe11815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 -- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe11815f500 msgr2=0x7fe1181525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe11815f500 0x7fe1181525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 -- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1180b6240 msgr2=0x7fe11815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1180b6240 0x7fe11815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 -- 172.21.15.39:0/3049564673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11815e1b0 con 0x7fe1180b4b10 2024-04-26T23:26:19.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe11d800640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c420 tx=0x7fe10c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c017070 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c005cf0 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0072d0 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11815e470 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11815ea30 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe118050740 con 0x7fe1180b4b10 2024-04-26T23:26:19.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.037+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe10c01a070 con 0x7fe1180b4b10 2024-04-26T23:26:19.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.041+0000 7fe115600640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 0x7fe0f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.041+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe10c085da0 con 0x7fe1180b4b10 2024-04-26T23:26:19.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.041+0000 7fe11ce00640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 0x7fe0f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.041+0000 7fe11ce00640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 0x7fe0f806a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ad000 tx=0x7fe104008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.045+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe10c055c70 con 0x7fe1180b4b10 2024-04-26T23:26:19.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.205+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe11815eda0 con 0x7fe0f8068380 2024-04-26T23:26:19.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.209+0000 7fe115600640 1 -- 172.21.15.39:0/3049564673 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fe11815eda0 con 0x7fe0f8068380 2024-04-26T23:26:19.217 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:19.219 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 msgr2=0x7fe0f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 0x7fe0f806a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ad000 tx=0x7fe104008040 comp rx=0 tx=0).stop 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 msgr2=0x7fe118152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c420 tx=0x7fe10c00c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 shutdown_connections 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0f8068380 0x7fe0f806a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe11815f500 0x7fe1181525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1180b6240 0x7fe11815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 --2- 172.21.15.39:0/3049564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1180b4b10 0x7fe118152dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 >> 172.21.15.39:0/3049564673 conn(0x7fe118068140 msgr2=0x7fe11806dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:19.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 shutdown_connections 2024-04-26T23:26:19.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.213+0000 7fe120200640 1 -- 172.21.15.39:0/3049564673 wait complete. 2024-04-26T23:26:19.239 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T23:26:17.657868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227344,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747376,"statfs":{"total":773094113280,"available":772861313024,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.962545"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736763+0000","last_change":"2024-04-26T23:26:14.750190+0000","last_active":"2024-04-26T23:26:15.736763+0000","last_peered":"2024-04-26T23:26:15.736763+0000","last_clean":"2024-04-26T23:26:15.736763+0000","last_became_active":"2024-04-26T23:26:14.749862+0000","last_became_peered":"2024-04-26T23:26:14.749862+0000","last_unstale":"2024-04-26T23:26:15.736763+0000","last_undegraded":"2024-04-26T23:26:15.736763+0000","last_fullsized":"2024-04-26T23:26:15.736763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723865+0000","last_change":"2024-04-26T23:26:14.724978+0000","last_active":"2024-04-26T23:26:15.723865+0000","last_peered":"2024-04-26T23:26:15.723865+0000","last_clean":"2024-04-26T23:26:15.723865+0000","last_became_active":"2024-04-26T23:26:14.724385+0000","last_became_peered":"2024-04-26T23:26:14.724385+0000","last_unstale":"2024-04-26T23:26:15.723865+0000","last_undegraded":"2024-04-26T23:26:15.723865+0000","last_fullsized":"2024-04-26T23:26:15.723865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736625+0000","last_change":"2024-04-26T23:26:14.724918+0000","last_active":"2024-04-26T23:26:15.736625+0000","last_peered":"2024-04-26T23:26:15.736625+0000","last_clean":"2024-04-26T23:26:15.736625+0000","last_became_active":"2024-04-26T23:26:14.724588+0000","last_became_peered":"2024-04-26T23:26:14.724588+0000","last_unstale":"2024-04-26T23:26:15.736625+0000","last_undegraded":"2024-04-26T23:26:15.736625+0000","last_fullsized":"2024-04-26T23:26:15.736625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725084+0000","last_change":"2024-04-26T23:26:14.723378+0000","last_active":"2024-04-26T23:26:15.725084+0000","last_peered":"2024-04-26T23:26:15.725084+0000","last_clean":"2024-04-26T23:26:15.725084+0000","last_became_active":"2024-04-26T23:26:14.722888+0000","last_became_peered":"2024-04-26T23:26:14.722888+0000","last_unstale":"2024-04-26T23:26:15.725084+0000","last_undegraded":"2024-04-26T23:26:15.725084+0000","last_fullsized":"2024-04-26T23:26:15.725084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736482+0000","last_change":"2024-04-26T23:26:14.733728+0000","last_active":"2024-04-26T23:26:15.736482+0000","last_peered":"2024-04-26T23:26:15.736482+0000","last_clean":"2024-04-26T23:26:15.736482+0000","last_became_active":"2024-04-26T23:26:14.733044+0000","last_became_peered":"2024-04-26T23:26:14.733044+0000","last_unstale":"2024-04-26T23:26:15.736482+0000","last_undegraded":"2024-04-26T23:26:15.736482+0000","last_fullsized":"2024-04-26T23:26:15.736482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725262+0000","last_change":"2024-04-26T23:26:14.724291+0000","last_active":"2024-04-26T23:26:15.725262+0000","last_peered":"2024-04-26T23:26:15.725262+0000","last_clean":"2024-04-26T23:26:15.725262+0000","last_became_active":"2024-04-26T23:26:14.724038+0000","last_became_peered":"2024-04-26T23:26:14.724038+0000","last_unstale":"2024-04-26T23:26:15.725262+0000","last_undegraded":"2024-04-26T23:26:15.725262+0000","last_fullsized":"2024-04-26T23:26:15.725262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736072+0000","last_change":"2024-04-26T23:26:14.728422+0000","last_active":"2024-04-26T23:26:15.736072+0000","last_peered":"2024-04-26T23:26:15.736072+0000","last_clean":"2024-04-26T23:26:15.736072+0000","last_became_active":"2024-04-26T23:26:14.728014+0000","last_became_peered":"2024-04-26T23:26:14.728014+0000","last_unstale":"2024-04-26T23:26:15.736072+0000","last_undegraded":"2024-04-26T23:26:15.736072+0000","last_fullsized":"2024-04-26T23:26:15.736072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735326+0000","last_change":"2024-04-26T23:26:14.720678+0000","last_active":"2024-04-26T23:26:15.735326+0000","last_peered":"2024-04-26T23:26:15.735326+0000","last_clean":"2024-04-26T23:26:15.735326+0000","last_became_active":"2024-04-26T23:26:14.720413+0000","last_became_peered":"2024-04-26T23:26:14.720413+0000","last_unstale":"2024-04-26T23:26:15.735326+0000","last_undegraded":"2024-04-26T23:26:15.735326+0000","last_fullsized":"2024-04-26T23:26:15.735326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736984+0000","last_change":"2024-04-26T23:26:14.746576+0000","last_active":"2024-04-26T23:26:15.736984+0000","last_peered":"2024-04-26T23:26:15.736984+0000","last_clean":"2024-04-26T23:26:15.736984+0000","last_became_active":"2024-04-26T23:26:14.745710+0000","last_became_peered":"2024-04-26T23:26:14.745710+0000","last_unstale":"2024-04-26T23:26:15.736984+0000","last_undegraded":"2024-04-26T23:26:15.736984+0000","last_fullsized":"2024-04-26T23:26:15.736984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:04.796305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735909+0000","last_change":"2024-04-26T23:26:14.736993+0000","last_active":"2024-04-26T23:26:15.735909+0000","last_peered":"2024-04-26T23:26:15.735909+0000","last_clean":"2024-04-26T23:26:15.735909+0000","last_became_active":"2024-04-26T23:26:14.736555+0000","last_became_peered":"2024-04-26T23:26:14.736555+0000","last_unstale":"2024-04-26T23:26:15.735909+0000","last_undegraded":"2024-04-26T23:26:15.735909+0000","last_fullsized":"2024-04-26T23:26:15.735909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735781+0000","last_change":"2024-04-26T23:26:14.738192+0000","last_active":"2024-04-26T23:26:15.735781+0000","last_peered":"2024-04-26T23:26:15.735781+0000","last_clean":"2024-04-26T23:26:15.735781+0000","last_became_active":"2024-04-26T23:26:14.735778+0000","last_became_peered":"2024-04-26T23:26:14.735778+0000","last_unstale":"2024-04-26T23:26:15.735781+0000","last_undegraded":"2024-04-26T23:26:15.735781+0000","last_fullsized":"2024-04-26T23:26:15.735781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723687+0000","last_change":"2024-04-26T23:26:14.746898+0000","last_active":"2024-04-26T23:26:15.723687+0000","last_peered":"2024-04-26T23:26:15.723687+0000","last_clean":"2024-04-26T23:26:15.723687+0000","last_became_active":"2024-04-26T23:26:14.743251+0000","last_became_peered":"2024-04-26T23:26:14.743251+0000","last_unstale":"2024-04-26T23:26:15.723687+0000","last_undegraded":"2024-04-26T23:26:15.723687+0000","last_fullsized":"2024-04-26T23:26:15.723687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:20.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737227+0000","last_change":"2024-04-26T23:26:14.740463+0000","last_active":"2024-04-26T23:26:15.737227+0000","last_peered":"2024-04-26T23:26:15.737227+0000","last_clean":"2024-04-26T23:26:15.737227+0000","last_became_active":"2024-04-26T23:26:14.740150+0000","last_became_peered":"2024-04-26T23:26:14.740150+0000","last_unstale":"2024-04-26T23:26:15.737227+0000","last_undegraded":"2024-04-26T23:26:15.737227+0000","last_fullsized":"2024-04-26T23:26:15.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736130+0000","last_change":"2024-04-26T23:26:14.728712+0000","last_active":"2024-04-26T23:26:15.736130+0000","last_peered":"2024-04-26T23:26:15.736130+0000","last_clean":"2024-04-26T23:26:15.736130+0000","last_became_active":"2024-04-26T23:26:14.728390+0000","last_became_peered":"2024-04-26T23:26:14.728390+0000","last_unstale":"2024-04-26T23:26:15.736130+0000","last_undegraded":"2024-04-26T23:26:15.736130+0000","last_fullsized":"2024-04-26T23:26:15.736130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:50.776227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723349+0000","last_change":"2024-04-26T23:26:14.739193+0000","last_active":"2024-04-26T23:26:15.723349+0000","last_peered":"2024-04-26T23:26:15.723349+0000","last_clean":"2024-04-26T23:26:15.723349+0000","last_became_active":"2024-04-26T23:26:14.739006+0000","last_became_peered":"2024-04-26T23:26:14.739006+0000","last_unstale":"2024-04-26T23:26:15.723349+0000","last_undegraded":"2024-04-26T23:26:15.723349+0000","last_fullsized":"2024-04-26T23:26:15.723349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723007+0000","last_change":"2024-04-26T23:26:14.732502+0000","last_active":"2024-04-26T23:26:15.723007+0000","last_peered":"2024-04-26T23:26:15.723007+0000","last_clean":"2024-04-26T23:26:15.723007+0000","last_became_active":"2024-04-26T23:26:14.732194+0000","last_became_peered":"2024-04-26T23:26:14.732194+0000","last_unstale":"2024-04-26T23:26:15.723007+0000","last_undegraded":"2024-04-26T23:26:15.723007+0000","last_fullsized":"2024-04-26T23:26:15.723007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724541+0000","last_change":"2024-04-26T23:26:14.742132+0000","last_active":"2024-04-26T23:26:15.724541+0000","last_peered":"2024-04-26T23:26:15.724541+0000","last_clean":"2024-04-26T23:26:15.724541+0000","last_became_active":"2024-04-26T23:26:14.741783+0000","last_became_peered":"2024-04-26T23:26:14.741783+0000","last_unstale":"2024-04-26T23:26:15.724541+0000","last_undegraded":"2024-04-26T23:26:15.724541+0000","last_fullsized":"2024-04-26T23:26:15.724541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:14.735635+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:14.735055+0000","last_became_peered":"2024-04-26T23:26:14.735055+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736912+0000","last_change":"2024-04-26T23:26:14.732726+0000","last_active":"2024-04-26T23:26:15.736912+0000","last_peered":"2024-04-26T23:26:15.736912+0000","last_clean":"2024-04-26T23:26:15.736912+0000","last_became_active":"2024-04-26T23:26:14.732453+0000","last_became_peered":"2024-04-26T23:26:14.732453+0000","last_unstale":"2024-04-26T23:26:15.736912+0000","last_undegraded":"2024-04-26T23:26:15.736912+0000","last_fullsized":"2024-04-26T23:26:15.736912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:26.906820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735761+0000","last_change":"2024-04-26T23:26:14.739109+0000","last_active":"2024-04-26T23:26:15.735761+0000","last_peered":"2024-04-26T23:26:15.735761+0000","last_clean":"2024-04-26T23:26:15.735761+0000","last_became_active":"2024-04-26T23:26:14.738756+0000","last_became_peered":"2024-04-26T23:26:14.738756+0000","last_unstale":"2024-04-26T23:26:15.735761+0000","last_undegraded":"2024-04-26T23:26:15.735761+0000","last_fullsized":"2024-04-26T23:26:15.735761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736250+0000","last_change":"2024-04-26T23:26:14.743573+0000","last_active":"2024-04-26T23:26:15.736250+0000","last_peered":"2024-04-26T23:26:15.736250+0000","last_clean":"2024-04-26T23:26:15.736250+0000","last_became_active":"2024-04-26T23:26:14.743307+0000","last_became_peered":"2024-04-26T23:26:14.743307+0000","last_unstale":"2024-04-26T23:26:15.736250+0000","last_undegraded":"2024-04-26T23:26:15.736250+0000","last_fullsized":"2024-04-26T23:26:15.736250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724521+0000","last_change":"2024-04-26T23:26:14.735001+0000","last_active":"2024-04-26T23:26:15.724521+0000","last_peered":"2024-04-26T23:26:15.724521+0000","last_clean":"2024-04-26T23:26:15.724521+0000","last_became_active":"2024-04-26T23:26:14.734736+0000","last_became_peered":"2024-04-26T23:26:14.734736+0000","last_unstale":"2024-04-26T23:26:15.724521+0000","last_undegraded":"2024-04-26T23:26:15.724521+0000","last_fullsized":"2024-04-26T23:26:15.724521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735364+0000","last_change":"2024-04-26T23:26:14.740226+0000","last_active":"2024-04-26T23:26:15.735364+0000","last_peered":"2024-04-26T23:26:15.735364+0000","last_clean":"2024-04-26T23:26:15.735364+0000","last_became_active":"2024-04-26T23:26:14.739943+0000","last_became_peered":"2024-04-26T23:26:14.739943+0000","last_unstale":"2024-04-26T23:26:15.735364+0000","last_undegraded":"2024-04-26T23:26:15.735364+0000","last_fullsized":"2024-04-26T23:26:15.735364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723048+0000","last_change":"2024-04-26T23:26:14.724087+0000","last_active":"2024-04-26T23:26:15.723048+0000","last_peered":"2024-04-26T23:26:15.723048+0000","last_clean":"2024-04-26T23:26:15.723048+0000","last_became_active":"2024-04-26T23:26:14.723715+0000","last_became_peered":"2024-04-26T23:26:14.723715+0000","last_unstale":"2024-04-26T23:26:15.723048+0000","last_undegraded":"2024-04-26T23:26:15.723048+0000","last_fullsized":"2024-04-26T23:26:15.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737556+0000","last_change":"2024-04-26T23:26:14.736545+0000","last_active":"2024-04-26T23:26:15.737556+0000","last_peered":"2024-04-26T23:26:15.737556+0000","last_clean":"2024-04-26T23:26:15.737556+0000","last_became_active":"2024-04-26T23:26:14.736290+0000","last_became_peered":"2024-04-26T23:26:14.736290+0000","last_unstale":"2024-04-26T23:26:15.737556+0000","last_undegraded":"2024-04-26T23:26:15.737556+0000","last_fullsized":"2024-04-26T23:26:15.737556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736017+0000","last_change":"2024-04-26T23:26:14.748640+0000","last_active":"2024-04-26T23:26:15.736017+0000","last_peered":"2024-04-26T23:26:15.736017+0000","last_clean":"2024-04-26T23:26:15.736017+0000","last_became_active":"2024-04-26T23:26:14.747387+0000","last_became_peered":"2024-04-26T23:26:14.747387+0000","last_unstale":"2024-04-26T23:26:15.736017+0000","last_undegraded":"2024-04-26T23:26:15.736017+0000","last_fullsized":"2024-04-26T23:26:15.736017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723738+0000","last_change":"2024-04-26T23:26:14.737597+0000","last_active":"2024-04-26T23:26:15.723738+0000","last_peered":"2024-04-26T23:26:15.723738+0000","last_clean":"2024-04-26T23:26:15.723738+0000","last_became_active":"2024-04-26T23:26:14.735590+0000","last_became_peered":"2024-04-26T23:26:14.735590+0000","last_unstale":"2024-04-26T23:26:15.723738+0000","last_undegraded":"2024-04-26T23:26:15.723738+0000","last_fullsized":"2024-04-26T23:26:15.723738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737377+0000","last_change":"2024-04-26T23:26:14.736063+0000","last_active":"2024-04-26T23:26:15.737377+0000","last_peered":"2024-04-26T23:26:15.737377+0000","last_clean":"2024-04-26T23:26:15.737377+0000","last_became_active":"2024-04-26T23:26:14.735857+0000","last_became_peered":"2024-04-26T23:26:14.735857+0000","last_unstale":"2024-04-26T23:26:15.737377+0000","last_undegraded":"2024-04-26T23:26:15.737377+0000","last_fullsized":"2024-04-26T23:26:15.737377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736401+0000","last_change":"2024-04-26T23:26:14.723733+0000","last_active":"2024-04-26T23:26:15.736401+0000","last_peered":"2024-04-26T23:26:15.736401+0000","last_clean":"2024-04-26T23:26:15.736401+0000","last_became_active":"2024-04-26T23:26:14.723459+0000","last_became_peered":"2024-04-26T23:26:14.723459+0000","last_unstale":"2024-04-26T23:26:15.736401+0000","last_undegraded":"2024-04-26T23:26:15.736401+0000","last_fullsized":"2024-04-26T23:26:15.736401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724727+0000","last_change":"2024-04-26T23:26:14.722556+0000","last_active":"2024-04-26T23:26:15.724727+0000","last_peered":"2024-04-26T23:26:15.724727+0000","last_clean":"2024-04-26T23:26:15.724727+0000","last_became_active":"2024-04-26T23:26:14.722259+0000","last_became_peered":"2024-04-26T23:26:14.722259+0000","last_unstale":"2024-04-26T23:26:15.724727+0000","last_undegraded":"2024-04-26T23:26:15.724727+0000","last_fullsized":"2024-04-26T23:26:15.724727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735569+0000","last_change":"2024-04-26T23:26:14.732537+0000","last_active":"2024-04-26T23:26:15.735569+0000","last_peered":"2024-04-26T23:26:15.735569+0000","last_clean":"2024-04-26T23:26:15.735569+0000","last_became_active":"2024-04-26T23:26:14.732051+0000","last_became_peered":"2024-04-26T23:26:14.732051+0000","last_unstale":"2024-04-26T23:26:15.735569+0000","last_undegraded":"2024-04-26T23:26:15.735569+0000","last_fullsized":"2024-04-26T23:26:15.735569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735547+0000","last_change":"2024-04-26T23:26:14.731655+0000","last_active":"2024-04-26T23:26:15.735547+0000","last_peered":"2024-04-26T23:26:15.735547+0000","last_clean":"2024-04-26T23:26:15.735547+0000","last_became_active":"2024-04-26T23:26:14.731379+0000","last_became_peered":"2024-04-26T23:26:14.731379+0000","last_unstale":"2024-04-26T23:26:15.735547+0000","last_undegraded":"2024-04-26T23:26:15.735547+0000","last_fullsized":"2024-04-26T23:26:15.735547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723549+0000","last_change":"2024-04-26T23:26:14.733290+0000","last_active":"2024-04-26T23:26:15.723549+0000","last_peered":"2024-04-26T23:26:15.723549+0000","last_clean":"2024-04-26T23:26:15.723549+0000","last_became_active":"2024-04-26T23:26:14.732863+0000","last_became_peered":"2024-04-26T23:26:14.732863+0000","last_unstale":"2024-04-26T23:26:15.723549+0000","last_undegraded":"2024-04-26T23:26:15.723549+0000","last_fullsized":"2024-04-26T23:26:15.723549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:36.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737262+0000","last_change":"2024-04-26T23:26:13.724097+0000","last_active":"2024-04-26T23:26:15.737262+0000","last_peered":"2024-04-26T23:26:15.737262+0000","last_clean":"2024-04-26T23:26:15.737262+0000","last_became_active":"2024-04-26T23:26:13.723161+0000","last_became_peered":"2024-04-26T23:26:13.723161+0000","last_unstale":"2024-04-26T23:26:15.737262+0000","last_undegraded":"2024-04-26T23:26:15.737262+0000","last_fullsized":"2024-04-26T23:26:15.737262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736414+0000","last_change":"2024-04-26T23:26:14.727155+0000","last_active":"2024-04-26T23:26:15.736414+0000","last_peered":"2024-04-26T23:26:15.736414+0000","last_clean":"2024-04-26T23:26:15.736414+0000","last_became_active":"2024-04-26T23:26:14.726867+0000","last_became_peered":"2024-04-26T23:26:14.726867+0000","last_unstale":"2024-04-26T23:26:15.736414+0000","last_undegraded":"2024-04-26T23:26:15.736414+0000","last_fullsized":"2024-04-26T23:26:15.736414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735577+0000","last_change":"2024-04-26T23:26:13.729977+0000","last_active":"2024-04-26T23:26:15.735577+0000","last_peered":"2024-04-26T23:26:15.735577+0000","last_clean":"2024-04-26T23:26:15.735577+0000","last_became_active":"2024-04-26T23:26:13.728795+0000","last_became_peered":"2024-04-26T23:26:13.728795+0000","last_unstale":"2024-04-26T23:26:15.735577+0000","last_undegraded":"2024-04-26T23:26:15.735577+0000","last_fullsized":"2024-04-26T23:26:15.735577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736357+0000","last_change":"2024-04-26T23:26:13.730567+0000","last_active":"2024-04-26T23:26:15.736357+0000","last_peered":"2024-04-26T23:26:15.736357+0000","last_clean":"2024-04-26T23:26:15.736357+0000","last_became_active":"2024-04-26T23:26:13.730321+0000","last_became_peered":"2024-04-26T23:26:13.730321+0000","last_unstale":"2024-04-26T23:26:15.736357+0000","last_undegraded":"2024-04-26T23:26:15.736357+0000","last_fullsized":"2024-04-26T23:26:15.736357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735371+0000","last_change":"2024-04-26T23:26:14.733324+0000","last_active":"2024-04-26T23:26:15.735371+0000","last_peered":"2024-04-26T23:26:15.735371+0000","last_clean":"2024-04-26T23:26:15.735371+0000","last_became_active":"2024-04-26T23:26:14.733059+0000","last_became_peered":"2024-04-26T23:26:14.733059+0000","last_unstale":"2024-04-26T23:26:15.735371+0000","last_undegraded":"2024-04-26T23:26:15.735371+0000","last_fullsized":"2024-04-26T23:26:15.735371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723137+0000","last_change":"2024-04-26T23:26:13.714305+0000","last_active":"2024-04-26T23:26:15.723137+0000","last_peered":"2024-04-26T23:26:15.723137+0000","last_clean":"2024-04-26T23:26:15.723137+0000","last_became_active":"2024-04-26T23:26:13.713944+0000","last_became_peered":"2024-04-26T23:26:13.713944+0000","last_unstale":"2024-04-26T23:26:15.723137+0000","last_undegraded":"2024-04-26T23:26:15.723137+0000","last_fullsized":"2024-04-26T23:26:15.723137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:14.729913+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:14.729650+0000","last_became_peered":"2024-04-26T23:26:14.729650+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735790+0000","last_change":"2024-04-26T23:26:13.735343+0000","last_active":"2024-04-26T23:26:15.735790+0000","last_peered":"2024-04-26T23:26:15.735790+0000","last_clean":"2024-04-26T23:26:15.735790+0000","last_became_active":"2024-04-26T23:26:13.734994+0000","last_became_peered":"2024-04-26T23:26:13.734994+0000","last_unstale":"2024-04-26T23:26:15.735790+0000","last_undegraded":"2024-04-26T23:26:15.735790+0000","last_fullsized":"2024-04-26T23:26:15.735790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724315+0000","last_change":"2024-04-26T23:26:14.742311+0000","last_active":"2024-04-26T23:26:15.724315+0000","last_peered":"2024-04-26T23:26:15.724315+0000","last_clean":"2024-04-26T23:26:15.724315+0000","last_became_active":"2024-04-26T23:26:14.742033+0000","last_became_peered":"2024-04-26T23:26:14.742033+0000","last_unstale":"2024-04-26T23:26:15.724315+0000","last_undegraded":"2024-04-26T23:26:15.724315+0000","last_fullsized":"2024-04-26T23:26:15.724315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724308+0000","last_change":"2024-04-26T23:26:13.733199+0000","last_active":"2024-04-26T23:26:15.724308+0000","last_peered":"2024-04-26T23:26:15.724308+0000","last_clean":"2024-04-26T23:26:15.724308+0000","last_became_active":"2024-04-26T23:26:13.732940+0000","last_became_peered":"2024-04-26T23:26:13.732940+0000","last_unstale":"2024-04-26T23:26:15.724308+0000","last_undegraded":"2024-04-26T23:26:15.724308+0000","last_fullsized":"2024-04-26T23:26:15.724308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736800+0000","last_change":"2024-04-26T23:26:14.729724+0000","last_active":"2024-04-26T23:26:15.736800+0000","last_peered":"2024-04-26T23:26:15.736800+0000","last_clean":"2024-04-26T23:26:15.736800+0000","last_became_active":"2024-04-26T23:26:14.729430+0000","last_became_peered":"2024-04-26T23:26:14.729430+0000","last_unstale":"2024-04-26T23:26:15.736800+0000","last_undegraded":"2024-04-26T23:26:15.736800+0000","last_fullsized":"2024-04-26T23:26:15.736800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723725+0000","last_change":"2024-04-26T23:26:13.724763+0000","last_active":"2024-04-26T23:26:15.723725+0000","last_peered":"2024-04-26T23:26:15.723725+0000","last_clean":"2024-04-26T23:26:15.723725+0000","last_became_active":"2024-04-26T23:26:13.724483+0000","last_became_peered":"2024-04-26T23:26:13.724483+0000","last_unstale":"2024-04-26T23:26:15.723725+0000","last_undegraded":"2024-04-26T23:26:15.723725+0000","last_fullsized":"2024-04-26T23:26:15.723725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723791+0000","last_change":"2024-04-26T23:26:14.733025+0000","last_active":"2024-04-26T23:26:15.723791+0000","last_peered":"2024-04-26T23:26:15.723791+0000","last_clean":"2024-04-26T23:26:15.723791+0000","last_became_active":"2024-04-26T23:26:14.732739+0000","last_became_peered":"2024-04-26T23:26:14.732739+0000","last_unstale":"2024-04-26T23:26:15.723791+0000","last_undegraded":"2024-04-26T23:26:15.723791+0000","last_fullsized":"2024-04-26T23:26:15.723791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735689+0000","last_change":"2024-04-26T23:26:13.729905+0000","last_active":"2024-04-26T23:26:15.735689+0000","last_peered":"2024-04-26T23:26:15.735689+0000","last_clean":"2024-04-26T23:26:15.735689+0000","last_became_active":"2024-04-26T23:26:13.729641+0000","last_became_peered":"2024-04-26T23:26:13.729641+0000","last_unstale":"2024-04-26T23:26:15.735689+0000","last_undegraded":"2024-04-26T23:26:15.735689+0000","last_fullsized":"2024-04-26T23:26:15.735689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736765+0000","last_change":"2024-04-26T23:26:14.744333+0000","last_active":"2024-04-26T23:26:15.736765+0000","last_peered":"2024-04-26T23:26:15.736765+0000","last_clean":"2024-04-26T23:26:15.736765+0000","last_became_active":"2024-04-26T23:26:14.741477+0000","last_became_peered":"2024-04-26T23:26:14.741477+0000","last_unstale":"2024-04-26T23:26:15.736765+0000","last_undegraded":"2024-04-26T23:26:15.736765+0000","last_fullsized":"2024-04-26T23:26:15.736765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736523+0000","last_change":"2024-04-26T23:26:13.724495+0000","last_active":"2024-04-26T23:26:15.736523+0000","last_peered":"2024-04-26T23:26:15.736523+0000","last_clean":"2024-04-26T23:26:15.736523+0000","last_became_active":"2024-04-26T23:26:13.722127+0000","last_became_peered":"2024-04-26T23:26:13.722127+0000","last_unstale":"2024-04-26T23:26:15.736523+0000","last_undegraded":"2024-04-26T23:26:15.736523+0000","last_fullsized":"2024-04-26T23:26:15.736523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736199+0000","last_change":"2024-04-26T23:26:14.730136+0000","last_active":"2024-04-26T23:26:15.736199+0000","last_peered":"2024-04-26T23:26:15.736199+0000","last_clean":"2024-04-26T23:26:15.736199+0000","last_became_active":"2024-04-26T23:26:14.729903+0000","last_became_peered":"2024-04-26T23:26:14.729903+0000","last_unstale":"2024-04-26T23:26:15.736199+0000","last_undegraded":"2024-04-26T23:26:15.736199+0000","last_fullsized":"2024-04-26T23:26:15.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724823+0000","last_change":"2024-04-26T23:26:13.730110+0000","last_active":"2024-04-26T23:26:15.724823+0000","last_peered":"2024-04-26T23:26:15.724823+0000","last_clean":"2024-04-26T23:26:15.724823+0000","last_became_active":"2024-04-26T23:26:13.729806+0000","last_became_peered":"2024-04-26T23:26:13.729806+0000","last_unstale":"2024-04-26T23:26:15.724823+0000","last_undegraded":"2024-04-26T23:26:15.724823+0000","last_fullsized":"2024-04-26T23:26:15.724823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736577+0000","last_change":"2024-04-26T23:26:14.739556+0000","last_active":"2024-04-26T23:26:15.736577+0000","last_peered":"2024-04-26T23:26:15.736577+0000","last_clean":"2024-04-26T23:26:15.736577+0000","last_became_active":"2024-04-26T23:26:14.739201+0000","last_became_peered":"2024-04-26T23:26:14.739201+0000","last_unstale":"2024-04-26T23:26:15.736577+0000","last_undegraded":"2024-04-26T23:26:15.736577+0000","last_fullsized":"2024-04-26T23:26:15.736577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735986+0000","last_change":"2024-04-26T23:26:13.736521+0000","last_active":"2024-04-26T23:26:15.735986+0000","last_peered":"2024-04-26T23:26:15.735986+0000","last_clean":"2024-04-26T23:26:15.735986+0000","last_became_active":"2024-04-26T23:26:13.736233+0000","last_became_peered":"2024-04-26T23:26:13.736233+0000","last_unstale":"2024-04-26T23:26:15.735986+0000","last_undegraded":"2024-04-26T23:26:15.735986+0000","last_fullsized":"2024-04-26T23:26:15.735986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735936+0000","last_change":"2024-04-26T23:26:14.731078+0000","last_active":"2024-04-26T23:26:15.735936+0000","last_peered":"2024-04-26T23:26:15.735936+0000","last_clean":"2024-04-26T23:26:15.735936+0000","last_became_active":"2024-04-26T23:26:14.730526+0000","last_became_peered":"2024-04-26T23:26:14.730526+0000","last_unstale":"2024-04-26T23:26:15.735936+0000","last_undegraded":"2024-04-26T23:26:15.735936+0000","last_fullsized":"2024-04-26T23:26:15.735936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735491+0000","last_change":"2024-04-26T23:26:13.720259+0000","last_active":"2024-04-26T23:26:15.735491+0000","last_peered":"2024-04-26T23:26:15.735491+0000","last_clean":"2024-04-26T23:26:15.735491+0000","last_became_active":"2024-04-26T23:26:13.719993+0000","last_became_peered":"2024-04-26T23:26:13.719993+0000","last_unstale":"2024-04-26T23:26:15.735491+0000","last_undegraded":"2024-04-26T23:26:15.735491+0000","last_fullsized":"2024-04-26T23:26:15.735491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736174+0000","last_change":"2024-04-26T23:26:14.744189+0000","last_active":"2024-04-26T23:26:15.736174+0000","last_peered":"2024-04-26T23:26:15.736174+0000","last_clean":"2024-04-26T23:26:15.736174+0000","last_became_active":"2024-04-26T23:26:14.742691+0000","last_became_peered":"2024-04-26T23:26:14.742691+0000","last_unstale":"2024-04-26T23:26:15.736174+0000","last_undegraded":"2024-04-26T23:26:15.736174+0000","last_fullsized":"2024-04-26T23:26:15.736174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725515+0000","last_change":"2024-04-26T23:26:13.722716+0000","last_active":"2024-04-26T23:26:15.725515+0000","last_peered":"2024-04-26T23:26:15.725515+0000","last_clean":"2024-04-26T23:26:15.725515+0000","last_became_active":"2024-04-26T23:26:13.722282+0000","last_became_peered":"2024-04-26T23:26:13.722282+0000","last_unstale":"2024-04-26T23:26:15.725515+0000","last_undegraded":"2024-04-26T23:26:15.725515+0000","last_fullsized":"2024-04-26T23:26:15.725515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:03.302571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736807+0000","last_change":"2024-04-26T23:26:14.745739+0000","last_active":"2024-04-26T23:26:15.736807+0000","last_peered":"2024-04-26T23:26:15.736807+0000","last_clean":"2024-04-26T23:26:15.736807+0000","last_became_active":"2024-04-26T23:26:14.745393+0000","last_became_peered":"2024-04-26T23:26:14.745393+0000","last_unstale":"2024-04-26T23:26:15.736807+0000","last_undegraded":"2024-04-26T23:26:15.736807+0000","last_fullsized":"2024-04-26T23:26:15.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736102+0000","last_change":"2024-04-26T23:26:13.720970+0000","last_active":"2024-04-26T23:26:15.736102+0000","last_peered":"2024-04-26T23:26:15.736102+0000","last_clean":"2024-04-26T23:26:15.736102+0000","last_became_active":"2024-04-26T23:26:13.720659+0000","last_became_peered":"2024-04-26T23:26:13.720659+0000","last_unstale":"2024-04-26T23:26:15.736102+0000","last_undegraded":"2024-04-26T23:26:15.736102+0000","last_fullsized":"2024-04-26T23:26:15.736102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736992+0000","last_change":"2024-04-26T23:26:14.746831+0000","last_active":"2024-04-26T23:26:15.736992+0000","last_peered":"2024-04-26T23:26:15.736992+0000","last_clean":"2024-04-26T23:26:15.736992+0000","last_became_active":"2024-04-26T23:26:14.746189+0000","last_became_peered":"2024-04-26T23:26:14.746189+0000","last_unstale":"2024-04-26T23:26:15.736992+0000","last_undegraded":"2024-04-26T23:26:15.736992+0000","last_fullsized":"2024-04-26T23:26:15.736992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:58.384739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723835+0000","last_change":"2024-04-26T23:26:13.716047+0000","last_active":"2024-04-26T23:26:15.723835+0000","last_peered":"2024-04-26T23:26:15.723835+0000","last_clean":"2024-04-26T23:26:15.723835+0000","last_became_active":"2024-04-26T23:26:13.715774+0000","last_became_peered":"2024-04-26T23:26:13.715774+0000","last_unstale":"2024-04-26T23:26:15.723835+0000","last_undegraded":"2024-04-26T23:26:15.723835+0000","last_fullsized":"2024-04-26T23:26:15.723835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725303+0000","last_change":"2024-04-26T23:26:14.723161+0000","last_active":"2024-04-26T23:26:15.725303+0000","last_peered":"2024-04-26T23:26:15.725303+0000","last_clean":"2024-04-26T23:26:15.725303+0000","last_became_active":"2024-04-26T23:26:14.722467+0000","last_became_peered":"2024-04-26T23:26:14.722467+0000","last_unstale":"2024-04-26T23:26:15.725303+0000","last_undegraded":"2024-04-26T23:26:15.725303+0000","last_fullsized":"2024-04-26T23:26:15.725303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735933+0000","last_change":"2024-04-26T23:26:13.723125+0000","last_active":"2024-04-26T23:26:15.735933+0000","last_peered":"2024-04-26T23:26:15.735933+0000","last_clean":"2024-04-26T23:26:15.735933+0000","last_became_active":"2024-04-26T23:26:13.722807+0000","last_became_peered":"2024-04-26T23:26:13.722807+0000","last_unstale":"2024-04-26T23:26:15.735933+0000","last_undegraded":"2024-04-26T23:26:15.735933+0000","last_fullsized":"2024-04-26T23:26:15.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736740+0000","last_change":"2024-04-26T23:26:14.736690+0000","last_active":"2024-04-26T23:26:15.736740+0000","last_peered":"2024-04-26T23:26:15.736740+0000","last_clean":"2024-04-26T23:26:15.736740+0000","last_became_active":"2024-04-26T23:26:14.736316+0000","last_became_peered":"2024-04-26T23:26:14.736316+0000","last_unstale":"2024-04-26T23:26:15.736740+0000","last_undegraded":"2024-04-26T23:26:15.736740+0000","last_fullsized":"2024-04-26T23:26:15.736740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736227+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:26:15.736227+0000","last_peered":"2024-04-26T23:26:15.736227+0000","last_clean":"2024-04-26T23:26:15.736227+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:26:15.736227+0000","last_undegraded":"2024-04-26T23:26:15.736227+0000","last_fullsized":"2024-04-26T23:26:15.736227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723256+0000","last_change":"2024-04-26T23:26:13.722340+0000","last_active":"2024-04-26T23:26:15.723256+0000","last_peered":"2024-04-26T23:26:15.723256+0000","last_clean":"2024-04-26T23:26:15.723256+0000","last_became_active":"2024-04-26T23:26:13.721645+0000","last_became_peered":"2024-04-26T23:26:13.721645+0000","last_unstale":"2024-04-26T23:26:15.723256+0000","last_undegraded":"2024-04-26T23:26:15.723256+0000","last_fullsized":"2024-04-26T23:26:15.723256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736573+0000","last_change":"2024-04-26T23:26:14.733211+0000","last_active":"2024-04-26T23:26:15.736573+0000","last_peered":"2024-04-26T23:26:15.736573+0000","last_clean":"2024-04-26T23:26:15.736573+0000","last_became_active":"2024-04-26T23:26:14.732931+0000","last_became_peered":"2024-04-26T23:26:14.732931+0000","last_unstale":"2024-04-26T23:26:15.736573+0000","last_undegraded":"2024-04-26T23:26:15.736573+0000","last_fullsized":"2024-04-26T23:26:15.736573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:13.726362+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:13.725944+0000","last_became_peered":"2024-04-26T23:26:13.725944+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735941+0000","last_change":"2024-04-26T23:26:14.715493+0000","last_active":"2024-04-26T23:26:15.735941+0000","last_peered":"2024-04-26T23:26:15.735941+0000","last_clean":"2024-04-26T23:26:15.735941+0000","last_became_active":"2024-04-26T23:26:14.715120+0000","last_became_peered":"2024-04-26T23:26:14.715120+0000","last_unstale":"2024-04-26T23:26:15.735941+0000","last_undegraded":"2024-04-26T23:26:15.735941+0000","last_fullsized":"2024-04-26T23:26:15.735941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:14.575559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735840+0000","last_change":"2024-04-26T23:26:13.718666+0000","last_active":"2024-04-26T23:26:15.735840+0000","last_peered":"2024-04-26T23:26:15.735840+0000","last_clean":"2024-04-26T23:26:15.735840+0000","last_became_active":"2024-04-26T23:26:13.718352+0000","last_became_peered":"2024-04-26T23:26:13.718352+0000","last_unstale":"2024-04-26T23:26:15.735840+0000","last_undegraded":"2024-04-26T23:26:15.735840+0000","last_fullsized":"2024-04-26T23:26:15.735840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723353+0000","last_change":"2024-04-26T23:26:14.731553+0000","last_active":"2024-04-26T23:26:15.723353+0000","last_peered":"2024-04-26T23:26:15.723353+0000","last_clean":"2024-04-26T23:26:15.723353+0000","last_became_active":"2024-04-26T23:26:14.730918+0000","last_became_peered":"2024-04-26T23:26:14.730918+0000","last_unstale":"2024-04-26T23:26:15.723353+0000","last_undegraded":"2024-04-26T23:26:15.723353+0000","last_fullsized":"2024-04-26T23:26:15.723353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724912+0000","last_change":"2024-04-26T23:26:13.727250+0000","last_active":"2024-04-26T23:26:15.724912+0000","last_peered":"2024-04-26T23:26:15.724912+0000","last_clean":"2024-04-26T23:26:15.724912+0000","last_became_active":"2024-04-26T23:26:13.726714+0000","last_became_peered":"2024-04-26T23:26:13.726714+0000","last_unstale":"2024-04-26T23:26:15.724912+0000","last_undegraded":"2024-04-26T23:26:15.724912+0000","last_fullsized":"2024-04-26T23:26:15.724912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724072+0000","last_change":"2024-04-26T23:26:14.730947+0000","last_active":"2024-04-26T23:26:15.724072+0000","last_peered":"2024-04-26T23:26:15.724072+0000","last_clean":"2024-04-26T23:26:15.724072+0000","last_became_active":"2024-04-26T23:26:14.730626+0000","last_became_peered":"2024-04-26T23:26:14.730626+0000","last_unstale":"2024-04-26T23:26:15.724072+0000","last_undegraded":"2024-04-26T23:26:15.724072+0000","last_fullsized":"2024-04-26T23:26:15.724072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723662+0000","last_change":"2024-04-26T23:26:13.723935+0000","last_active":"2024-04-26T23:26:15.723662+0000","last_peered":"2024-04-26T23:26:15.723662+0000","last_clean":"2024-04-26T23:26:15.723662+0000","last_became_active":"2024-04-26T23:26:13.723536+0000","last_became_peered":"2024-04-26T23:26:13.723536+0000","last_unstale":"2024-04-26T23:26:15.723662+0000","last_undegraded":"2024-04-26T23:26:15.723662+0000","last_fullsized":"2024-04-26T23:26:15.723662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723671+0000","last_change":"2024-04-26T23:26:14.725964+0000","last_active":"2024-04-26T23:26:15.723671+0000","last_peered":"2024-04-26T23:26:15.723671+0000","last_clean":"2024-04-26T23:26:15.723671+0000","last_became_active":"2024-04-26T23:26:14.724935+0000","last_became_peered":"2024-04-26T23:26:14.724935+0000","last_unstale":"2024-04-26T23:26:15.723671+0000","last_undegraded":"2024-04-26T23:26:15.723671+0000","last_fullsized":"2024-04-26T23:26:15.723671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736960+0000","last_change":"2024-04-26T23:26:13.728354+0000","last_active":"2024-04-26T23:26:15.736960+0000","last_peered":"2024-04-26T23:26:15.736960+0000","last_clean":"2024-04-26T23:26:15.736960+0000","last_became_active":"2024-04-26T23:26:13.727416+0000","last_became_peered":"2024-04-26T23:26:13.727416+0000","last_unstale":"2024-04-26T23:26:15.736960+0000","last_undegraded":"2024-04-26T23:26:15.736960+0000","last_fullsized":"2024-04-26T23:26:15.736960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:22.327383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723520+0000","last_change":"2024-04-26T23:26:14.728202+0000","last_active":"2024-04-26T23:26:15.723520+0000","last_peered":"2024-04-26T23:26:15.723520+0000","last_clean":"2024-04-26T23:26:15.723520+0000","last_became_active":"2024-04-26T23:26:14.725745+0000","last_became_peered":"2024-04-26T23:26:14.725745+0000","last_unstale":"2024-04-26T23:26:15.723520+0000","last_undegraded":"2024-04-26T23:26:15.723520+0000","last_fullsized":"2024-04-26T23:26:15.723520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723857+0000","last_change":"2024-04-26T23:26:13.734188+0000","last_active":"2024-04-26T23:26:15.723857+0000","last_peered":"2024-04-26T23:26:15.723857+0000","last_clean":"2024-04-26T23:26:15.723857+0000","last_became_active":"2024-04-26T23:26:13.733977+0000","last_became_peered":"2024-04-26T23:26:13.733977+0000","last_unstale":"2024-04-26T23:26:15.723857+0000","last_undegraded":"2024-04-26T23:26:15.723857+0000","last_fullsized":"2024-04-26T23:26:15.723857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737564+0000","last_change":"2024-04-26T23:26:14.743925+0000","last_active":"2024-04-26T23:26:15.737564+0000","last_peered":"2024-04-26T23:26:15.737564+0000","last_clean":"2024-04-26T23:26:15.737564+0000","last_became_active":"2024-04-26T23:26:14.743638+0000","last_became_peered":"2024-04-26T23:26:14.743638+0000","last_unstale":"2024-04-26T23:26:15.737564+0000","last_undegraded":"2024-04-26T23:26:15.737564+0000","last_fullsized":"2024-04-26T23:26:15.737564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735918+0000","last_change":"2024-04-26T23:26:13.734100+0000","last_active":"2024-04-26T23:26:15.735918+0000","last_peered":"2024-04-26T23:26:15.735918+0000","last_clean":"2024-04-26T23:26:15.735918+0000","last_became_active":"2024-04-26T23:26:13.733667+0000","last_became_peered":"2024-04-26T23:26:13.733667+0000","last_unstale":"2024-04-26T23:26:15.735918+0000","last_undegraded":"2024-04-26T23:26:15.735918+0000","last_fullsized":"2024-04-26T23:26:15.735918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736866+0000","last_change":"2024-04-26T23:26:14.734618+0000","last_active":"2024-04-26T23:26:15.736866+0000","last_peered":"2024-04-26T23:26:15.736866+0000","last_clean":"2024-04-26T23:26:15.736866+0000","last_became_active":"2024-04-26T23:26:14.734369+0000","last_became_peered":"2024-04-26T23:26:14.734369+0000","last_unstale":"2024-04-26T23:26:15.736866+0000","last_undegraded":"2024-04-26T23:26:15.736866+0000","last_fullsized":"2024-04-26T23:26:15.736866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736054+0000","last_change":"2024-04-26T23:26:13.730845+0000","last_active":"2024-04-26T23:26:15.736054+0000","last_peered":"2024-04-26T23:26:15.736054+0000","last_clean":"2024-04-26T23:26:15.736054+0000","last_became_active":"2024-04-26T23:26:13.730510+0000","last_became_peered":"2024-04-26T23:26:13.730510+0000","last_unstale":"2024-04-26T23:26:15.736054+0000","last_undegraded":"2024-04-26T23:26:15.736054+0000","last_fullsized":"2024-04-26T23:26:15.736054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723134+0000","last_change":"2024-04-26T23:26:14.729756+0000","last_active":"2024-04-26T23:26:15.723134+0000","last_peered":"2024-04-26T23:26:15.723134+0000","last_clean":"2024-04-26T23:26:15.723134+0000","last_became_active":"2024-04-26T23:26:14.729469+0000","last_became_peered":"2024-04-26T23:26:14.729469+0000","last_unstale":"2024-04-26T23:26:15.723134+0000","last_undegraded":"2024-04-26T23:26:15.723134+0000","last_fullsized":"2024-04-26T23:26:15.723134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:40.724145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723464+0000","last_change":"2024-04-26T23:26:13.732419+0000","last_active":"2024-04-26T23:26:15.723464+0000","last_peered":"2024-04-26T23:26:15.723464+0000","last_clean":"2024-04-26T23:26:15.723464+0000","last_became_active":"2024-04-26T23:26:13.732075+0000","last_became_peered":"2024-04-26T23:26:13.732075+0000","last_unstale":"2024-04-26T23:26:15.723464+0000","last_undegraded":"2024-04-26T23:26:15.723464+0000","last_fullsized":"2024-04-26T23:26:15.723464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735487+0000","last_change":"2024-04-26T23:26:14.734658+0000","last_active":"2024-04-26T23:26:15.735487+0000","last_peered":"2024-04-26T23:26:15.735487+0000","last_clean":"2024-04-26T23:26:15.735487+0000","last_became_active":"2024-04-26T23:26:14.734365+0000","last_became_peered":"2024-04-26T23:26:14.734365+0000","last_unstale":"2024-04-26T23:26:15.735487+0000","last_undegraded":"2024-04-26T23:26:15.735487+0000","last_fullsized":"2024-04-26T23:26:15.735487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:13.717076+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:13.716768+0000","last_became_peered":"2024-04-26T23:26:13.716768+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737169+0000","last_change":"2024-04-26T23:26:14.739852+0000","last_active":"2024-04-26T23:26:15.737169+0000","last_peered":"2024-04-26T23:26:15.737169+0000","last_clean":"2024-04-26T23:26:15.737169+0000","last_became_active":"2024-04-26T23:26:14.732086+0000","last_became_peered":"2024-04-26T23:26:14.732086+0000","last_unstale":"2024-04-26T23:26:15.737169+0000","last_undegraded":"2024-04-26T23:26:15.737169+0000","last_fullsized":"2024-04-26T23:26:15.737169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736729+0000","last_change":"2024-04-26T23:26:13.725980+0000","last_active":"2024-04-26T23:26:15.736729+0000","last_peered":"2024-04-26T23:26:15.736729+0000","last_clean":"2024-04-26T23:26:15.736729+0000","last_became_active":"2024-04-26T23:26:13.725692+0000","last_became_peered":"2024-04-26T23:26:13.725692+0000","last_unstale":"2024-04-26T23:26:15.736729+0000","last_undegraded":"2024-04-26T23:26:15.736729+0000","last_fullsized":"2024-04-26T23:26:15.736729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735910+0000","last_change":"2024-04-26T23:26:14.735387+0000","last_active":"2024-04-26T23:26:15.735910+0000","last_peered":"2024-04-26T23:26:15.735910+0000","last_clean":"2024-04-26T23:26:15.735910+0000","last_became_active":"2024-04-26T23:26:14.735036+0000","last_became_peered":"2024-04-26T23:26:14.735036+0000","last_unstale":"2024-04-26T23:26:15.735910+0000","last_undegraded":"2024-04-26T23:26:15.735910+0000","last_fullsized":"2024-04-26T23:26:15.735910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723581+0000","last_change":"2024-04-26T23:26:14.736310+0000","last_active":"2024-04-26T23:26:15.723581+0000","last_peered":"2024-04-26T23:26:15.723581+0000","last_clean":"2024-04-26T23:26:15.723581+0000","last_became_active":"2024-04-26T23:26:14.735927+0000","last_became_peered":"2024-04-26T23:26:14.735927+0000","last_unstale":"2024-04-26T23:26:15.723581+0000","last_undegraded":"2024-04-26T23:26:15.723581+0000","last_fullsized":"2024-04-26T23:26:15.723581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736622+0000","last_change":"2024-04-26T23:26:13.725017+0000","last_active":"2024-04-26T23:26:15.736622+0000","last_peered":"2024-04-26T23:26:15.736622+0000","last_clean":"2024-04-26T23:26:15.736622+0000","last_became_active":"2024-04-26T23:26:13.724363+0000","last_became_peered":"2024-04-26T23:26:13.724363+0000","last_unstale":"2024-04-26T23:26:15.736622+0000","last_undegraded":"2024-04-26T23:26:15.736622+0000","last_fullsized":"2024-04-26T23:26:15.736622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:46.949014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725323+0000","last_change":"2024-04-26T23:26:14.744041+0000","last_active":"2024-04-26T23:26:15.725323+0000","last_peered":"2024-04-26T23:26:15.725323+0000","last_clean":"2024-04-26T23:26:15.725323+0000","last_became_active":"2024-04-26T23:26:14.743726+0000","last_became_peered":"2024-04-26T23:26:14.743726+0000","last_unstale":"2024-04-26T23:26:15.725323+0000","last_undegraded":"2024-04-26T23:26:15.725323+0000","last_fullsized":"2024-04-26T23:26:15.725323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736853+0000","last_change":"2024-04-26T23:26:13.737149+0000","last_active":"2024-04-26T23:26:15.736853+0000","last_peered":"2024-04-26T23:26:15.736853+0000","last_clean":"2024-04-26T23:26:15.736853+0000","last_became_active":"2024-04-26T23:26:13.736573+0000","last_became_peered":"2024-04-26T23:26:13.736573+0000","last_unstale":"2024-04-26T23:26:15.736853+0000","last_undegraded":"2024-04-26T23:26:15.736853+0000","last_fullsized":"2024-04-26T23:26:15.736853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:50.948166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736769+0000","last_change":"2024-04-26T23:26:14.722451+0000","last_active":"2024-04-26T23:26:15.736769+0000","last_peered":"2024-04-26T23:26:15.736769+0000","last_clean":"2024-04-26T23:26:15.736769+0000","last_became_active":"2024-04-26T23:26:14.719570+0000","last_became_peered":"2024-04-26T23:26:14.719570+0000","last_unstale":"2024-04-26T23:26:15.736769+0000","last_undegraded":"2024-04-26T23:26:15.736769+0000","last_fullsized":"2024-04-26T23:26:15.736769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737451+0000","last_change":"2024-04-26T23:26:13.729916+0000","last_active":"2024-04-26T23:26:15.737451+0000","last_peered":"2024-04-26T23:26:15.737451+0000","last_clean":"2024-04-26T23:26:15.737451+0000","last_became_active":"2024-04-26T23:26:13.729382+0000","last_became_peered":"2024-04-26T23:26:13.729382+0000","last_unstale":"2024-04-26T23:26:15.737451+0000","last_undegraded":"2024-04-26T23:26:15.737451+0000","last_fullsized":"2024-04-26T23:26:15.737451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737423+0000","last_change":"2024-04-26T23:26:14.734991+0000","last_active":"2024-04-26T23:26:15.737423+0000","last_peered":"2024-04-26T23:26:15.737423+0000","last_clean":"2024-04-26T23:26:15.737423+0000","last_became_active":"2024-04-26T23:26:14.734727+0000","last_became_peered":"2024-04-26T23:26:14.734727+0000","last_unstale":"2024-04-26T23:26:15.737423+0000","last_undegraded":"2024-04-26T23:26:15.737423+0000","last_fullsized":"2024-04-26T23:26:15.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736858+0000","last_change":"2024-04-26T23:26:13.732964+0000","last_active":"2024-04-26T23:26:15.736858+0000","last_peered":"2024-04-26T23:26:15.736858+0000","last_clean":"2024-04-26T23:26:15.736858+0000","last_became_active":"2024-04-26T23:26:13.732485+0000","last_became_peered":"2024-04-26T23:26:13.732485+0000","last_unstale":"2024-04-26T23:26:15.736858+0000","last_undegraded":"2024-04-26T23:26:15.736858+0000","last_fullsized":"2024-04-26T23:26:15.736858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:26:19.243 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:26:19.243 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:26:19.243 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:26:19.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:26:19.243 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:26:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.413+0000 7f98c4a00640 1 Processor -- start 2024-04-26T23:26:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.413+0000 7f98c4a00640 1 -- start start 2024-04-26T23:26:19.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98c4a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f98c006fc80 0x7f98c00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98c4a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c0160060 con 0x7f98c0145820 2024-04-26T23:26:19.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98c4a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c0160340 con 0x7f98c00cf2a0 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98c4a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f98c00cd5c0 con 0x7f98c006fc80 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bde00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f98c0145820 0x7f98c00b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56476/0 (socket says 172.21.15.39:56476) 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bde00640 1 -- 172.21.15.39:0/1670532550 learned_addr learned my addr 172.21.15.39:0/1670532550 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439599845 0 0) 0x7f98c0160060 con 0x7f98c0145820 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a4003530 con 0x7f98c0145820 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98be800640 1 --2- 172.21.15.39:0/1670532550 >> v2:172.21.15.71:3300/0 conn(0x7f98c006fc80 0x7f98c00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505736602 0 0) 0x7f98a4003530 con 0x7f98c0145820 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 >> v2:172.21.15.71:3300/0 conn(0x7f98c006fc80 msgr2=0x7f98c00cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 --2- 172.21.15.39:0/1670532550 >> v2:172.21.15.71:3300/0 conn(0x7f98c006fc80 0x7f98c00cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 >> v1:172.21.15.71:6789/0 conn(0x7f98c00cf2a0 legacy=0x7f98c006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c0160620 con 0x7f98c0145820 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f98b0001680 con 0x7f98c0145820 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 >> v1:172.21.15.39:6789/0 conn(0x7f98c0145820 legacy=0x7f98c00b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98a40039c0 0x7f98a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a40051d0 0x7f98a400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00cd5c0 con 0x7f98a4004810 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98a400e280 con 0x7f98a40051d0 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f98a400e480 con 0x7f98a40039c0 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98bde00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98a40039c0 0x7f98a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98be800640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a40051d0 0x7f98a400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 -- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98a40039c0 msgr2=0x7f98a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98a40039c0 0x7f98a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 -- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a40051d0 msgr2=0x7f98a400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a40051d0 0x7f98a400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98b7e00640 1 -- 172.21.15.39:0/1670532550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a4003530 con 0x7f98a4004810 2024-04-26T23:26:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.417+0000 7f98be800640 1 -- 172.21.15.39:0/1670532550 reap_dead start 2024-04-26T23:26:19.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98b7e00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98a4004c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001780 tx=0x7f98a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a564f1ec77018a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80013a0 con 0x7f98a4004810 2024-04-26T23:26:19.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a80052f0 con 0x7f98a4004810 2024-04-26T23:26:19.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98bd400640 1 -- 172.21.15.39:0/1670532550 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003840 con 0x7f98a4004810 2024-04-26T23:26:19.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 -- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 msgr2=0x7f98a4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98a4004c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001780 tx=0x7f98a801c400 comp rx=0 tx=0).stop 2024-04-26T23:26:19.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 -- 172.21.15.39:0/1670532550 shutdown_connections 2024-04-26T23:26:19.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 --2- 172.21.15.39:0/1670532550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98a4004c90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 -- 172.21.15.39:0/1670532550 >> 172.21.15.39:0/1670532550 conn(0x7f98c00b2af0 msgr2=0x7f98c00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:19.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 -- 172.21.15.39:0/1670532550 shutdown_connections 2024-04-26T23:26:19.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.421+0000 7f98c4a00640 1 -- 172.21.15.39:0/1670532550 wait complete. 2024-04-26T23:26:19.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 Processor -- start 2024-04-26T23:26:19.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- start start 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98c013bb30 0x7f98c0140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98c0072560 0x7f98c0072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0145d80 con 0x7f98a4004810 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0145c00 con 0x7f98c0072560 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f98c015fc30 con 0x7f98c013bb30 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59060/0 (socket says 172.21.15.39:59060) 2024-04-26T23:26:19.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 -- 172.21.15.39:0/887392840 learned_addr learned my addr 172.21.15.39:0/887392840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98be800640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98c0072560 0x7f98c0072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98b7e00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98c013bb30 0x7f98c0140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 -- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98c013bb30 msgr2=0x7f98c0140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98c013bb30 0x7f98c0140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 -- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98c0072560 msgr2=0x7f98c0072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98c0072560 0x7f98c0072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 -- 172.21.15.39:0/887392840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c01f4f70 con 0x7f98a4004810 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98bde00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98b0012540 tx=0x7f98b0012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b001c070 con 0x7f98a4004810 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b0014830 con 0x7f98a4004810 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c01f51e0 con 0x7f98a4004810 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0014c20 con 0x7f98a4004810 2024-04-26T23:26:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c01f5760 con 0x7f98a4004810 2024-04-26T23:26:19.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.425+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c0050740 con 0x7f98a4004810 2024-04-26T23:26:19.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.429+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98b001f070 con 0x7f98a4004810 2024-04-26T23:26:19.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.429+0000 7f98b6000640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 0x7f989c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.429+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f98b0089400 con 0x7f98a4004810 2024-04-26T23:26:19.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.429+0000 7f98b7e00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 0x7f989c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.429+0000 7f98b7e00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 0x7f989c06a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001750 tx=0x7f98a80011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.433+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f98b0059920 con 0x7f98a4004810 2024-04-26T23:26:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.637+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f98c006f460 con 0x7f98a4004810 2024-04-26T23:26:19.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.641+0000 7f98b6000640 1 -- 172.21.15.39:0/887392840 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168083 (secure 0 0 0) 0x7f98b0059220 con 0x7f98a4004810 2024-04-26T23:26:19.648 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 msgr2=0x7f989c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 0x7f989c06a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001750 tx=0x7f98a80011a0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 msgr2=0x7f98c0140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98b0012540 tx=0x7f98b0012a00 comp rx=0 tx=0).stop 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 shutdown_connections 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f989c0683b0 0x7f989c06a870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98c0072560 0x7f98c0072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98c013bb30 0x7f98c0140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 --2- 172.21.15.39:0/887392840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98a4004810 0x7f98c0140730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 >> 172.21.15.39:0/887392840 conn(0x7f98c00b2af0 msgr2=0x7f98c00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:19.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 shutdown_connections 2024-04-26T23:26:19.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.645+0000 7f98c4a00640 1 -- 172.21.15.39:0/887392840 wait complete. 2024-04-26T23:26:19.669 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4212401484},{"type":"v1","addr":"172.21.15.71:6833","nonce":4212401484}]},"active_addr":"172.21.15.71:6833/4212401484","active_change":"2024-04-26T23:25:53.642579+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1077394975}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":41432616}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3805822812}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4103088875}]}]} 2024-04-26T23:26:19.672 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:26:19.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:26:19.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:19.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 Processor -- start 2024-04-26T23:26:19.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 -- start start 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80f015f240 0x7f80f00d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 0x7f80f00cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f80f00d0b80 con 0x7f80f015f240 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f80f00d2cb0 con 0x7f80f00d27d0 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f8800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f80f00d0e40 con 0x7f80f00b4b10 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80f015f240 0x7f80f00d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80f015f240 0x7f80f00d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59070/0 (socket says 172.21.15.39:59070) 2024-04-26T23:26:19.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 -- 172.21.15.39:0/3047684831 learned_addr learned my addr 172.21.15.39:0/3047684831 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5400640 1 --2- 172.21.15.39:0/3047684831 >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 0x7f80f00cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 -- 172.21.15.39:0/3047684831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 msgr2=0x7f80f00b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f6800640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 -- 172.21.15.39:0/3047684831 >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 msgr2=0x7f80f00cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 --2- 172.21.15.39:0/3047684831 >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 0x7f80f00cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5e00640 1 -- 172.21.15.39:0/3047684831 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f00d1120 con 0x7f80f015f240 2024-04-26T23:26:19.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f5400640 1 --2- 172.21.15.39:0/3047684831 >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 0x7f80f00cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:19.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.809+0000 7f80f6800640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:19.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f5e00640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f015f240 0x7f80f00d03d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80f0070f90 tx=0x7f80e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1868b674a3a2f783 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f4a00640 1 -- 172.21.15.39:0/3047684831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e40b0070 con 0x7f80f015f240 2024-04-26T23:26:19.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f4a00640 1 -- 172.21.15.39:0/3047684831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e40ab600 con 0x7f80f015f240 2024-04-26T23:26:19.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f4a00640 1 -- 172.21.15.39:0/3047684831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e40ab9d0 con 0x7f80f015f240 2024-04-26T23:26:19.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 -- 172.21.15.39:0/3047684831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f015f240 msgr2=0x7f80f00d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f015f240 0x7f80f00d03d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80f0070f90 tx=0x7f80e401c520 comp rx=0 tx=0).stop 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 -- 172.21.15.39:0/3047684831 shutdown_connections 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 --2- 172.21.15.39:0/3047684831 >> v2:172.21.15.71:3300/0 conn(0x7f80f00d27d0 0x7f80f00cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 --2- 172.21.15.39:0/3047684831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f015f240 0x7f80f00d03d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 -- 172.21.15.39:0/3047684831 >> 172.21.15.39:0/3047684831 conn(0x7f80f0068140 msgr2=0x7f80f0068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 -- 172.21.15.39:0/3047684831 shutdown_connections 2024-04-26T23:26:19.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.813+0000 7f80f8800640 1 -- 172.21.15.39:0/3047684831 wait complete. 2024-04-26T23:26:19.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 Processor -- start 2024-04-26T23:26:19.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- start start 2024-04-26T23:26:19.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 0x7f80f01fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f80f0163c90 con 0x7f80f00d27d0 2024-04-26T23:26:19.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80f0163b10 con 0x7f80f015f240 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f80f0163e10 con 0x7f80f00b4b10 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59082/0 (socket says 172.21.15.39:59082) 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 -- 172.21.15.39:0/735707622 learned_addr learned my addr 172.21.15.39:0/735707622 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f6800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 0x7f80f01fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5e00640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 -- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 msgr2=0x7f80f00b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 -- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 msgr2=0x7f80f01fbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:19.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 0x7f80f01fbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 -- 172.21.15.39:0/735707622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f00b7700 con 0x7f80f00d27d0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f6800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 0x7f80f01fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f5400640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c820 tx=0x7f80e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e0015070 con 0x7f80f00d27d0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e0007a30 con 0x7f80f00d27d0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f0157740 con 0x7f80f00d27d0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e0007e40 con 0x7f80f00d27d0 2024-04-26T23:26:19.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.817+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f0160800 con 0x7f80f00d27d0 2024-04-26T23:26:19.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.821+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f0050740 con 0x7f80f00d27d0 2024-04-26T23:26:19.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.821+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80e0018070 con 0x7f80f00d27d0 2024-04-26T23:26:19.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.821+0000 7f80ea000640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 0x7f80d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:19.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.821+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f80e0086860 con 0x7f80f00d27d0 2024-04-26T23:26:19.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.821+0000 7f80f5e00640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 0x7f80d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:19.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.825+0000 7f80f5e00640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 0x7f80d406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f80e40ad000 tx=0x7f80e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:19.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.825+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f80e0056730 con 0x7f80f00d27d0 2024-04-26T23:26:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.993+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80f00c98a0 con 0x7f80f00d27d0 2024-04-26T23:26:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.993+0000 7f80ea000640 1 -- 172.21.15.39:0/735707622 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f80e005aa30 con 0x7f80f00d27d0 2024-04-26T23:26:19.999 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:19.999 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 msgr2=0x7f80d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 0x7f80d406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f80e40ad000 tx=0x7f80e4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 msgr2=0x7f80f01fb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c820 tx=0x7f80e000cce0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 shutdown_connections 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f80d4068380 0x7f80d406a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f015f240 0x7f80f01fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80f00d27d0 0x7f80f01fb790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 --2- 172.21.15.39:0/735707622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80f00b4b10 0x7f80f00b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 >> 172.21.15.39:0/735707622 conn(0x7f80f0068140 msgr2=0x7f80f00cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 shutdown_connections 2024-04-26T23:26:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:19.997+0000 7f80f8800640 1 -- 172.21.15.39:0/735707622 wait complete. 2024-04-26T23:26:20.021 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:26:20.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 Processor -- start 2024-04-26T23:26:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 -- start start 2024-04-26T23:26:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b1c15f500 0x7f4b1c0d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1c163ce0 con 0x7f4b1c0b4b10 2024-04-26T23:26:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1c0d1390 con 0x7f4b1c15f500 2024-04-26T23:26:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b21400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c0d0b80 con 0x7f4b1c0b7250 2024-04-26T23:26:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b1c15f500 0x7f4b1c0d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b1c15f500 0x7f4b1c0d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34682/0 (socket says 172.21.15.39:34682) 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 -- 172.21.15.39:0/3921496848 learned_addr learned my addr 172.21.15.39:0/3921496848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b13e00640 1 --1- 172.21.15.39:0/3921496848 >> v1:172.21.15.71:6789/0 conn(0x7f4b1c0b4b10 0x7f4b1c06d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40242/0 (socket says 172.21.15.39:40242) 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 -- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 msgr2=0x7f4b1c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 --2- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.157+0000 7f4b1a800640 1 -- 172.21.15.39:0/3921496848 >> v1:172.21.15.71:6789/0 conn(0x7f4b1c0b4b10 legacy=0x7f4b1c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b1a800640 1 -- 172.21.15.39:0/3921496848 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c0d0dd0 con 0x7f4b1c15f500 2024-04-26T23:26:20.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b1a800640 1 --2- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c15f500 0x7f4b1c0d27b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49d365e284697a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b19e00640 1 -- 172.21.15.39:0/3921496848 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0b0070 con 0x7f4b1c15f500 2024-04-26T23:26:20.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b19e00640 1 -- 172.21.15.39:0/3921496848 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0ab600 con 0x7f4b1c15f500 2024-04-26T23:26:20.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b19e00640 1 -- 172.21.15.39:0/3921496848 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab9d0 con 0x7f4b1c15f500 2024-04-26T23:26:20.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 -- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c15f500 msgr2=0x7f4b1c0d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 --2- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c15f500 0x7f4b1c0d27b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c440 comp rx=0 tx=0).stop 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 -- 172.21.15.39:0/3921496848 shutdown_connections 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 --2- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 --2- 172.21.15.39:0/3921496848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c15f500 0x7f4b1c0d27b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 -- 172.21.15.39:0/3921496848 >> 172.21.15.39:0/3921496848 conn(0x7f4b1c068140 msgr2=0x7f4b1c068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 -- 172.21.15.39:0/3921496848 shutdown_connections 2024-04-26T23:26:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.161+0000 7f4b21400640 1 -- 172.21.15.39:0/3921496848 wait complete. 2024-04-26T23:26:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 Processor -- start 2024-04-26T23:26:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- start start 2024-04-26T23:26:20.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0b4b10 0x7f4b1c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c163ac0 con 0x7f4b1c15f500 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c163940 con 0x7f4b1c0b4b10 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c16c2d0 con 0x7f4b1c0b7250 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47340/0 (socket says 172.21.15.39:47340) 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 -- 172.21.15.39:0/2499573906 learned_addr learned my addr 172.21.15.39:0/2499573906 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b13e00640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1a800640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0b4b10 0x7f4b1c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 -- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 msgr2=0x7f4b1c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 -- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0b4b10 msgr2=0x7f4b1c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0b4b10 0x7f4b1c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 -- 172.21.15.39:0/2499573906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c160a40 con 0x7f4b1c15f500 2024-04-26T23:26:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b1b200640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400efc0 tx=0x7f4b1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14018020 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b14014480 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14009e60 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c162420 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.165+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c162080 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1c0715e0 con 0x7f4b1c15f500 2024-04-26T23:26:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b1401b020 con 0x7f4b1c15f500 2024-04-26T23:26:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b12a00640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 0x7f4af806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b14087690 con 0x7f4b1c15f500 2024-04-26T23:26:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b1a800640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 0x7f4af806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.169+0000 7f4b1a800640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 0x7f4af806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad000 tx=0x7f4b0c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.173+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4b14022030 con 0x7f4b1c15f500 2024-04-26T23:26:20.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.337+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b1c050740 con 0x7f4b1c15f500 2024-04-26T23:26:20.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b12a00640 1 -- 172.21.15.39:0/2499573906 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f4b14010040 con 0x7f4b1c15f500 2024-04-26T23:26:20.344 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:20.344 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 msgr2=0x7f4af806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 0x7f4af806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad000 tx=0x7f4b0c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 msgr2=0x7f4b1c151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400efc0 tx=0x7f4b1400c490 comp rx=0 tx=0).stop 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 shutdown_connections 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4af8068380 0x7f4af806a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b1c15f500 0x7f4b1c151b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b1c0b7250 0x7f4b1c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 --2- 172.21.15.39:0/2499573906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c0b4b10 0x7f4b1c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 >> 172.21.15.39:0/2499573906 conn(0x7f4b1c068140 msgr2=0x7f4b1c0b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 shutdown_connections 2024-04-26T23:26:20.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.341+0000 7f4b21400640 1 -- 172.21.15.39:0/2499573906 wait complete. 2024-04-26T23:26:20.365 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:26:20.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:26:20.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:26:20.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:26:20.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:26:20.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:26:20.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:26:20.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:26:20.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.605+0000 7f063fe00640 1 Processor -- start 2024-04-26T23:26:20.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.605+0000 7f063fe00640 1 -- start start 2024-04-26T23:26:20.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.605+0000 7fb81ca00640 1 Processor -- start 2024-04-26T23:26:20.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.605+0000 7fb81ca00640 1 -- start start 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400c5d70 0x7f06400b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f06400d38c0 0x7f06400cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063fe00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06400b2820 con 0x7f06400b3e40 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063fe00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f06400b3430 con 0x7f06400d38c0 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f06400b2b00 con 0x7f06400c5d70 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f06400b3e40 0x7f06400c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60804/0 (socket says 172.21.15.39:60804) 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063e000640 1 -- 172.21.15.39:0/184039158 learned_addr learned my addr 172.21.15.39:0/184039158 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:20.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063f400640 1 --2- 172.21.15.39:0/184039158 >> v2:172.21.15.39:3300/0 conn(0x7f06400d38c0 0x7f06400cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb81ca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb81806f9c0 0x7fb8180b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb81ca00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81815c660 con 0x7fb8180b3530 2024-04-26T23:26:20.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb81ca00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81815b8a0 con 0x7fb8181558a0 2024-04-26T23:26:20.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb81ca00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb81815bb80 con 0x7fb81806f9c0 2024-04-26T23:26:20.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063f400640 1 -- 172.21.15.39:0/184039158 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400c5d70 msgr2=0x7f06400b38c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:26:20.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063f400640 1 --2- 172.21.15.39:0/184039158 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400c5d70 0x7f06400b38c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063f400640 1 -- 172.21.15.39:0/184039158 >> v1:172.21.15.39:6789/0 conn(0x7f06400b3e40 legacy=0x7f06400c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb816800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb8180b3530 0x7fb8180b6310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60814/0 (socket says 172.21.15.39:60814) 2024-04-26T23:26:20.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb816800640 1 -- 172.21.15.39:0/361732843 learned_addr learned my addr 172.21.15.39:0/361732843 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:20.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7f063f400640 1 -- 172.21.15.39:0/184039158 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06400b2de0 con 0x7f06400d38c0 2024-04-26T23:26:20.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.609+0000 7fb815400640 1 --2- 172.21.15.39:0/361732843 >> v2:172.21.15.71:3300/0 conn(0x7fb81806f9c0 0x7fb8180b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7fb815400640 1 -- 172.21.15.39:0/361732843 >> v1:172.21.15.71:6789/0 conn(0x7fb8181558a0 legacy=0x7fb81806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7fb815400640 1 -- 172.21.15.39:0/361732843 >> v1:172.21.15.39:6789/0 conn(0x7fb8180b3530 legacy=0x7fb8180b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7fb815400640 1 -- 172.21.15.39:0/361732843 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81815be60 con 0x7fb81806f9c0 2024-04-26T23:26:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7f063f400640 1 --2- 172.21.15.39:0/184039158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400d38c0 0x7f06400cd3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0638009d90 tx=0x7f063801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45329a72e5e4c06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7f063d600640 1 -- 172.21.15.39:0/184039158 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380b2070 con 0x7f06400d38c0 2024-04-26T23:26:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.613+0000 7f063d600640 1 -- 172.21.15.39:0/184039158 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380a5850 con 0x7f06400d38c0 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063d600640 1 -- 172.21.15.39:0/184039158 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380a5c20 con 0x7f06400d38c0 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 -- 172.21.15.39:0/184039158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400d38c0 msgr2=0x7f06400cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 --2- 172.21.15.39:0/184039158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400d38c0 0x7f06400cd3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0638009d90 tx=0x7f063801c990 comp rx=0 tx=0).stop 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 -- 172.21.15.39:0/184039158 shutdown_connections 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 --2- 172.21.15.39:0/184039158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400d38c0 0x7f06400cd3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 --2- 172.21.15.39:0/184039158 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400c5d70 0x7f06400b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 -- 172.21.15.39:0/184039158 >> 172.21.15.39:0/184039158 conn(0x7f06400d2da0 msgr2=0x7f06400d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 -- 172.21.15.39:0/184039158 shutdown_connections 2024-04-26T23:26:20.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 -- 172.21.15.39:0/184039158 wait complete. 2024-04-26T23:26:20.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7fb815400640 1 --2- 172.21.15.39:0/361732843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb8180b5dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8080097c0 tx=0x7fb80801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4964e9e2dadc1680 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7fb814a00640 1 -- 172.21.15.39:0/361732843 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080b0070 con 0x7fb81806f9c0 2024-04-26T23:26:20.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7fb814a00640 1 -- 172.21.15.39:0/361732843 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8080ab600 con 0x7fb81806f9c0 2024-04-26T23:26:20.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7fb814a00640 1 -- 172.21.15.39:0/361732843 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080ab9d0 con 0x7fb81806f9c0 2024-04-26T23:26:20.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.617+0000 7f063fe00640 1 Processor -- start 2024-04-26T23:26:20.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 -- start start 2024-04-26T23:26:20.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 -- 172.21.15.39:0/361732843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 msgr2=0x7fb8180b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 --2- 172.21.15.39:0/361732843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb8180b5dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8080097c0 tx=0x7fb80801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06400b3e40 0x7f06400c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f1e6b200640 1 Processor -- start 2024-04-26T23:26:20.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400c5d70 0x7f06401612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 0x7f0640149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f1e6b200640 1 -- start start 2024-04-26T23:26:20.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0640170670 con 0x7f06400c5d70 2024-04-26T23:26:20.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06401704f0 con 0x7f06400b3e40 2024-04-26T23:26:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f06401707f0 con 0x7f06400d38c0 2024-04-26T23:26:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 0x7f0640149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 0x7f0640149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45254/0 (socket says 172.21.15.39:45254) 2024-04-26T23:26:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063f400640 1 -- 172.21.15.39:0/3744053332 learned_addr learned my addr 172.21.15.39:0/3744053332 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 -- 172.21.15.39:0/361732843 shutdown_connections 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 --2- 172.21.15.39:0/361732843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb8180b5dd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 -- 172.21.15.39:0/361732843 >> 172.21.15.39:0/361732843 conn(0x7fb8180b2a10 msgr2=0x7fb8180b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7f063e000640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400c5d70 0x7f06401612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 -- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06400b3e40 msgr2=0x7f06400c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063ea00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06400b3e40 0x7f06400c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 -- 172.21.15.39:0/361732843 shutdown_connections 2024-04-26T23:26:20.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.621+0000 7fb81ca00640 1 -- 172.21.15.39:0/361732843 wait complete. 2024-04-26T23:26:20.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06400b3e40 0x7f06400c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 -- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400c5d70 msgr2=0x7f06401612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06400c5d70 0x7f06401612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064015f9b0 con 0x7f06400d38c0 2024-04-26T23:26:20.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e6b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e640d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e6b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e640d1720 0x7f1e640b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e6b200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e640d1b70 con 0x7f1e6414d140 2024-04-26T23:26:20.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e6b200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6406eb70 con 0x7f1e640d1720 2024-04-26T23:26:20.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e6b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6406ee40 con 0x7f1e64163c70 2024-04-26T23:26:20.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e640d1720 0x7f1e640b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063f400640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 0x7f0640149d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f063801a5c0 tx=0x7f0638019730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e640d1720 0x7f1e640b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34702/0 (socket says 172.21.15.39:34702) 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 -- 172.21.15.39:0/3022188421 learned_addr learned my addr 172.21.15.39:0/3022188421 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e63400640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e640d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 -- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 msgr2=0x7f1e640d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e640d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 -- 172.21.15.39:0/3022188421 >> v1:172.21.15.71:6789/0 conn(0x7f1e6414d140 legacy=0x7f1e6406e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f1e69200640 1 -- 172.21.15.39:0/3022188421 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6406f120 con 0x7f1e640d1720 2024-04-26T23:26:20.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380b2040 con 0x7f06400d38c0 2024-04-26T23:26:20.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064015fc90 con 0x7f06400d38c0 2024-04-26T23:26:20.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7fb81ca00640 1 Processor -- start 2024-04-26T23:26:20.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7fb81ca00640 1 -- start start 2024-04-26T23:26:20.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06400c7e30 con 0x7f06400d38c0 2024-04-26T23:26:20.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380bf070 con 0x7f06400d38c0 2024-04-26T23:26:20.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380b88b0 con 0x7f06400d38c0 2024-04-26T23:26:20.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb81815e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180b3530 0x7fb81814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f0edae00640 1 Processor -- start 2024-04-26T23:26:20.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.625+0000 7f0edae00640 1 -- start start 2024-04-26T23:26:20.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8181558a0 0x7fb818071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0618001040 con 0x7f06400d38c0 2024-04-26T23:26:20.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff907a00640 1 Processor -- start 2024-04-26T23:26:20.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181646b0 con 0x7fb8180b3530 2024-04-26T23:26:20.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb818164530 con 0x7fb81806f9c0 2024-04-26T23:26:20.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb818164830 con 0x7fb8181558a0 2024-04-26T23:26:20.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb81815e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb81815e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34710/0 (socket says 172.21.15.39:34710) 2024-04-26T23:26:20.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 -- 172.21.15.39:0/154365047 learned_addr learned my addr 172.21.15.39:0/154365047 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb816800640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8181558a0 0x7fb818071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff907a00640 1 -- start start 2024-04-26T23:26:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0edae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0edae00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ed40d56a0 0x7f0ed40b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0edae00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed40d3a80 con 0x7f0ed4163b50 2024-04-26T23:26:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0edae00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed4163f30 con 0x7f0ed40d56a0 2024-04-26T23:26:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0edae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed40d5b50 con 0x7f0ed40cfe60 2024-04-26T23:26:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 -- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8181558a0 msgr2=0x7fb818071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb8181558a0 0x7fb818071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 -- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180b3530 msgr2=0x7fb81814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180b3530 0x7fb81814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45278/0 (socket says 172.21.15.39:45278) 2024-04-26T23:26:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 -- 172.21.15.39:0/2096281005 learned_addr learned my addr 172.21.15.39:0/2096281005 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81814ef60 con 0x7fb81806f9c0 2024-04-26T23:26:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ed8e00640 1 --2- 172.21.15.39:0/2096281005 >> v2:172.21.15.39:3300/0 conn(0x7f0ed40d56a0 0x7f0ed40b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb815e00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb81815e1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c440 tx=0x7fb80400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017070 con 0x7fb81806f9c0 2024-04-26T23:26:20.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8040052f0 con 0x7fb81806f9c0 2024-04-26T23:26:20.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804003840 con 0x7fb81806f9c0 2024-04-26T23:26:20.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 -- 172.21.15.39:0/2096281005 >> v2:172.21.15.39:3300/0 conn(0x7f0ed40d56a0 msgr2=0x7f0ed40b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 --2- 172.21.15.39:0/2096281005 >> v2:172.21.15.39:3300/0 conn(0x7f0ed40d56a0 0x7f0ed40b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 -- 172.21.15.39:0/2096281005 >> v1:172.21.15.71:6789/0 conn(0x7f0ed4163b50 legacy=0x7f0ed40d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0ecbe00640 1 -- 172.21.15.39:0/2096281005 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed40d3d60 con 0x7f0ed40cfe60 2024-04-26T23:26:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb818157920 con 0x7fb81806f9c0 2024-04-26T23:26:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb818159a90 con 0x7fb81806f9c0 2024-04-26T23:26:20.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff907a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff90015afc0 0x7ff90015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f1e69200640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b4c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009870 tx=0x7f1e5001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4dfd4d1529e8660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff907a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9000d0890 0x7ff90015f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff905000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff90015afc0 0x7ff90015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7ff905000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff90015afc0 0x7ff90015ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47382/0 (socket says 172.21.15.39:47382) 2024-04-26T23:26:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7fe0e9a00640 1 Processor -- start 2024-04-26T23:26:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 -- 172.21.15.39:0/2602172384 learned_addr learned my addr 172.21.15.39:0/2602172384 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff907a00640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9000b3200 0x7ff9000b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7f0001040 con 0x7fb81806f9c0 2024-04-26T23:26:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff90015fc60 con 0x7ff90015afc0 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff9000739c0 con 0x7ff9000d0890 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff900073ca0 con 0x7ff9000b3200 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e62a00640 1 -- 172.21.15.39:0/3022188421 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e500b1070 con 0x7f1e640d1720 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e62a00640 1 -- 172.21.15.39:0/3022188421 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e500ac620 con 0x7f1e640d1720 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e62a00640 1 -- 172.21.15.39:0/3022188421 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e500ac9f0 con 0x7f1e640d1720 2024-04-26T23:26:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.629+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06380b8a50 con 0x7f06400d38c0 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905a00640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9000b3200 0x7ff9000b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 -- 172.21.15.39:0/2602172384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9000b3200 msgr2=0x7ff9000b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9000b3200 0x7ff9000b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 -- 172.21.15.39:0/2602172384 >> v2:172.21.15.71:3300/0 conn(0x7ff9000d0890 msgr2=0x7ff90015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 --2- 172.21.15.39:0/2602172384 >> v2:172.21.15.71:3300/0 conn(0x7ff9000d0890 0x7ff90015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7ff905000640 1 -- 172.21.15.39:0/2602172384 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff900073f80 con 0x7ff90015afc0 2024-04-26T23:26:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0636a00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f06200683b0 0x7f062006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0638121790 con 0x7f06400d38c0 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f063ea00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f06200683b0 0x7f062006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0636a00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f06200705d0 0x7f06200729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 -- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 msgr2=0x7f1e640b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b4c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009870 tx=0x7f1e5001c4f0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06380c2e50 con 0x7f06200705d0 2024-04-26T23:26:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0638128050 con 0x7f06400d38c0 2024-04-26T23:26:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7fe0e9a00640 1 -- start start 2024-04-26T23:26:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 -- 172.21.15.39:0/3022188421 shutdown_connections 2024-04-26T23:26:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b4c50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 --2- 172.21.15.39:0/3022188421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e640d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 -- 172.21.15.39:0/3022188421 >> 172.21.15.39:0/3022188421 conn(0x7f1e6406c7d0 msgr2=0x7f1e6406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f38c7000640 1 Processor -- start 2024-04-26T23:26:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f38c7000640 1 -- start start 2024-04-26T23:26:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f063e000640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f06200705d0 0x7f06200729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f063ea00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f06200683b0 0x7f062006a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a7d0 tx=0x7f062c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb80401a070 con 0x7fb81806f9c0 2024-04-26T23:26:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 -- 172.21.15.39:0/3022188421 shutdown_connections 2024-04-26T23:26:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f1e6b200640 1 -- 172.21.15.39:0/3022188421 wait complete. 2024-04-26T23:26:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f0ecbe00640 1 --2- 172.21.15.39:0/2096281005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009870 tx=0x7f0ebc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0d9d79bd860741 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f2335c00640 1 Processor -- start 2024-04-26T23:26:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.633+0000 7f38c7000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f38c0069ba0 0x7f38c00743d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38c7000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c015bdc0 con 0x7f38c00701d0 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38c7000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c015c0a0 con 0x7f38c006fd60 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38c7000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f38c0162320 con 0x7f38c0069ba0 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0ed3400640 1 -- 172.21.15.39:0/2096281005 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0b1070 con 0x7f0ed40cfe60 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0ed3400640 1 -- 172.21.15.39:0/2096281005 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0ac630 con 0x7f0ed40cfe60 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0ed3400640 1 -- 172.21.15.39:0/2096281005 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0b1070 con 0x7f0ed40cfe60 2024-04-26T23:26:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb80e000640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7f80683b0 0x7fb7f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335c00640 1 -- start start 2024-04-26T23:26:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e9a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0e4163c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f063e000640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f06200705d0 0x7f06200729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb804085bf0 con 0x7fb81806f9c0 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb80e000640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7fb7f8070550 0x7fb7f8072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb80401ae50 con 0x7fb7f8070550 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb804051c20 con 0x7fb81806f9c0 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb815400640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7f80683b0 0x7fb7f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0e4163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0e4163c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45290/0 (socket says 172.21.15.39:45290) 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bfe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f38c0069ba0 0x7f38c00743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38c5000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f38c00701d0 0x7f38c006e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60816/0 (socket says 172.21.15.39:60816) 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38c5000640 1 -- 172.21.15.39:0/652230797 learned_addr learned my addr 172.21.15.39:0/652230797 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bfe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f38c0069ba0 0x7f38c00743d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34738/0 (socket says 172.21.15.39:34738) 2024-04-26T23:26:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f1e6b200640 1 Processor -- start 2024-04-26T23:26:20.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb816800640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7fb7f8070550 0x7fb7f8072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e9a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e406ee40 con 0x7fe0e40d18f0 2024-04-26T23:26:20.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e9a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e406f120 con 0x7fe0e406e460 2024-04-26T23:26:20.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e9a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e41641b0 con 0x7fe0e414d140 2024-04-26T23:26:20.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e2000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe0e406e460 0x7fe0e40d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40292/0 (socket says 172.21.15.39:40292) 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fe0e2000640 1 -- 172.21.15.39:0/676892105 learned_addr learned my addr 172.21.15.39:0/676892105 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f1e6b200640 1 -- start start 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f233006e2d0 0x7f233015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23300b5250 con 0x7f2330073550 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23300b5530 con 0x7f233006cae0 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f23300b5810 con 0x7f233006e2d0 2024-04-26T23:26:20.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bea00640 1 -- 172.21.15.39:0/652230797 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135031342 0 0) 0x7f38c015c0a0 con 0x7f38c006fd60 2024-04-26T23:26:20.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bea00640 1 -- 172.21.15.39:0/652230797 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a4003530 con 0x7f38c006fd60 2024-04-26T23:26:20.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 -- 172.21.15.39:0/2096281005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 msgr2=0x7f0ed40d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 --2- 172.21.15.39:0/2096281005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009870 tx=0x7f0ebc01c520 comp rx=0 tx=0).stop 2024-04-26T23:26:20.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7ff905000640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff90015afc0 0x7ff90015ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b5ea0 tx=0x7ff8f801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d3dc1726dfb356 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 -- 172.21.15.39:0/2096281005 shutdown_connections 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 --2- 172.21.15.39:0/2096281005 >> v2:172.21.15.39:3300/0 conn(0x7f0ed40d56a0 0x7f0ed40b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb815400640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7f80683b0 0x7fb7f806a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8080ad000 tx=0x7fb808004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7fb816800640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7fb7f8070550 0x7fb7f8072970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 --2- 172.21.15.39:0/2096281005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40cfe60 0x7f0ed40d5160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 -- 172.21.15.39:0/2096281005 >> 172.21.15.39:0/2096281005 conn(0x7f0ed408ec00 msgr2=0x7f0ed409e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bfe00640 1 -- 172.21.15.39:0/652230797 >> v1:172.21.15.71:6789/0 conn(0x7f38c006fd60 legacy=0x7f38c00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bfe00640 1 -- 172.21.15.39:0/652230797 >> v1:172.21.15.39:6789/0 conn(0x7f38c00701d0 legacy=0x7f38c006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f232fe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f233006cae0 0x7f233015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40296/0 (socket says 172.21.15.39:40296) 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f232fe00640 1 -- 172.21.15.39:0/2057118454 learned_addr learned my addr 172.21.15.39:0/2057118454 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2335200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2330073550 0x7f2330072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60830/0 (socket says 172.21.15.39:60830) 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2327400640 1 --2- 172.21.15.39:0/2057118454 >> v2:172.21.15.71:3300/0 conn(0x7f233006e2d0 0x7f233015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 -- 172.21.15.39:0/2096281005 shutdown_connections 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f232f400640 1 -- 172.21.15.39:0/2057118454 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141006804 0 0) 0x7f23300b5530 con 0x7f233006cae0 2024-04-26T23:26:20.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f232f400640 1 -- 172.21.15.39:0/2057118454 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2314003530 con 0x7f233006cae0 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2327400640 1 -- 172.21.15.39:0/2057118454 >> v1:172.21.15.71:6789/0 conn(0x7f233006cae0 legacy=0x7f233015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2327400640 1 -- 172.21.15.39:0/2057118454 >> v1:172.21.15.39:6789/0 conn(0x7f2330073550 legacy=0x7f2330072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f2327400640 1 -- 172.21.15.39:0/2057118454 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23300b5af0 con 0x7f233006e2d0 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== osd.0 v2:172.21.15.39:6800/3002752600 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06380c2e50 con 0x7f06200705d0 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e6414d140 0x7f1e6414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226880585 0 0) 0x7fe0e406f120 con 0x7fe0e406e460 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c8003530 con 0x7fe0e406e460 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 435702313 0 0) 0x7fe0c8003530 con 0x7fe0e406e460 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 msgr2=0x7fe0e4163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0e4163c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 >> v1:172.21.15.39:6789/0 conn(0x7fe0e40d18f0 legacy=0x7fe0e40b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f0edae00640 1 -- 172.21.15.39:0/2096281005 wait complete. 2024-04-26T23:26:20.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7ff8ff400640 1 -- 172.21.15.39:0/2602172384 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8007d60 con 0x7ff90015afc0 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e64160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34756/0 (socket says 172.21.15.39:34756) 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 -- 172.21.15.39:0/1011336006 learned_addr learned my addr 172.21.15.39:0/1011336006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64072230 con 0x7f1e6414d140 2024-04-26T23:26:20.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e641640d0 con 0x7f1e640d1720 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e69200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e64160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640723b0 con 0x7f1e64163c70 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63400640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e6414d140 0x7f1e6414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== osd.1 v2:172.21.15.39:6808/4093290330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb80401ae50 con 0x7fb7f8070550 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7ff8ff400640 1 -- 172.21.15.39:0/2602172384 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f80a5860 con 0x7ff90015afc0 2024-04-26T23:26:20.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7ff8ff400640 1 -- 172.21.15.39:0/2602172384 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80a5c30 con 0x7ff90015afc0 2024-04-26T23:26:20.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 Processor -- start 2024-04-26T23:26:20.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 -- start start 2024-04-26T23:26:20.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 -- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 msgr2=0x7f1e64160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e64160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 -- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e6414d140 msgr2=0x7f1e6414adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e6414d140 0x7f1e6414adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e640b1510 con 0x7f1e640d1720 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff90015afc0 msgr2=0x7ff90015ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7ff907a00640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff90015afc0 0x7ff90015ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b5ea0 tx=0x7ff8f801c9c0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e69200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e64163c70 0x7f1e64160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.637+0000 7f38bfe00640 1 -- 172.21.15.39:0/652230797 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c015c380 con 0x7f38c0069ba0 2024-04-26T23:26:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e63e00640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b22d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c7a0 tx=0x7f1e5400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed40cfe60 0x7f0ed40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 0x7f0ed415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed4163b50 0x7f0ed4164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed40c88d0 con 0x7f0ed4163b50 2024-04-26T23:26:20.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed40c8750 con 0x7f0ed40cfe60 2024-04-26T23:26:20.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0edae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed40b63b0 con 0x7f0ed40d56a0 2024-04-26T23:26:20.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54003b80 con 0x7f1e640d1720 2024-04-26T23:26:20.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e54003d20 con 0x7f1e640d1720 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e406f400 con 0x7fe0e406e460 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fe0d0001680 con 0x7fe0e406e460 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 >> v1:172.21.15.71:6789/0 conn(0x7fe0e406e460 legacy=0x7fe0e40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80039c0 0x7fe0c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0c8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e41641b0 con 0x7fe0c80039c0 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c800bb90 con 0x7fe0c8004810 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c800bd90 con 0x7fe0e414d140 2024-04-26T23:26:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7fe0e2000640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e640b17f0 con 0x7f1e640d1720 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e640b1db0 con 0x7f1e640d1720 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400aa90 con 0x7f1e640d1720 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.641+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 0x7f0ed415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 0x7f0ed415ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45308/0 (socket says 172.21.15.39:45308) 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 -- 172.21.15.39:0/1467037175 learned_addr learned my addr 172.21.15.39:0/1467037175 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed40cfe60 0x7f0ed40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7fe0e3400640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0c8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7fe0e2000640 1 -- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 msgr2=0x7fe0c8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7fe0e2000640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e414d140 0x7fe0c8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed8e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed4163b50 0x7f0ed4164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 -- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed40cfe60 msgr2=0x7f0ed40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed40cfe60 0x7f0ed40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 -- 172.21.15.39:0/1467037175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed4163b50 msgr2=0x7f0ed4164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed4163b50 0x7f0ed4164440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed40cc6e0 con 0x7f0ed40d56a0 2024-04-26T23:26:20.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e3c001040 con 0x7f1e640d1720 2024-04-26T23:26:20.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed8e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed4163b50 0x7f0ed4164440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:20.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed3e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed40cfe60 0x7f0ed40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:20.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 shutdown_connections 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9000b3200 0x7ff9000b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 --2- 172.21.15.39:0/2602172384 >> v2:172.21.15.71:3300/0 conn(0x7ff9000d0890 0x7ff90015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 --2- 172.21.15.39:0/2602172384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff90015afc0 0x7ff90015ee00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 >> 172.21.15.39:0/2602172384 conn(0x7ff90006cd70 msgr2=0x7ff9000b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ecbe00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 0x7f0ed415ef50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0af040 tx=0x7f0ebc0192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0bb030 con 0x7f0ed40d56a0 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0ac7e0 con 0x7f0ed40d56a0 2024-04-26T23:26:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0b1040 con 0x7f0ed40d56a0 2024-04-26T23:26:20.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 shutdown_connections 2024-04-26T23:26:20.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7ff907a00640 1 -- 172.21.15.39:0/2602172384 wait complete. 2024-04-26T23:26:20.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f38bfe00640 1 --2- 172.21.15.39:0/652230797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c00743d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38b00097c0 tx=0x7f38b001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb010ee819203e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed40cc9c0 con 0x7f0ed40d56a0 2024-04-26T23:26:20.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed40cd260 con 0x7f0ed40d56a0 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f2327400640 1 --2- 172.21.15.39:0/2057118454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233015aeb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23180097c0 tx=0x7f231801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a18683688636644 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f232f400640 1 -- 172.21.15.39:0/2057118454 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180b1070 con 0x7f233006e2d0 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f232f400640 1 -- 172.21.15.39:0/2057118454 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23180ac630 con 0x7f233006e2d0 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f232f400640 1 -- 172.21.15.39:0/2057118454 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a8050 con 0x7f233006e2d0 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f2335c00640 1 -- 172.21.15.39:0/2057118454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 msgr2=0x7f233015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f2335c00640 1 --2- 172.21.15.39:0/2057118454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233015aeb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23180097c0 tx=0x7f231801c430 comp rx=0 tx=0).stop 2024-04-26T23:26:20.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f38bea00640 1 -- 172.21.15.39:0/652230797 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00b5070 con 0x7f38c0069ba0 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f38bea00640 1 -- 172.21.15.39:0/652230797 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b00a8990 con 0x7f38c0069ba0 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f38bea00640 1 -- 172.21.15.39:0/652230797 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00a8d60 con 0x7f38c0069ba0 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e5400ac30 con 0x7f1e640d1720 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 Processor -- start 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 -- 172.21.15.39:0/2057118454 shutdown_connections 2024-04-26T23:26:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 --2- 172.21.15.39:0/2057118454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233015aeb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 -- 172.21.15.39:0/2057118454 >> 172.21.15.39:0/2057118454 conn(0x7f23300687a0 msgr2=0x7f233006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e5be00640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1e44068380 0x7f1e4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e54086830 con 0x7f1e640d1720 2024-04-26T23:26:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 -- 172.21.15.39:0/2057118454 shutdown_connections 2024-04-26T23:26:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 -- 172.21.15.39:0/2057118454 wait complete. 2024-04-26T23:26:20.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e5be00640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f1e44070520 0x7f1e44072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e5401de70 con 0x7f1e44070520 2024-04-26T23:26:20.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e5408d050 con 0x7f1e640d1720 2024-04-26T23:26:20.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e63400640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1e44068380 0x7f1e4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ed406a720 con 0x7f0ed40d56a0 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f38c7000640 1 -- 172.21.15.39:0/652230797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 msgr2=0x7f38c00743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f38c7000640 1 --2- 172.21.15.39:0/652230797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c00743d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38b00097c0 tx=0x7f38b001ecb0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f38c7000640 1 -- 172.21.15.39:0/652230797 shutdown_connections 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f38c7000640 1 --2- 172.21.15.39:0/652230797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c00743d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f38c7000640 1 -- 172.21.15.39:0/652230797 >> 172.21.15.39:0/652230797 conn(0x7f38c0072a40 msgr2=0x7f38c00738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e69200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f1e44070520 0x7f1e44072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e63400640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1e44068380 0x7f1e4406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009af0 tx=0x7f1e5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 -- start start 2024-04-26T23:26:20.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ebc0be070 con 0x7f0ed40d56a0 2024-04-26T23:26:20.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f1e69200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f1e44070520 0x7f1e44072940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0eb0068450 0x7f0eb006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9000b3200 0x7ff9001fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 Processor -- start 2024-04-26T23:26:20.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ebc120750 con 0x7f0ed40d56a0 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 0x7ff90015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 0x7ff90015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 0x7ff90015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47428/0 (socket says 172.21.15.39:47428) 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff8ffe00640 1 -- 172.21.15.39:0/2235236735 learned_addr learned my addr 172.21.15.39:0/2235236735 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.645+0000 7fe0e2000640 1 -- 172.21.15.39:0/676892105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80039c0 msgr2=0x7fe0c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7fe0e2000640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80039c0 0x7fe0c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7fe0e2000640 1 -- 172.21.15.39:0/676892105 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8003530 con 0x7fe0c8004810 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f0eb0070670 0x7f0eb0072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ebc0aee90 con 0x7f0eb0070670 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0ebc127050 con 0x7f0ed40d56a0 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f0ed3e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0eb0068450 0x7f0eb006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff90015afc0 0x7ff9001edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9000b4ed0 con 0x7ff9000d0890 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9000b4d50 con 0x7ff9000b3200 2024-04-26T23:26:20.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9000b5050 con 0x7ff90015afc0 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f0ed8e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f0eb0070670 0x7f0eb0072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff905000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9000b3200 0x7ff9001fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7f2335c00640 1 -- start start 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 0x7f2330160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2330073550 0x7f233015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2330073d40 con 0x7f2330073550 2024-04-26T23:26:20.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23300b4ef0 con 0x7f233006e2d0 2024-04-26T23:26:20.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2330073ec0 con 0x7f233006cae0 2024-04-26T23:26:20.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f0ed3e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0eb0068450 0x7f0eb006a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ed41ffc60 tx=0x7f0ec4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 0x7f2330160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.649+0000 7ff905a00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff90015afc0 0x7ff9001edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 0x7f2330160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45326/0 (socket says 172.21.15.39:45326) 2024-04-26T23:26:20.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 -- 172.21.15.39:0/1947194077 learned_addr learned my addr 172.21.15.39:0/1947194077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 -- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9000b3200 msgr2=0x7ff9001fbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9000b3200 0x7ff9001fbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 -- 172.21.15.39:0/2235236735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 msgr2=0x7ff90015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 0x7ff90015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90015bcb0 con 0x7ff90015afc0 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff8ffe00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9000d0890 0x7ff90015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff905a00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff90015afc0 0x7ff9001edc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000baf0 tx=0x7ff8f000df60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2327400640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f0ed8e00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f0eb0070670 0x7f0eb0072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335200640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2330073550 0x7f233015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 -- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 msgr2=0x7f233014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f233006e2d0 0x7f233014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 -- 172.21.15.39:0/1947194077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2330073550 msgr2=0x7f233015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2330073550 0x7f233015c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233015f990 con 0x7f233006cae0 2024-04-26T23:26:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f001b070 con 0x7ff90015afc0 2024-04-26T23:26:20.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f000f8a0 con 0x7ff90015afc0 2024-04-26T23:26:20.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000fc90 con 0x7ff90015afc0 2024-04-26T23:26:20.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90015bf90 con 0x7ff90015afc0 2024-04-26T23:26:20.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== osd.2 v2:172.21.15.39:6817/2063945159 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e5401de70 con 0x7f1e44070520 2024-04-26T23:26:20.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232fe00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 0x7f2330160750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f232000c8d0 tx=0x7f232000cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90015c550 con 0x7ff90015afc0 2024-04-26T23:26:20.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== osd.4 v2:172.21.15.71:6800/299609171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ebc0aee90 con 0x7f0eb0070670 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320018070 con 0x7f233006cae0 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232000a640 con 0x7f233006cae0 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000a9f0 con 0x7f233006cae0 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233015fc70 con 0x7f233006cae0 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2330160230 con 0x7f233006cae0 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f38c7000640 1 -- 172.21.15.39:0/652230797 shutdown_connections 2024-04-26T23:26:20.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f38c7000640 1 -- 172.21.15.39:0/652230797 wait complete. 2024-04-26T23:26:20.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7fe0e2000640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0c8004c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c110 tx=0x7fe0d001cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53f8e85ca5039c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23300506d0 con 0x7f233006cae0 2024-04-26T23:26:20.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f232001b070 con 0x7f233006cae0 2024-04-26T23:26:20.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f38c7000640 1 Processor -- start 2024-04-26T23:26:20.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.657+0000 7f38c7000640 1 -- start start 2024-04-26T23:26:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.653+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff90006a720 con 0x7ff90015afc0 2024-04-26T23:26:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0007c50 con 0x7fe0c8004810 2024-04-26T23:26:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d00a9070 con 0x7fe0c8004810 2024-04-26T23:26:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c009c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e1600640 1 -- 172.21.15.39:0/676892105 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0005dc0 con 0x7fe0c8004810 2024-04-26T23:26:20.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e9a00640 1 -- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 msgr2=0x7fe0c8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e9a00640 1 --2- 172.21.15.39:0/676892105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0c8004c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c110 tx=0x7fe0d001cbc0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7fe0e3400640 1 -- 172.21.15.39:0/676892105 reap_dead start 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c009c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34804/0 (socket says 172.21.15.39:34804) 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38c006fd60 0x7f38c015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f230c0683d0 0x7f230c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2320085ff0 con 0x7f233006cae0 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7f230c070650 0x7f230c072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f230c073120 con 0x7f230c070650 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f23200885d0 con 0x7f233006cae0 2024-04-26T23:26:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f2335200640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7f230c070650 0x7f230c072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f2335200640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7f230c070650 0x7f230c072a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8f001e070 con 0x7ff90015afc0 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38bfe00640 1 -- 172.21.15.39:0/1577716940 learned_addr learned my addr 172.21.15.39:0/1577716940 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38bf400640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38c006fd60 0x7f38c015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c00b61a0 0x7f38c009baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f38c015bb50 con 0x7f38c00b61a0 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38c015b9d0 con 0x7f38c0069ba0 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f38c015c880 con 0x7f38c006fd60 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== osd.6 v2:172.21.15.71:6824/3577500951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f230c073120 con 0x7f230c070650 2024-04-26T23:26:20.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7ff8fcc00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff8e0068480 0x7ff8e006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.661+0000 7f38c5000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c00b61a0 0x7f38c009baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8f0086000 con 0x7ff90015afc0 2024-04-26T23:26:20.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7fe0e9a00640 1 -- 172.21.15.39:0/676892105 shutdown_connections 2024-04-26T23:26:20.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7fe0e9a00640 1 -- 172.21.15.39:0/676892105 >> 172.21.15.39:0/676892105 conn(0x7fe0e406c7d0 msgr2=0x7fe0e406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7fe0e9a00640 1 -- 172.21.15.39:0/676892105 shutdown_connections 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7fe0e9a00640 1 -- 172.21.15.39:0/676892105 wait complete. 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8fcc00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7ff8e00706a0 0x7ff8e0072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8f0008e50 con 0x7ff8e00706a0 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff8f0088600 con 0x7ff90015afc0 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff905000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff8e0068480 0x7ff8e006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f2327400640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f230c0683d0 0x7f230c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 -- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38c006fd60 msgr2=0x7f38c015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8ffe00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7ff8e00706a0 0x7ff8e0072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38c006fd60 0x7f38c015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 -- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 msgr2=0x7f38c009c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0069ba0 0x7f38c009c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c009cc80 con 0x7f38c00b61a0 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38bf400640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38c006fd60 0x7f38c015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e9a00640 1 Processor -- start 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e9a00640 1 -- start start 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0e416d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e9a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0e416b6b0 0x7fe0e416e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8ffe00640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7ff8e00706a0 0x7ff8e0072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff905000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff8e0068480 0x7ff8e006a940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80ae000 tx=0x7ff8f80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== osd.5 v2:172.21.15.71:6816/821690898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8f0008e50 con 0x7ff8e00706a0 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f2327400640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f230c0683d0 0x7f230c06a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23180ae000 tx=0x7f23180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0e416d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0e416d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34808/0 (socket says 172.21.15.39:34808) 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e2a00640 1 -- 172.21.15.39:0/3293694554 learned_addr learned my addr 172.21.15.39:0/3293694554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e9a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e4162f10 0x7fe0e4163390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c5000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c00b61a0 0x7f38c009baa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b800caa0 tx=0x7f38b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8017070 con 0x7f38c00b61a0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b800aba0 con 0x7f38c00b61a0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8012400 con 0x7f38c00b61a0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c009cf60 con 0x7f38c00b61a0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.665+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c009c8c0 con 0x7f38c00b61a0 2024-04-26T23:26:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3898001040 con 0x7f38c00b61a0 2024-04-26T23:26:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40b5360 con 0x7fe0e416b6b0 2024-04-26T23:26:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.669+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 --> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0618002de0 con 0x7f06200705d0 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4072440 con 0x7fe0c8004810 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e40b54e0 con 0x7fe0e4162f10 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e4162f10 0x7fe0e4163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 -- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 msgr2=0x7fe0e416d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e2000640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0e416b6b0 0x7fe0e416e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38b801a070 con 0x7f38c00b61a0 2024-04-26T23:26:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f0636a00640 1 -- 172.21.15.39:0/3744053332 <== osd.0 v2:172.21.15.39:6800/3002752600 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0618002de0 con 0x7f06200705d0 2024-04-26T23:26:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f06200705d0 msgr2=0x7f06200729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f063fe00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f06200705d0 0x7f06200729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f38b7e00640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f38a00683d0 0x7f38a006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f06200683b0 msgr2=0x7f062006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0e416d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 -- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0e416b6b0 msgr2=0x7fe0e416e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0e416b6b0 0x7fe0e416e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e416dcc0 con 0x7fe0e4162f10 2024-04-26T23:26:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f063fe00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f06200683b0 0x7f062006a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a7d0 tx=0x7f062c008040 comp rx=0 tx=0).stop 2024-04-26T23:26:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 --> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e3c002de0 con 0x7f1e44070520 2024-04-26T23:26:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e2000640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0e416b6b0 0x7fe0e416e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e2a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c8004810 0x7fe0e416d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:20.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38b8086bb0 con 0x7f38c00b61a0 2024-04-26T23:26:20.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.673+0000 7fe0e3400640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e4162f10 0x7fe0e4163390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4070290 tx=0x7fe0dc00e9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc019070 con 0x7fe0e4162f10 2024-04-26T23:26:20.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38b7e00640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f38a00705f0 0x7f38a0072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38a00730c0 con 0x7f38a00705f0 2024-04-26T23:26:20.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc006d70 con 0x7fe0e4162f10 2024-04-26T23:26:20.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc003ba0 con 0x7fe0e4162f10 2024-04-26T23:26:20.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f38b8087090 con 0x7f38c00b61a0 2024-04-26T23:26:20.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38bfe00640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f38a00683d0 0x7f38a006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38bf400640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f38a00705f0 0x7f38a0072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 msgr2=0x7f0640149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38bf400640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f38a00705f0 0x7f38a0072a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38bfe00640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f38a00683d0 0x7f38a006a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000c10 tx=0x7f38b00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e416e550 con 0x7fe0e4162f10 2024-04-26T23:26:20.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 --2- 172.21.15.39:0/3744053332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06400d38c0 0x7f0640149d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f063801a5c0 tx=0x7f0638019730 comp rx=0 tx=0).stop 2024-04-26T23:26:20.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e5be00640 1 -- 172.21.15.39:0/1011336006 <== osd.2 v2:172.21.15.39:6817/2063945159 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1e3c002de0 con 0x7f1e44070520 2024-04-26T23:26:20.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e416cca0 con 0x7fe0e4162f10 2024-04-26T23:26:20.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063f400640 1 -- 172.21.15.39:0/3744053332 reap_dead start 2024-04-26T23:26:20.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 shutdown_connections 2024-04-26T23:26:20.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 >> 172.21.15.39:0/3744053332 conn(0x7f06400d2da0 msgr2=0x7f06400d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f1e44070520 msgr2=0x7f1e44072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 shutdown_connections 2024-04-26T23:26:20.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f063fe00640 1 -- 172.21.15.39:0/3744053332 wait complete. 2024-04-26T23:26:20.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f1e44070520 0x7f1e44072940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== osd.7 v2:172.21.15.71:6808/2492781367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38a00730c0 con 0x7f38a00705f0 2024-04-26T23:26:20.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1e44068380 msgr2=0x7f1e4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1e44068380 0x7f1e4406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009af0 tx=0x7f1e5c008040 comp rx=0 tx=0).stop 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 msgr2=0x7f1e640b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 --2- 172.21.15.39:0/1011336006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640d1720 0x7f1e640b22d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c7a0 tx=0x7f1e5400cc60 comp rx=0 tx=0).stop 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e69200640 1 -- 172.21.15.39:0/1011336006 reap_dead start 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 shutdown_connections 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 >> 172.21.15.39:0/1011336006 conn(0x7f1e6406c7d0 msgr2=0x7f1e64149030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.677+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0e406a720 con 0x7fe0e4162f10 2024-04-26T23:26:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.681+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 shutdown_connections 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.681+0000 7f1e6b200640 1 -- 172.21.15.39:0/1011336006 wait complete. 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.681+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0dc01c070 con 0x7fe0e4162f10 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.681+0000 7fe0daa00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0c4068450 0x7fe0c406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc085ec0 con 0x7fe0e4162f10 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0daa00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7fe0c40705f0 0x7fe0c4072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0c40730c0 con 0x7fe0c40705f0 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe0dc0520b0 con 0x7fe0e4162f10 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0e2a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0c4068450 0x7fe0c406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0e2000640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7fe0c40705f0 0x7fe0c4072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 --> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ed40cd460 con 0x7f0eb0070670 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 --> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7f0002de0 con 0x7fb7f8070550 2024-04-26T23:26:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7f0ed0c00640 1 -- 172.21.15.39:0/1467037175 <== osd.4 v2:172.21.15.71:6800/299609171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ed40cd460 con 0x7f0eb0070670 2024-04-26T23:26:20.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0e2a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0c4068450 0x7fe0c406a910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40047c0 tx=0x7fe0d4009570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.685+0000 7fe0e2000640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7fe0c40705f0 0x7fe0c4072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== osd.3 v2:172.21.15.39:6816/2544189874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0c40730c0 con 0x7fe0c40705f0 2024-04-26T23:26:20.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb80e000640 1 -- 172.21.15.39:0/154365047 <== osd.1 v2:172.21.15.39:6808/4093290330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb7f0002de0 con 0x7fb7f8070550 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f0eb0070670 msgr2=0x7f0eb0072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f0eb0070670 0x7f0eb0072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0eb0068450 msgr2=0x7f0eb006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0eb0068450 0x7f0eb006a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ed41ffc60 tx=0x7f0ec4009060 comp rx=0 tx=0).stop 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 msgr2=0x7f0ed415ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 --2- 172.21.15.39:0/1467037175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ed40d56a0 0x7f0ed415ef50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0af040 tx=0x7f0ebc0192c0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0ed8e00640 1 -- 172.21.15.39:0/1467037175 reap_dead start 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 shutdown_connections 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 >> 172.21.15.39:0/1467037175 conn(0x7f0ed408ec00 msgr2=0x7f0ed40d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 shutdown_connections 2024-04-26T23:26:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f0edae00640 1 -- 172.21.15.39:0/1467037175 wait complete. 2024-04-26T23:26:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7ff907a00640 1 -- 172.21.15.39:0/2235236735 --> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9001fc310 con 0x7ff8e00706a0 2024-04-26T23:26:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7fb7f8070550 msgr2=0x7fb7f8072970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7fb7f8070550 0x7fb7f8072970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7f80683b0 msgr2=0x7fb7f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7f80683b0 0x7fb7f806a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8080ad000 tx=0x7fb808004740 comp rx=0 tx=0).stop 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 msgr2=0x7fb81815e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 --2- 172.21.15.39:0/154365047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb81806f9c0 0x7fb81815e1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c440 tx=0x7fb80400c900 comp rx=0 tx=0).stop 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb816800640 1 -- 172.21.15.39:0/154365047 reap_dead start 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 shutdown_connections 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 >> 172.21.15.39:0/154365047 conn(0x7fb8180b2a10 msgr2=0x7fb8180b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7ff8fcc00640 1 -- 172.21.15.39:0/2235236735 <== osd.5 v2:172.21.15.71:6816/821690898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9001fc310 con 0x7ff8e00706a0 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7ff8e00706a0 msgr2=0x7ff8e0072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7ff8f6000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7ff8e00706a0 0x7ff8e0072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff8e0068480 msgr2=0x7ff8e006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff8e0068480 0x7ff8e006a940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80ae000 tx=0x7ff8f80a7070 comp rx=0 tx=0).stop 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff90015afc0 msgr2=0x7ff9001edc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 --2- 172.21.15.39:0/2235236735 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff90015afc0 0x7ff9001edc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000baf0 tx=0x7ff8f000df60 comp rx=0 tx=0).stop 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 --> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2330072070 con 0x7f230c070650 2024-04-26T23:26:20.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.689+0000 7f232cc00640 1 -- 172.21.15.39:0/1947194077 <== osd.6 v2:172.21.15.71:6824/3577500951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2330072070 con 0x7f230c070650 2024-04-26T23:26:20.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff905a00640 1 -- 172.21.15.39:0/2235236735 reap_dead start 2024-04-26T23:26:20.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 shutdown_connections 2024-04-26T23:26:20.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7fb81ca00640 1 -- 172.21.15.39:0/154365047 wait complete. 2024-04-26T23:26:20.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 shutdown_connections 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 >> 172.21.15.39:0/2235236735 conn(0x7ff90006cd70 msgr2=0x7ff9000b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7f230c070650 msgr2=0x7f230c072a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7f230c070650 0x7f230c072a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f230c0683d0 msgr2=0x7f230c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f230c0683d0 0x7f230c06a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23180ae000 tx=0x7f23180a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:20.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 msgr2=0x7f2330160750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 --2- 172.21.15.39:0/1947194077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f233006cae0 0x7f2330160750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f232000c8d0 tx=0x7f232000cd90 comp rx=0 tx=0).stop 2024-04-26T23:26:20.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335200640 1 -- 172.21.15.39:0/1947194077 reap_dead start 2024-04-26T23:26:20.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 shutdown_connections 2024-04-26T23:26:20.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7ff8f6000640 1 -- 172.21.15.39:0/2235236735 wait complete. 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 shutdown_connections 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 >> 172.21.15.39:0/1947194077 conn(0x7f23300687a0 msgr2=0x7f23300b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 shutdown_connections 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.693+0000 7f2335c00640 1 -- 172.21.15.39:0/1947194077 wait complete. 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.701+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 --> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3898002de0 con 0x7f38a00705f0 2024-04-26T23:26:20.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.701+0000 7f38b7e00640 1 -- 172.21.15.39:0/1577716940 <== osd.7 v2:172.21.15.71:6808/2492781367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3898002de0 con 0x7f38a00705f0 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f38a00705f0 msgr2=0x7f38a0072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f38a00705f0 0x7f38a0072a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f38a00683d0 msgr2=0x7f38a006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f38a00683d0 0x7f38a006a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000c10 tx=0x7f38b00aa070 comp rx=0 tx=0).stop 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c00b61a0 msgr2=0x7f38c009baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 --2- 172.21.15.39:0/1577716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c00b61a0 0x7f38c009baa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b800caa0 tx=0x7f38b800cf60 comp rx=0 tx=0).stop 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c5000640 1 -- 172.21.15.39:0/1577716940 reap_dead start 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 shutdown_connections 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 >> 172.21.15.39:0/1577716940 conn(0x7f38c0072a40 msgr2=0x7f38c00b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 shutdown_connections 2024-04-26T23:26:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.709+0000 7f38c7000640 1 -- 172.21.15.39:0/1577716940 wait complete. 2024-04-26T23:26:20.735 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:20.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:26:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 --> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0e40b3f50 con 0x7fe0c40705f0 2024-04-26T23:26:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0daa00640 1 -- 172.21.15.39:0/3293694554 <== osd.3 v2:172.21.15.39:6816/2544189874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0e40b3f50 con 0x7fe0c40705f0 2024-04-26T23:26:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7fe0c40705f0 msgr2=0x7fe0c4072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7fe0c40705f0 0x7fe0c4072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0c4068450 msgr2=0x7fe0c406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe0c4068450 0x7fe0c406a910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40047c0 tx=0x7fe0d4009570 comp rx=0 tx=0).stop 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e4162f10 msgr2=0x7fe0e4163390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 --2- 172.21.15.39:0/3293694554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0e4162f10 0x7fe0e4163390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4070290 tx=0x7fe0dc00e9e0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e3400640 1 -- 172.21.15.39:0/3293694554 reap_dead start 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 shutdown_connections 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 >> 172.21.15.39:0/3293694554 conn(0x7fe0e406c7d0 msgr2=0x7fe0e4165a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.721+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 shutdown_connections 2024-04-26T23:26:20.739 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:20.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:26:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.725+0000 7fe0e9a00640 1 -- 172.21.15.39:0/3293694554 wait complete. 2024-04-26T23:26:20.740 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:20.740 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:26:20.741 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:20.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:26:20.742 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:20.742 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:26:20.743 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-04-26T23:26:20.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:26:20.753 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:20.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:26:20.754 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:20.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:26:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.977+0000 7f4869a00640 1 Processor -- start 2024-04-26T23:26:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.977+0000 7f4869a00640 1 -- start start 2024-04-26T23:26:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 0x7f485c038760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f485c038ca0 0x7f485c0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f485c03a0d0 con 0x7f485c0548b0 2024-04-26T23:26:20.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f485c009c70 con 0x7f485c038ca0 2024-04-26T23:26:20.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f485c056020 con 0x7f485c035fa0 2024-04-26T23:26:20.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4863e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4863e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45350/0 (socket says 172.21.15.39:45350) 2024-04-26T23:26:20.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f485c038ca0 0x7f485c0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f485c038ca0 0x7f485c0e0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34836/0 (socket says 172.21.15.39:34836) 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 -- 172.21.15.39:0/3714293901 learned_addr learned my addr 172.21.15.39:0/3714293901 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4863400640 1 --2- 172.21.15.39:0/3714293901 >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 0x7f485c038760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 -- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 msgr2=0x7f485c0557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 --2- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 -- 172.21.15.39:0/3714293901 >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 msgr2=0x7f485c038760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 --2- 172.21.15.39:0/3714293901 >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 0x7f485c038760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f4869000640 1 -- 172.21.15.39:0/3714293901 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c00ad20 con 0x7f485c038ca0 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.977+0000 7f223be00640 1 Processor -- start 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.977+0000 7f223be00640 1 -- start start 2024-04-26T23:26:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c15d100 0x7f223c071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f223c071990 0x7f223c0d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223c0cd730 con 0x7f223c0d3200 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f223c071ed0 con 0x7f223c071990 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223be00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f223c0721b0 con 0x7f223c15d100 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f223c071990 0x7f223c0d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f223c071990 0x7f223c0d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34824/0 (socket says 172.21.15.39:34824) 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 -- 172.21.15.39:0/187601711 learned_addr learned my addr 172.21.15.39:0/187601711 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223aa00640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c15d100 0x7f223c071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 -- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c15d100 msgr2=0x7f223c071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c15d100 0x7f223c071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 -- 172.21.15.39:0/187601711 >> v1:172.21.15.71:6789/0 conn(0x7f223c0d3200 legacy=0x7f223c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.981+0000 7f223a000640 1 -- 172.21.15.39:0/187601711 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c0cd9d0 con 0x7f223c071990 2024-04-26T23:26:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.985+0000 7f4863400640 1 --2- 172.21.15.39:0/3714293901 >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 0x7f485c038760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4869000640 1 --2- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e0930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4864063fa0 tx=0x7f4864098d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ccdb8d1f945eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4862a00640 1 -- 172.21.15.39:0/3714293901 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864070190 con 0x7f485c038ca0 2024-04-26T23:26:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223a000640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c071990 0x7f223c0d2cc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7744da26b5b516e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4862a00640 1 -- 172.21.15.39:0/3714293901 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4864121870 con 0x7f485c038ca0 2024-04-26T23:26:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4862a00640 1 -- 172.21.15.39:0/3714293901 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864121ce0 con 0x7f485c038ca0 2024-04-26T23:26:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f2239600640 1 -- 172.21.15.39:0/187601711 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0b0070 con 0x7f223c071990 2024-04-26T23:26:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f2239600640 1 -- 172.21.15.39:0/187601711 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c0ab600 con 0x7f223c071990 2024-04-26T23:26:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f2239600640 1 -- 172.21.15.39:0/187601711 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0b0070 con 0x7f223c071990 2024-04-26T23:26:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4869a00640 1 -- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 msgr2=0x7f485c0e0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f4869a00640 1 --2- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e0930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4864063fa0 tx=0x7f4864098d80 comp rx=0 tx=0).stop 2024-04-26T23:26:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 -- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c071990 msgr2=0x7f223c0d2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c071990 0x7f223c0d2cc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c01c540 comp rx=0 tx=0).stop 2024-04-26T23:26:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 -- 172.21.15.39:0/187601711 shutdown_connections 2024-04-26T23:26:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c071990 0x7f223c0d2cc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 --2- 172.21.15.39:0/187601711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c15d100 0x7f223c071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.989+0000 7f223be00640 1 -- 172.21.15.39:0/187601711 >> 172.21.15.39:0/187601711 conn(0x7f223c09b9e0 msgr2=0x7f223c09bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f223be00640 1 -- 172.21.15.39:0/187601711 shutdown_connections 2024-04-26T23:26:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f223be00640 1 -- 172.21.15.39:0/187601711 wait complete. 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 -- 172.21.15.39:0/3714293901 shutdown_connections 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 --2- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e0930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 --2- 172.21.15.39:0/3714293901 >> v2:172.21.15.39:3300/0 conn(0x7f485c0548b0 0x7f485c038760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 --2- 172.21.15.39:0/3714293901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 -- 172.21.15.39:0/3714293901 >> 172.21.15.39:0/3714293901 conn(0x7f485c053760 msgr2=0x7f485c053b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 -- 172.21.15.39:0/3714293901 shutdown_connections 2024-04-26T23:26:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f223be00640 1 Processor -- start 2024-04-26T23:26:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.993+0000 7f4869a00640 1 -- 172.21.15.39:0/3714293901 wait complete. 2024-04-26T23:26:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 -- start start 2024-04-26T23:26:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c0d3200 0x7f223c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47468/0 (socket says 172.21.15.39:47468) 2024-04-26T23:26:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223aa00640 1 -- 172.21.15.39:0/3235115179 learned_addr learned my addr 172.21.15.39:0/3235115179 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f4869a00640 1 Processor -- start 2024-04-26T23:26:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 0x7f223c1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f223c169e40 con 0x7f223c071990 2024-04-26T23:26:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f4869a00640 1 -- start start 2024-04-26T23:26:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f6b39200640 1 Processor -- start 2024-04-26T23:26:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f6b39200640 1 -- start start 2024-04-26T23:26:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0e2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f223c169cc0 con 0x7f223c15d100 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f223c169fc0 con 0x7f223c0d3200 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223a000640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c0d3200 0x7f223c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:20.997+0000 7f223b400640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 0x7f223c1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 -- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c0d3200 msgr2=0x7f223c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c0d3200 0x7f223c06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 -- 172.21.15.39:0/3235115179 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 msgr2=0x7f223c06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c06e4f0 con 0x7f223c15d100 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223aa00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223b400640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 0x7f223c1552d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f223400c780 tx=0x7f223400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c0548b0 0x7f485c04d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f485c055ce0 con 0x7f485c0548b0 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f485c036380 con 0x7f485c038ca0 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f485c051760 con 0x7f485c035fa0 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34864/0 (socket says 172.21.15.39:34864) 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 -- 172.21.15.39:0/385327958 learned_addr learned my addr 172.21.15.39:0/385327958 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 -- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 msgr2=0x7f485c0e2090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863e00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b39200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6b3406eff0 0x7f6b340c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b31e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6b340c4190 0x7f6b340cfc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40320/0 (socket says 172.21.15.39:40320) 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b31e00640 1 -- 172.21.15.39:0/2378093868 learned_addr learned my addr 172.21.15.39:0/2378093868 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b39200640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.71:3300/0 conn(0x7f6b341676b0 0x7f6b34167b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234016020 con 0x7f223c15d100 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223400aa50 con 0x7f223c15d100 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223400ce30 con 0x7f223c15d100 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 -- 172.21.15.39:0/385327958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c0548b0 msgr2=0x7f485c04d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c0548b0 0x7f485c04d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 -- 172.21.15.39:0/385327958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c0e47c0 con 0x7f485c038ca0 2024-04-26T23:26:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b32800640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.71:3300/0 conn(0x7f6b341676b0 0x7f6b34167b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b31400640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.39:3300/0 conn(0x7f6b3406eff0 0x7f6b340c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b340c4ab0 con 0x7f6b340c4190 2024-04-26T23:26:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6b340d1e00 con 0x7f6b3406eff0 2024-04-26T23:26:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6b3406f630 con 0x7f6b341676b0 2024-04-26T23:26:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c06dc50 con 0x7f223c15d100 2024-04-26T23:26:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4863400640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f485800c7f0 tx=0x7f485800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262498415 0 0) 0x7f6b340c4ab0 con 0x7f6b340c4190 2024-04-26T23:26:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b18003530 con 0x7f6b340c4190 2024-04-26T23:26:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858015070 con 0x7f485c038ca0 2024-04-26T23:26:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858007820 con 0x7f485c038ca0 2024-04-26T23:26:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858007c30 con 0x7f485c038ca0 2024-04-26T23:26:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c06e210 con 0x7f223c15d100 2024-04-26T23:26:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c04d8e0 con 0x7f485c038ca0 2024-04-26T23:26:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c0e2670 con 0x7f485c038ca0 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.1 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3417351127 0 0) 0x7f6b18003530 con 0x7f6b340c4190 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 >> v2:172.21.15.71:3300/0 conn(0x7f6b341676b0 msgr2=0x7f6b34167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.71:3300/0 conn(0x7f6b341676b0 0x7f6b34167b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 >> v2:172.21.15.39:3300/0 conn(0x7f6b3406eff0 msgr2=0x7f6b340c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.39:3300/0 conn(0x7f6b3406eff0 0x7f6b340c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3406f880 con 0x7f6b340c4190 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.1 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f6b20001680 con 0x7f6b340c4190 2024-04-26T23:26:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 >> v1:172.21.15.71:6789/0 conn(0x7f6b340c4190 legacy=0x7f6b340cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 0x7f6b18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b18004810 0x7f6b18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b180051d0 0x7f6b1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b340d1e00 con 0x7f6b18004810 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3406f630 con 0x7f6b180051d0 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1800c0d0 con 0x7f6b180039c0 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.001+0000 7f6b31400640 1 --2- 172.21.15.39:0/2378093868 >> v2:172.21.15.39:3300/0 conn(0x7f6b3406eff0 0x7f6b340c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31400640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b18004810 0x7f6b18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c0506d0 con 0x7f223c15d100 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 0x7f6b18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b32800640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b180051d0 0x7f6b1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f9957600640 1 Processor -- start 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f9957600640 1 -- start start 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 -- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b180051d0 msgr2=0x7f6b1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b180051d0 0x7f6b1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 -- 172.21.15.39:0/2378093868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b18004810 msgr2=0x7f6b18004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b18004810 0x7f6b18004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b31e00640 1 -- 172.21.15.39:0/2378093868 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3406f880 con 0x7f6b180039c0 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4858018070 con 0x7f485c038ca0 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2234019020 con 0x7f223c15d100 2024-04-26T23:26:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7fc92dc00640 1 Processor -- start 2024-04-26T23:26:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7f6b32800640 1 -- 172.21.15.39:0/2378093868 reap_dead start 2024-04-26T23:26:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f4853e00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 0x7f484806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 Processor -- start 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48400052a0 con 0x7f485c038ca0 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48580867b0 con 0x7f485c038ca0 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9957600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 0x7f9950073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9957600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500b3f70 con 0x7f9950164270 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9957600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500b4250 con 0x7f99500b5010 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9957600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f99500b4b80 con 0x7f995014d140 2024-04-26T23:26:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9955600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9950164270 0x7f995006e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60834/0 (socket says 172.21.15.39:60834) 2024-04-26T23:26:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9955600640 1 -- 172.21.15.39:0/3390723197 learned_addr learned my addr 172.21.15.39:0/3390723197 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.005+0000 7fc92dc00640 1 -- start start 2024-04-26T23:26:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f2232a00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 0x7f221c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2234086830 con 0x7f223c15d100 2024-04-26T23:26:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc92dc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc92815afc0 0x7fc92815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc92dc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9280b4e00 0x7fc92806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9954c00640 1 --2- 172.21.15.39:0/3390723197 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 0x7f9950073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f223aa00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 0x7f221c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc92dc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92815fc60 con 0x7fc9280d0890 2024-04-26T23:26:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 -- start start 2024-04-26T23:26:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9954c00640 1 -- 172.21.15.39:0/3390723197 >> v1:172.21.15.71:6789/0 conn(0x7f99500b5010 legacy=0x7f9950163b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:26:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc927400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9280b4e00 0x7fc92806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc926000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc9280d0890 0x7fc92815f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40328/0 (socket says 172.21.15.39:40328) 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc926000640 1 -- 172.21.15.39:0/1217733850 learned_addr learned my addr 172.21.15.39:0/1217733850 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc927400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9280b4e00 0x7fc92806e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34890/0 (socket says 172.21.15.39:34890) 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0900d3d80 0x7fd0900d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0900d0db0 con 0x7fd09015f650 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd0900b4510 con 0x7fd0900d3d80 2024-04-26T23:26:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd095000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0900d1090 con 0x7fd0900d0580 2024-04-26T23:26:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc926a00640 1 --2- 172.21.15.39:0/1217733850 >> v2:172.21.15.39:3300/0 conn(0x7fc92815afc0 0x7fc92815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc9280739c0 con 0x7fc92815afc0 2024-04-26T23:26:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc928073ca0 con 0x7fc9280b4e00 2024-04-26T23:26:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd08ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0900d3d80 0x7fd0900d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f223aa00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 0x7f221c06a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2228007e60 tx=0x7f2228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45420/0 (socket says 172.21.15.39:45420) 2024-04-26T23:26:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7fd08fe00640 1 -- 172.21.15.39:0/3228781172 learned_addr learned my addr 172.21.15.39:0/3228781172 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f6b31e00640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 0x7f6b18003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c260 tx=0x7f6b2001f450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3c66f21e2653c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fd08fe00640 1 -- 172.21.15.39:0/3228781172 >> v2:172.21.15.39:3300/0 conn(0x7fd0900d3d80 msgr2=0x7fd0900d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fd08fe00640 1 --2- 172.21.15.39:0/3228781172 >> v2:172.21.15.39:3300/0 conn(0x7fd0900d3d80 0x7fd0900d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fd08fe00640 1 -- 172.21.15.39:0/3228781172 >> v1:172.21.15.71:6789/0 conn(0x7fd09015f650 legacy=0x7fd0900d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f4863e00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 0x7f484806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fd08fe00640 1 -- 172.21.15.39:0/3228781172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0900d1370 con 0x7fd0900d0580 2024-04-26T23:26:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9954c00640 1 -- 172.21.15.39:0/3390723197 >> v1:172.21.15.39:6789/0 conn(0x7f9950164270 legacy=0x7f995006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.009+0000 7f9954c00640 1 -- 172.21.15.39:0/3390723197 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99500b4530 con 0x7f995014d140 2024-04-26T23:26:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2234020030 con 0x7f223c15d100 2024-04-26T23:26:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f4863e00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 0x7f484806a8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4854009a30 tx=0x7f4854008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20007d80 con 0x7f6b180039c0 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fc927400640 1 -- 172.21.15.39:0/1217733850 >> v2:172.21.15.39:3300/0 conn(0x7fc92815afc0 msgr2=0x7fc92815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fc927400640 1 --2- 172.21.15.39:0/1217733850 >> v2:172.21.15.39:3300/0 conn(0x7fc92815afc0 0x7fc92815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fc927400640 1 -- 172.21.15.39:0/1217733850 >> v1:172.21.15.71:6789/0 conn(0x7fc9280d0890 legacy=0x7fc92815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7fc927400640 1 -- 172.21.15.39:0/1217733850 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc928073f80 con 0x7fc9280b4e00 2024-04-26T23:26:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b20005b00 con 0x7f6b180039c0 2024-04-26T23:26:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b30a00640 1 -- 172.21.15.39:0/2378093868 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20007070 con 0x7f6b180039c0 2024-04-26T23:26:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 msgr2=0x7f6b18003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b39200640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 0x7f6b18003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c260 tx=0x7f6b2001f450 comp rx=0 tx=0).stop 2024-04-26T23:26:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f9954c00640 1 --2- 172.21.15.39:0/3390723197 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 0x7f9950073440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097f0 tx=0x7f993c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d31649f16f1a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 shutdown_connections 2024-04-26T23:26:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f9381400640 1 Processor -- start 2024-04-26T23:26:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b39200640 1 --2- 172.21.15.39:0/2378093868 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b180039c0 0x7f6b18003de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.013+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 >> 172.21.15.39:0/2378093868 conn(0x7f6b340d11c0 msgr2=0x7f6b340d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 shutdown_connections 2024-04-26T23:26:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9381400640 1 -- start start 2024-04-26T23:26:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f6b39200640 1 -- 172.21.15.39:0/2378093868 wait complete. 2024-04-26T23:26:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd08fe00640 1 --2- 172.21.15.39:0/3228781172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd080009870 tx=0x7fd08001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce96b200d4b5aad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f994f400640 1 -- 172.21.15.39:0/3390723197 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b1070 con 0x7f995014d140 2024-04-26T23:26:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f994f400640 1 -- 172.21.15.39:0/3390723197 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c0ac410 con 0x7f995014d140 2024-04-26T23:26:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f994f400640 1 -- 172.21.15.39:0/3390723197 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0ac7e0 con 0x7f995014d140 2024-04-26T23:26:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4858056ee0 con 0x7f485c038ca0 2024-04-26T23:26:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd08e000640 1 -- 172.21.15.39:0/3228781172 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0800aa430 con 0x7fd0900d0580 2024-04-26T23:26:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd08e000640 1 -- 172.21.15.39:0/3228781172 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0800af070 con 0x7fd0900d0580 2024-04-26T23:26:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd08e000640 1 -- 172.21.15.39:0/3228781172 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0800aa7f0 con 0x7fd0900d0580 2024-04-26T23:26:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 -- 172.21.15.39:0/3390723197 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 msgr2=0x7f9950073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 --2- 172.21.15.39:0/3390723197 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 0x7f9950073440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097f0 tx=0x7f993c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 -- 172.21.15.39:0/3228781172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 msgr2=0x7fd0900b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 --2- 172.21.15.39:0/3228781172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd080009870 tx=0x7fd08001c4f0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 -- 172.21.15.39:0/3390723197 shutdown_connections 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 --2- 172.21.15.39:0/3390723197 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f995014d140 0x7f9950073440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 -- 172.21.15.39:0/3390723197 >> 172.21.15.39:0/3390723197 conn(0x7f995006cd70 msgr2=0x7f99500b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 -- 172.21.15.39:0/3390723197 shutdown_connections 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 -- 172.21.15.39:0/3228781172 shutdown_connections 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 --2- 172.21.15.39:0/3228781172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0900d0580 0x7fd0900b49a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 --2- 172.21.15.39:0/3228781172 >> v2:172.21.15.39:3300/0 conn(0x7fd0900d3d80 0x7fd0900d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 -- 172.21.15.39:0/3228781172 >> 172.21.15.39:0/3228781172 conn(0x7fd090074480 msgr2=0x7fd09009e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f6b39200640 1 Processor -- start 2024-04-26T23:26:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f6b39200640 1 -- start start 2024-04-26T23:26:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7fd095000640 1 -- 172.21.15.39:0/3228781172 shutdown_connections 2024-04-26T23:26:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fd095000640 1 -- 172.21.15.39:0/3228781172 wait complete. 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f937c15dce0 0x7f937c161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f937c15e0c0 0x7f937c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c06c910 0x7f937c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f937c143560 con 0x7f937c15dce0 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f937c06cd40 con 0x7f937c15e0c0 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9381400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f937c1429e0 con 0x7f937c06c910 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f937c15dce0 0x7f937c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f937c15dce0 0x7f937c161500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47524/0 (socket says 172.21.15.39:47524) 2024-04-26T23:26:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 -- 172.21.15.39:0/2826199130 learned_addr learned my addr 172.21.15.39:0/2826199130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc927400640 1 --2- 172.21.15.39:0/1217733850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280b4e00 0x7fc92806e460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9280cd8c0 tx=0x7fc92001eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530e67b2613bace4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 -- 172.21.15.39:0/2826199130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c06c910 msgr2=0x7f937c0732d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 --2- 172.21.15.39:0/2826199130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c06c910 0x7f937c0732d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 -- 172.21.15.39:0/2826199130 >> v2:172.21.15.71:3300/0 conn(0x7f937c15e0c0 msgr2=0x7f937c06c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 --2- 172.21.15.39:0/2826199130 >> v2:172.21.15.71:3300/0 conn(0x7f937c15e0c0 0x7f937c06c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 0x7f6b340b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34070120 con 0x7f6b180039c0 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3406fe40 con 0x7f6b340c4570 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b39200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6b34163cb0 con 0x7f6b340c5bd0 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47532/0 (socket says 172.21.15.39:47532) 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34912/0 (socket says 172.21.15.39:34912) 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 -- 172.21.15.39:0/3831367667 learned_addr learned my addr 172.21.15.39:0/3831367667 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fd095000640 1 Processor -- start 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.017+0000 7f9957600640 1 -- 172.21.15.39:0/3390723197 wait complete. 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9957600640 1 Processor -- start 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f9957600640 1 -- start start 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc925600640 1 -- 172.21.15.39:0/1217733850 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9200b4070 con 0x7fc9280b4e00 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc925600640 1 -- 172.21.15.39:0/1217733850 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9200a7b20 con 0x7fc9280b4e00 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc925600640 1 -- 172.21.15.39:0/1217733850 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9200af440 con 0x7fc9280b4e00 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280b4e00 msgr2=0x7fc92806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fc92dc00640 1 --2- 172.21.15.39:0/1217733850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280b4e00 0x7fc92806e460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9280cd8c0 tx=0x7fc92001eb40 comp rx=0 tx=0).stop 2024-04-26T23:26:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b32800640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 0x7f6b340b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7fd095000640 1 -- start start 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 -- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 msgr2=0x7f6b340b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 0x7f6b340b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f6b31400640 1 -- 172.21.15.39:0/3831367667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 msgr2=0x7f6b3415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b31400640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b31400640 1 -- 172.21.15.39:0/3831367667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3415c300 con 0x7f6b340c4570 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 shutdown_connections 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 --2- 172.21.15.39:0/1217733850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280b4e00 0x7fc92806e460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 --2- 172.21.15.39:0/1217733850 >> v2:172.21.15.39:3300/0 conn(0x7fc92815afc0 0x7fc92815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 >> 172.21.15.39:0/1217733850 conn(0x7fc92806cd70 msgr2=0x7fc9280b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 0x7f9950165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 0x7f99501465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b31e00640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b32800640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 0x7f6b340b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 shutdown_connections 2024-04-26T23:26:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 -- 172.21.15.39:0/1217733850 wait complete. 2024-04-26T23:26:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 0x7f9950165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 0x7f9950165790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34922/0 (socket says 172.21.15.39:34922) 2024-04-26T23:26:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.021+0000 7f937a800640 1 -- 172.21.15.39:0/2826199130 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c142cc0 con 0x7f937c15dce0 2024-04-26T23:26:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b31400640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0046e0 tx=0x7f6b2c007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0900d0580 0x7fd0900cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fb130400640 1 Processor -- start 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9955600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 0x7f99501465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9955600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 0x7f99501465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47544/0 (socket says 172.21.15.39:47544) 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45436/0 (socket says 172.21.15.39:45436) 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f995006ed80 con 0x7f9950164270 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9950073b90 con 0x7f995014d140 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f995006ef00 con 0x7f99500b5010 2024-04-26T23:26:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c014610 con 0x7f6b340c4570 2024-04-26T23:26:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0900d3d80 0x7fd09015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c019070 con 0x7f6b340c4570 2024-04-26T23:26:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994fe00640 1 -- 172.21.15.39:0/1451901358 learned_addr learned my addr 172.21.15.39:0/1451901358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b340c4b30 con 0x7f6b340c4570 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0149d0 con 0x7f6b340c4570 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b340c50f0 con 0x7f6b340c4570 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 -- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 msgr2=0x7f9950165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 0x7f9950165790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 -- 172.21.15.39:0/1451901358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 msgr2=0x7f99501465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 0x7f99501465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 -- 172.21.15.39:0/1451901358 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99501457e0 con 0x7f99500b5010 2024-04-26T23:26:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f937a800640 1 --2- 172.21.15.39:0/2826199130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c161500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f937c15e530 tx=0x7f936c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9144e9f041a41193 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fb130400640 1 -- start start 2024-04-26T23:26:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd0900b5a80 con 0x7fd0900d0580 2024-04-26T23:26:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0900b5900 con 0x7fd0900d3d80 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd095000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0900b5c00 con 0x7fd09015f650 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45438/0 (socket says 172.21.15.39:45438) 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 -- 172.21.15.39:0/2647171021 learned_addr learned my addr 172.21.15.39:0/2647171021 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9954c00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f993c0ac000 tx=0x7f993c019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 Processor -- start 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9379e00640 1 -- 172.21.15.39:0/2826199130 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c0b0070 con 0x7f937c15dce0 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9379e00640 1 -- 172.21.15.39:0/2826199130 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c0ab600 con 0x7f937c15dce0 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9379e00640 1 -- 172.21.15.39:0/2826199130 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c0ab9d0 con 0x7f937c15dce0 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 -- 172.21.15.39:0/2826199130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 msgr2=0x7f937c161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 --2- 172.21.15.39:0/2826199130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c161500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f937c15e530 tx=0x7f936c01c210 comp rx=0 tx=0).stop 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 -- 172.21.15.39:0/2826199130 shutdown_connections 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 --2- 172.21.15.39:0/2826199130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c06c910 0x7f937c0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 --2- 172.21.15.39:0/2826199130 >> v2:172.21.15.71:3300/0 conn(0x7f937c15e0c0 0x7f937c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 --2- 172.21.15.39:0/2826199130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c161500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 -- 172.21.15.39:0/2826199130 >> 172.21.15.39:0/2826199130 conn(0x7f937c0b3be0 msgr2=0x7f937c0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 -- 172.21.15.39:0/2826199130 shutdown_connections 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9381400640 1 -- 172.21.15.39:0/2826199130 wait complete. 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3406a720 con 0x7f6b340c4570 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b2c014b70 con 0x7f6b340c4570 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f6b2a000640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 0x7f6b1406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb130400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb12814d140 0x7fb128163c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb130400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb130400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb12806ee40 con 0x7fb12806e460 2024-04-26T23:26:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb130400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb1281641b0 con 0x7fb12814d140 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb130400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb12806f120 con 0x7fb1280d18f0 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb12e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 -- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0900d3d80 msgr2=0x7fd09015d710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0900d3d80 0x7fd09015d710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 -- 172.21.15.39:0/2647171021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0900d0580 msgr2=0x7fd0900cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0900d0580 0x7fd0900cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fd08fe00640 1 -- 172.21.15.39:0/2647171021 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09015e5b0 con 0x7fd09015f650 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd08fe00640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd08001cd90 tx=0x7fd08001ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0800bd3f0 con 0x7fd09015f650 2024-04-26T23:26:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0800bd590 con 0x7fd09015f650 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0800bd980 con 0x7fd09015f650 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09015c950 con 0x7fd09015f650 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09015cf10 con 0x7fd09015f650 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0680052a0 con 0x7fd09015f650 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b1040 con 0x7f99500b5010 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c0b54d0 con 0x7f99500b5010 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b56a0 con 0x7f99500b5010 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7f9957600640 1 -- 172.21.15.39:0/1451901358 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9950145ac0 con 0x7f99500b5010 2024-04-26T23:26:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9957600640 1 -- 172.21.15.39:0/1451901358 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99501413e0 con 0x7f99500b5010 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.025+0000 7fc92dc00640 1 -- start start 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 0x7fc928142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc92815afc0 0x7fc9280b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc92806f540 con 0x7fc92815afc0 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc92806f3c0 con 0x7fc9280d0890 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc92dc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc92806f6c0 con 0x7fc9280b4e00 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc926a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 0x7fc928142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b2c087220 con 0x7f6b340c4570 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc926000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc926000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34936/0 (socket says 172.21.15.39:34936) 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc926a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 0x7fc928142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45454/0 (socket says 172.21.15.39:45454) 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc926000640 1 -- 172.21.15.39:0/1166977683 learned_addr learned my addr 172.21.15.39:0/1166977683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fc927400640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc92815afc0 0x7fc9280b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c0052a0 con 0x7f99500b5010 2024-04-26T23:26:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.029+0000 7fb12e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45442/0 (socket says 172.21.15.39:45442) 2024-04-26T23:26:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f6b31e00640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 0x7f6b1406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0800b33f0 con 0x7fd09015f650 2024-04-26T23:26:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12d000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb12806e460 0x7fb1280d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60850/0 (socket says 172.21.15.39:60850) 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 -- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 msgr2=0x7fc928142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 0x7fc928142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 -- 172.21.15.39:0/1166977683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc92815afc0 msgr2=0x7fc9280b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc92815afc0 0x7fc9280b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 -- 172.21.15.39:0/1166977683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92815db30 con 0x7fc9280d0890 2024-04-26T23:26:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12e400640 1 -- 172.21.15.39:0/3157890513 learned_addr learned my addr 172.21.15.39:0/3157890513 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12da00640 1 --2- 172.21.15.39:0/3157890513 >> v2:172.21.15.39:3300/0 conn(0x7fb12814d140 0x7fb128163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f6b31e00640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 0x7f6b1406a910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ae000 tx=0x7f6b20001980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc926000640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c370 tx=0x7fc91800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12e400640 1 -- 172.21.15.39:0/3157890513 >> v2:172.21.15.39:3300/0 conn(0x7fb12814d140 msgr2=0x7fb128163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12e400640 1 --2- 172.21.15.39:0/3157890513 >> v2:172.21.15.39:3300/0 conn(0x7fb12814d140 0x7fb128163c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12e400640 1 -- 172.21.15.39:0/3157890513 >> v1:172.21.15.39:6789/0 conn(0x7fb12806e460 legacy=0x7fb1280d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fd087400640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 0x7fd07006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f993c0bd030 con 0x7f99500b5010 2024-04-26T23:26:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb127e00640 1 -- 172.21.15.39:0/3157890513 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930105072 0 0) 0x7fb12806ee40 con 0x7fb12806e460 2024-04-26T23:26:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd080120990 con 0x7fd09015f650 2024-04-26T23:26:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fb12e400640 1 -- 172.21.15.39:0/3157890513 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12806f400 con 0x7fb1280d18f0 2024-04-26T23:26:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f9381400640 1 Processor -- start 2024-04-26T23:26:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fd08f400640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 0x7fd07006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f9381400640 1 -- start start 2024-04-26T23:26:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b2c057850 con 0x7f6b340c4570 2024-04-26T23:26:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7f994cc00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 0x7f993006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918017070 con 0x7fc9280d0890 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc918005cf0 con 0x7fc9280d0890 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180072d0 con 0x7fc9280d0890 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc92dc00640 1 -- 172.21.15.39:0/1166977683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92815de10 con 0x7fc9280d0890 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fc92dc00640 1 -- 172.21.15.39:0/1166977683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92815e3d0 con 0x7fc9280d0890 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.033+0000 7fd08f400640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 0x7fd07006a910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009650 tx=0x7fd07c006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f994fe00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 0x7f993006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f993c11ff60 con 0x7f99500b5010 2024-04-26T23:26:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f994fe00640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 0x7f993006a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99500cd670 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47564/0 (socket says 172.21.15.39:47564) 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34942/0 (socket says 172.21.15.39:34942) 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45458/0 (socket says 172.21.15.39:45458) 2024-04-26T23:26:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 -- 172.21.15.39:0/3650211012 learned_addr learned my addr 172.21.15.39:0/3650211012 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f937c15d790 con 0x7f937c15dce0 2024-04-26T23:26:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0b6ff0 con 0x7f937c06c910 2024-04-26T23:26:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f937c141840 con 0x7f937c15e0c0 2024-04-26T23:26:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f80052a0 con 0x7fc9280d0890 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 -- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 msgr2=0x7f937c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 -- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 msgr2=0x7f937c1fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c153270 con 0x7f937c15dce0 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937a800640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9373e00640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936400b410 tx=0x7f936400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f937b200640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364015020 con 0x7f937c15dce0 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9364011830 con 0x7f937c15dce0 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364011c20 con 0x7f937c15dce0 2024-04-26T23:26:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c15ce20 con 0x7f937c15dce0 2024-04-26T23:26:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c1534e0 con 0x7f937c15dce0 2024-04-26T23:26:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0800c3060 con 0x7fd09015f650 2024-04-26T23:26:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc91801a070 con 0x7fc9280d0890 2024-04-26T23:26:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.037+0000 7fb12e400640 1 --2- 172.21.15.39:0/3157890513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb114009870 tx=0x7fb11401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0e90f60e679075 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7fc91ea00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 0x7fc90406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc918085b20 con 0x7fc9280d0890 2024-04-26T23:26:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7fc926a00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 0x7fc90406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93540052a0 con 0x7f937c15dce0 2024-04-26T23:26:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7fc926a00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 0x7fc90406a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc91000a970 tx=0x7fc91000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9364018020 con 0x7f937c15dce0 2024-04-26T23:26:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7f9372a00640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 0x7f935806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.041+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9364086710 con 0x7f937c15dce0 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb127e00640 1 -- 172.21.15.39:0/3157890513 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1140b0070 con 0x7fb1280d18f0 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb127e00640 1 -- 172.21.15.39:0/3157890513 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1140ab600 con 0x7fb1280d18f0 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb127e00640 1 -- 172.21.15.39:0/3157890513 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1140ab9d0 con 0x7fb1280d18f0 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 -- 172.21.15.39:0/3157890513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 msgr2=0x7fb1280b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 --2- 172.21.15.39:0/3157890513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb114009870 tx=0x7fb11401c4d0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7f937a800640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 0x7f935806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f993c0c4020 con 0x7f99500b5010 2024-04-26T23:26:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 -- 172.21.15.39:0/3157890513 shutdown_connections 2024-04-26T23:26:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 --2- 172.21.15.39:0/3157890513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb1280b4c50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 --2- 172.21.15.39:0/3157890513 >> v2:172.21.15.39:3300/0 conn(0x7fb12814d140 0x7fb128163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 -- 172.21.15.39:0/3157890513 >> 172.21.15.39:0/3157890513 conn(0x7fb12806c7d0 msgr2=0x7fb12806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc918055b70 con 0x7fc9280d0890 2024-04-26T23:26:21.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7f937a800640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 0x7f935806a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936c0ad000 tx=0x7f936c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 -- 172.21.15.39:0/3157890513 shutdown_connections 2024-04-26T23:26:21.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.045+0000 7fb130400640 1 -- 172.21.15.39:0/3157890513 wait complete. 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 Processor -- start 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 -- start start 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12806e460 0x7fb12814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12814d140 0x7fb1281449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb128170630 con 0x7fb12806e460 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb128072440 con 0x7fb12814d140 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb130400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb1281707b0 con 0x7fb1280d18f0 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb12d000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f936401f020 con 0x7f937c15dce0 2024-04-26T23:26:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb12d000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45474/0 (socket says 172.21.15.39:45474) 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb12d000640 1 -- 172.21.15.39:0/4195172133 learned_addr learned my addr 172.21.15.39:0/4195172133 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.049+0000 7fb12da00640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12806e460 0x7fb12814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12e400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12814d140 0x7fb1281449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 -- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12814d140 msgr2=0x7fb1281449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12814d140 0x7fb1281449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 -- 172.21.15.39:0/4195172133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12806e460 msgr2=0x7fb12814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12806e460 0x7fb12814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 -- 172.21.15.39:0/4195172133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12814abd0 con 0x7fb1280d18f0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb12d000640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c410 tx=0x7fb11c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0074e0 con 0x7fb1280d18f0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c0047f0 con 0x7fb1280d18f0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c007680 con 0x7fb1280d18f0 2024-04-26T23:26:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12814aeb0 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12814b470 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.053+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12806a720 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.057+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb11c011070 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.057+0000 7fb125600640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 0x7fb10806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.057+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb11c086590 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.061+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb11c056ab0 con 0x7fb1280d18f0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.065+0000 7fb12da00640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 0x7fb10806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.065+0000 7fb12da00640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 0x7fb10806a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb120003b90 tx=0x7fb1200098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:21.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.349+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f223c1602f0 con 0x7f223c15d100 2024-04-26T23:26:21.356 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:21.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.349+0000 7f2232a00640 1 -- 172.21.15.39:0/3235115179 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2234056e60 con 0x7f223c15d100 2024-04-26T23:26:21.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 msgr2=0x7f221c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 0x7f221c06a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2228007e60 tx=0x7f2228008040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 msgr2=0x7f223c1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 0x7f223c1552d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f223400c780 tx=0x7f223400cc40 comp rx=0 tx=0).stop 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 shutdown_connections 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f221c068450 0x7f221c06a910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c15d100 0x7f223c1552d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f223c0d3200 0x7f223c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 --2- 172.21.15.39:0/3235115179 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c071990 0x7f223c06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.353+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 >> 172.21.15.39:0/3235115179 conn(0x7f223c09b9e0 msgr2=0x7f223c15c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.357+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 shutdown_connections 2024-04-26T23:26:21.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.357+0000 7f223be00640 1 -- 172.21.15.39:0/3235115179 wait complete. 2024-04-26T23:26:21.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.373+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4840005860 con 0x7f485c038ca0 2024-04-26T23:26:21.386 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.381+0000 7f4853e00640 1 -- 172.21.15.39:0/385327958 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48580567e0 con 0x7f485c038ca0 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.381+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 msgr2=0x7f484806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.381+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 0x7f484806a8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4854009a30 tx=0x7f4854008040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.381+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 msgr2=0x7f485c0e4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.381+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f485800c7f0 tx=0x7f485800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 shutdown_connections 2024-04-26T23:26:21.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4848068400 0x7f484806a8c0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4854009a30 tx=0x7f4854008040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c0548b0 0x7f485c04d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f485c038ca0 0x7f485c0e4280 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 --2- 172.21.15.39:0/385327958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f485c035fa0 0x7f485c0e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 >> 172.21.15.39:0/385327958 conn(0x7f485c053760 msgr2=0x7f485c007c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 shutdown_connections 2024-04-26T23:26:21.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-26T23:26:21.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.385+0000 7f4869a00640 1 -- 172.21.15.39:0/385327958 wait complete. 2024-04-26T23:26:21.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6b340742c0 con 0x7f6b340c4570 2024-04-26T23:26:21.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b2a000640 1 -- 172.21.15.39:0/3831367667 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b2c057850 con 0x7f6b340c4570 2024-04-26T23:26:21.392 INFO:teuthology.orchestra.run.smithi039.stdout:55834574852 2024-04-26T23:26:21.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f992c005590 con 0x7f99500b5010 2024-04-26T23:26:21.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 msgr2=0x7f6b1406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 0x7f6b1406a910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ae000 tx=0x7f6b20001980 comp rx=0 tx=0).stop 2024-04-26T23:26:21.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 msgr2=0x7f6b34166940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0046e0 tx=0x7f6b2c007700 comp rx=0 tx=0).stop 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 shutdown_connections 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6b14068450 0x7f6b1406a910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b340c5bd0 0x7f6b340b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b340c4570 0x7f6b34166940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 --2- 172.21.15.39:0/3831367667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b180039c0 0x7f6b3415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 >> 172.21.15.39:0/3831367667 conn(0x7f6b340d11c0 msgr2=0x7f6b340affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 shutdown_connections 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f6b39200640 1 -- 172.21.15.39:0/3831367667 wait complete. 2024-04-26T23:26:21.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.389+0000 7f994cc00640 1 -- 172.21.15.39:0/1451901358 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f993c016090 con 0x7f99500b5010 2024-04-26T23:26:21.397 INFO:teuthology.orchestra.run.smithi039.stdout:55834574852 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc8f8005860 con 0x7fc9280d0890 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7fc91ea00640 1 -- 172.21.15.39:0/1166977683 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc918059e70 con 0x7fc9280d0890 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 msgr2=0x7f993006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 0x7f993006a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99500cd670 tx=0x7f9944009040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 msgr2=0x7f9950140ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f993c0ac000 tx=0x7f993c019240 comp rx=0 tx=0).stop 2024-04-26T23:26:21.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.393+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd068005590 con 0x7fd09015f650 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 shutdown_connections 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99300683d0 0x7f993006a890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9950164270 0x7f99501465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995014d140 0x7f9950165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 --2- 172.21.15.39:0/1451901358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99500b5010 0x7f9950140ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 >> 172.21.15.39:0/1451901358 conn(0x7f995006cd70 msgr2=0x7f995013e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fd087400640 1 -- 172.21.15.39:0/2647171021 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd080016110 con 0x7fd09015f650 2024-04-26T23:26:21.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 msgr2=0x7fc90406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 0x7fc90406a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc91000a970 tx=0x7fc91000c040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 shutdown_connections 2024-04-26T23:26:21.402 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:21.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 msgr2=0x7fc928142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c370 tx=0x7fc91800c830 comp rx=0 tx=0).stop 2024-04-26T23:26:21.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7f9942000640 1 -- 172.21.15.39:0/1451901358 wait complete. 2024-04-26T23:26:21.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 shutdown_connections 2024-04-26T23:26:21.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9040683d0 0x7fc90406a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc92815afc0 0x7fc9280b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9280d0890 0x7fc928142550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 --2- 172.21.15.39:0/1166977683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9280b4e00 0x7fc928142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 >> 172.21.15.39:0/1166977683 conn(0x7fc92806cd70 msgr2=0x7fc92814ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 shutdown_connections 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.397+0000 7fc917e00640 1 -- 172.21.15.39:0/1166977683 wait complete. 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 msgr2=0x7fd07006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 0x7fd07006a910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009650 tx=0x7fd07c006bb0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 msgr2=0x7fd090160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd08001cd90 tx=0x7fd08001ad30 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 shutdown_connections 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd070068450 0x7fd07006a910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd09015f650 0x7fd090160ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0900d3d80 0x7fd09015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 --2- 172.21.15.39:0/2647171021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0900d0580 0x7fd0900cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 >> 172.21.15.39:0/2647171021 conn(0x7fd090074480 msgr2=0x7fd0900cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 shutdown_connections 2024-04-26T23:26:21.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7fd095000640 1 -- 172.21.15.39:0/2647171021 wait complete. 2024-04-26T23:26:21.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.401+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9354005860 con 0x7f937c15dce0 2024-04-26T23:26:21.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.405+0000 7f9372a00640 1 -- 172.21.15.39:0/3650211012 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93640172c0 con 0x7f937c15dce0 2024-04-26T23:26:21.411 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:21.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 msgr2=0x7f935806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 0x7f935806a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936c0ad000 tx=0x7f936c008040 comp rx=0 tx=0).stop 2024-04-26T23:26:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb128072a20 con 0x7fb1280d18f0 2024-04-26T23:26:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 msgr2=0x7f937c15c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936400b410 tx=0x7f936400b8d0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 shutdown_connections 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93580683d0 0x7f935806a890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f937c15e0c0 0x7f937c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f937c15dce0 0x7f937c15c110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 --2- 172.21.15.39:0/3650211012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c06c910 0x7f937c1fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 >> 172.21.15.39:0/3650211012 conn(0x7f937c0b3be0 msgr2=0x7f937c141d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7fb125600640 1 -- 172.21.15.39:0/4195172133 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb11c0563b0 con 0x7fb1280d18f0 2024-04-26T23:26:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.409+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 shutdown_connections 2024-04-26T23:26:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7f9381400640 1 -- 172.21.15.39:0/3650211012 wait complete. 2024-04-26T23:26:21.417 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 msgr2=0x7fb10806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 0x7fb10806a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb120003b90 tx=0x7fb1200098d0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 msgr2=0x7fb128145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c410 tx=0x7fb11c00c8d0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 shutdown_connections 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.413+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1080683b0 0x7fb10806a870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12814d140 0x7fb1281449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1280d18f0 0x7fb128145490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 --2- 172.21.15.39:0/4195172133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb12806e460 0x7fb12814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 >> 172.21.15.39:0/4195172133 conn(0x7fb12806c7d0 msgr2=0x7fb128148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 shutdown_connections 2024-04-26T23:26:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:21.417+0000 7fb130400640 1 -- 172.21.15.39:0/4195172133 wait complete. 2024-04-26T23:26:21.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-26T23:26:21.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-26T23:26:21.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-26T23:26:21.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-26T23:26:21.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-26T23:26:21.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-04-26T23:26:21.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-26T23:26:22.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:26:22.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:26:22.435 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:26:22.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:26:22.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:26:22.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:26:22.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:26:22.453 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:26:22.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 Processor -- start 2024-04-26T23:26:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 -- start start 2024-04-26T23:26:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f11b81558a0 0x7f11b806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 0x7f11b80b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b815c660 con 0x7f11b806f7f0 2024-04-26T23:26:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f11b815b8a0 con 0x7f11b80b64e0 2024-04-26T23:26:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.577+0000 7f11c0400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f11b815bb80 con 0x7f11b81558a0 2024-04-26T23:26:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bd000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f11b806f7f0 0x7f11b80b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40346/0 (socket says 172.21.15.39:40346) 2024-04-26T23:26:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bd000640 1 -- 172.21.15.39:0/3761186215 learned_addr learned my addr 172.21.15.39:0/3761186215 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bda00640 1 --2- 172.21.15.39:0/3761186215 >> v2:172.21.15.71:3300/0 conn(0x7f11b81558a0 0x7f11b806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11be400640 1 --2- 172.21.15.39:0/3761186215 >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 0x7f11b80b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11b7e00640 1 -- 172.21.15.39:0/3761186215 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561104846 0 0) 0x7f11b815c660 con 0x7f11b806f7f0 2024-04-26T23:26:22.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bda00640 1 -- 172.21.15.39:0/3761186215 >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 msgr2=0x7f11b80b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bda00640 1 --2- 172.21.15.39:0/3761186215 >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 0x7f11b80b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bda00640 1 -- 172.21.15.39:0/3761186215 >> v1:172.21.15.71:6789/0 conn(0x7f11b806f7f0 legacy=0x7f11b80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11bda00640 1 -- 172.21.15.39:0/3761186215 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b815be60 con 0x7f11b81558a0 2024-04-26T23:26:22.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.581+0000 7f11be400640 1 --2- 172.21.15.39:0/3761186215 >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 0x7f11b80b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11bda00640 1 --2- 172.21.15.39:0/3761186215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b81558a0 0x7f11b806f2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11b806ffa0 tx=0x7f11a401c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=150fbd4b246a6fef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11b7e00640 1 -- 172.21.15.39:0/3761186215 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a40aa600 con 0x7f11b81558a0 2024-04-26T23:26:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11b7e00640 1 -- 172.21.15.39:0/3761186215 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a40af070 con 0x7f11b81558a0 2024-04-26T23:26:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11b7e00640 1 -- 172.21.15.39:0/3761186215 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a40aa600 con 0x7f11b81558a0 2024-04-26T23:26:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11c0400640 1 -- 172.21.15.39:0/3761186215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b81558a0 msgr2=0x7f11b806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11c0400640 1 --2- 172.21.15.39:0/3761186215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b81558a0 0x7f11b806f2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11b806ffa0 tx=0x7f11a401c5b0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11c0400640 1 -- 172.21.15.39:0/3761186215 shutdown_connections 2024-04-26T23:26:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11c0400640 1 --2- 172.21.15.39:0/3761186215 >> v2:172.21.15.39:3300/0 conn(0x7f11b80b64e0 0x7f11b80b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.589+0000 7f11c0400640 1 --2- 172.21.15.39:0/3761186215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b81558a0 0x7f11b806f2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.593+0000 7f11c0400640 1 -- 172.21.15.39:0/3761186215 >> 172.21.15.39:0/3761186215 conn(0x7f11b80b2a10 msgr2=0x7f11b80b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.593+0000 7f11c0400640 1 -- 172.21.15.39:0/3761186215 shutdown_connections 2024-04-26T23:26:22.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.593+0000 7f11c0400640 1 -- 172.21.15.39:0/3761186215 wait complete. 2024-04-26T23:26:22.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.593+0000 7f11c0400640 1 Processor -- start 2024-04-26T23:26:22.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.593+0000 7f11c0400640 1 -- start start 2024-04-26T23:26:22.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 0x7f11b8148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11bda00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11bda00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34966/0 (socket says 172.21.15.39:34966) 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11bd000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 0x7f11b8148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11bd000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 0x7f11b8148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45480/0 (socket says 172.21.15.39:45480) 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11be400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11be400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47598/0 (socket says 172.21.15.39:47598) 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11bda00640 1 -- 172.21.15.39:0/2763726811 learned_addr learned my addr 172.21.15.39:0/2763726811 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80b53c0 con 0x7f11b81558a0 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80b5240 con 0x7f11b806f7f0 2024-04-26T23:26:22.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.597+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f11b8167d40 con 0x7f11b80b64e0 2024-04-26T23:26:22.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 -- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 msgr2=0x7f11b8148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 0x7f11b8148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 -- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 msgr2=0x7f11b8149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81499d0 con 0x7f11b81558a0 2024-04-26T23:26:22.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11be400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11b0014b00 tx=0x7f11b00150c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11bda00640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0015d00 con 0x7f11b81558a0 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b00039a0 con 0x7f11b81558a0 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0003d70 con 0x7f11b81558a0 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b8149cb0 con 0x7f11b81558a0 2024-04-26T23:26:22.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.601+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b814a270 con 0x7f11b81558a0 2024-04-26T23:26:22.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.605+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11b0004030 con 0x7f11b81558a0 2024-04-26T23:26:22.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.605+0000 7f11b5600640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 0x7f119806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.605+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11b005aec0 con 0x7f11b81558a0 2024-04-26T23:26:22.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.605+0000 7f11bda00640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 0x7f119806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.609+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b814c910 con 0x7f11b81558a0 2024-04-26T23:26:22.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.613+0000 7f11bda00640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 0x7f119806a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11a40ac040 tx=0x7f11a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.617+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11b814c910 con 0x7f11b81558a0 2024-04-26T23:26:22.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.649+0000 7f3514c00640 1 Processor -- start 2024-04-26T23:26:22.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.649+0000 7f3514c00640 1 -- start start 2024-04-26T23:26:22.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.649+0000 7f3514c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35101558a0 0x7f351006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35101558a0 0x7f351006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35101558a0 0x7f351006f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34970/0 (socket says 172.21.15.39:34970) 2024-04-26T23:26:22.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 -- 172.21.15.39:0/4183859802 learned_addr learned my addr 172.21.15.39:0/4183859802 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351015c660 con 0x7f35100b64e0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351015b8a0 con 0x7f351006f7f0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f351015bb80 con 0x7f35101558a0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108513058 0 0) 0x7f351015c660 con 0x7f35100b64e0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34f4003450 con 0x7f35100b64e0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600422138 0 0) 0x7f351015b8a0 con 0x7f351006f7f0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f351015c660 con 0x7f351006f7f0 2024-04-26T23:26:22.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 -- 172.21.15.39:0/4183859802 >> v1:172.21.15.71:6789/0 conn(0x7f351006f7f0 legacy=0x7f35100b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 -- 172.21.15.39:0/4183859802 >> v1:172.21.15.39:6789/0 conn(0x7f35100b64e0 legacy=0x7f35100b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.653+0000 7f350de00640 1 -- 172.21.15.39:0/4183859802 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351015be60 con 0x7f35101558a0 2024-04-26T23:26:22.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.657+0000 7f0ff9800640 1 Processor -- start 2024-04-26T23:26:22.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.657+0000 7f0ff9800640 1 -- start start 2024-04-26T23:26:22.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.657+0000 7f0ff9800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ff41558a0 0x7f0ff406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.657+0000 7f350de00640 1 --2- 172.21.15.39:0/4183859802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35101558a0 0x7f351006f2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009f80 tx=0x7f34fc0208a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd06a15b08b5e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ff41558a0 0x7f0ff406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff9800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 0x7f0ff40b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff9800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff415c660 con 0x7f0ff406f7f0 2024-04-26T23:26:22.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff9800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff415b8a0 con 0x7f0ff41558a0 2024-04-26T23:26:22.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff9800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff415bb80 con 0x7f0ff40b64e0 2024-04-26T23:26:22.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ff41558a0 0x7f0ff406f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47614/0 (socket says 172.21.15.39:47614) 2024-04-26T23:26:22.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 -- 172.21.15.39:0/1644613847 learned_addr learned my addr 172.21.15.39:0/1644613847 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff3400640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 0x7f0ff40b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 -- 172.21.15.39:0/1644613847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 msgr2=0x7f0ff40b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 0x7f0ff40b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc007ad0 con 0x7f35101558a0 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc007c70 con 0x7f35101558a0 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f350ca00640 1 -- 172.21.15.39:0/4183859802 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0092f0 con 0x7f35101558a0 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35101558a0 msgr2=0x7f351006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 --2- 172.21.15.39:0/4183859802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35101558a0 0x7f351006f2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009f80 tx=0x7f34fc0208a0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 shutdown_connections 2024-04-26T23:26:22.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 --2- 172.21.15.39:0/4183859802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35101558a0 0x7f351006f2b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 >> 172.21.15.39:0/4183859802 conn(0x7f35100b2a10 msgr2=0x7f35100b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 shutdown_connections 2024-04-26T23:26:22.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f3514c00640 1 -- 172.21.15.39:0/4183859802 wait complete. 2024-04-26T23:26:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.665+0000 7f3514c00640 1 Processor -- start 2024-04-26T23:26:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 -- 172.21.15.39:0/1644613847 >> v1:172.21.15.39:6789/0 conn(0x7f0ff406f7f0 legacy=0x7f0ff40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff2a00640 1 -- 172.21.15.39:0/1644613847 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff415be60 con 0x7f0ff41558a0 2024-04-26T23:26:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.661+0000 7f0ff3400640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 0x7f0ff40b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.665+0000 7f3514c00640 1 -- start start 2024-04-26T23:26:22.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.665+0000 7f0ff2a00640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff41558a0 0x7f0ff406f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0006fd0 tx=0x7f0fe001e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510ed379048165b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.665+0000 7f3514c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff1600640 1 -- 172.21.15.39:0/1644613847 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00ad070 con 0x7f0ff41558a0 2024-04-26T23:26:22.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f3514c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35100b64e0 0x7f3510153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff1600640 1 -- 172.21.15.39:0/1644613847 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe0004230 con 0x7f0ff41558a0 2024-04-26T23:26:22.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:34972/0 (socket says 172.21.15.39:34972) 2024-04-26T23:26:22.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 -- 172.21.15.39:0/949707381 learned_addr learned my addr 172.21.15.39:0/949707381 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff1600640 1 -- 172.21.15.39:0/1644613847 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00a76c0 con 0x7f0ff41558a0 2024-04-26T23:26:22.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 -- 172.21.15.39:0/1644613847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff41558a0 msgr2=0x7f0ff406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff41558a0 0x7f0ff406f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0006fd0 tx=0x7f0fe001e9f0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 -- 172.21.15.39:0/1644613847 shutdown_connections 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 0x7f35100c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35101690e0 con 0x7f35100b64e0 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3510168f60 con 0x7f351006f7f0 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3510169260 con 0x7f35101558a0 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff40b64e0 0x7f0ff40b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 --2- 172.21.15.39:0/1644613847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff41558a0 0x7f0ff406f2b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 -- 172.21.15.39:0/1644613847 >> 172.21.15.39:0/1644613847 conn(0x7f0ff40b2a10 msgr2=0x7f0ff40b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350e800640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 0x7f35100c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 -- 172.21.15.39:0/1644613847 shutdown_connections 2024-04-26T23:26:22.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 -- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 msgr2=0x7f35100c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 0x7f35100c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 -- 172.21.15.39:0/949707381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35100b64e0 msgr2=0x7f3510153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35100b64e0 0x7f3510153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3510151d80 con 0x7f351006f7f0 2024-04-26T23:26:22.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f0ff9800640 1 -- 172.21.15.39:0/1644613847 wait complete. 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350e800640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 0x7f35100c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.669+0000 7f350de00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f34fc01d4b0 tx=0x7f34fc01d640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0bf070 con 0x7f351006f7f0 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc0a9570 con 0x7f351006f7f0 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc007ad0 con 0x7f351006f7f0 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3510152020 con 0x7f351006f7f0 2024-04-26T23:26:22.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35101525e0 con 0x7f351006f7f0 2024-04-26T23:26:22.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f0ff9800640 1 Processor -- start 2024-04-26T23:26:22.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e80052a0 con 0x7f351006f7f0 2024-04-26T23:26:22.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f0ff9800640 1 -- start start 2024-04-26T23:26:22.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.673+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34fc0a9940 con 0x7f351006f7f0 2024-04-26T23:26:22.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff406f7f0 0x7f0ff4142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40b64e0 0x7f0ff41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f3506000640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 0x7f34f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f34fc1207b0 con 0x7f351006f7f0 2024-04-26T23:26:22.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f350d400640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 0x7f34f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40b53c0 con 0x7f0ff406f7f0 2024-04-26T23:26:22.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40b5240 con 0x7f0ff40b64e0 2024-04-26T23:26:22.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff9800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff406fc20 con 0x7f0ff41558a0 2024-04-26T23:26:22.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45502/0 (socket says 172.21.15.39:45502) 2024-04-26T23:26:22.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 -- 172.21.15.39:0/1177503034 learned_addr learned my addr 172.21.15.39:0/1177503034 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff2000640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40b64e0 0x7f0ff41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f350d400640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 0x7f34f006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3500007fd0 tx=0x7f3500007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff2a00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff406f7f0 0x7f0ff4142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 -- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40b64e0 msgr2=0x7f0ff41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40b64e0 0x7f0ff41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 -- 172.21.15.39:0/1177503034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff406f7f0 msgr2=0x7f0ff4142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff406f7f0 0x7f0ff4142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.677+0000 7f0ff3400640 1 -- 172.21.15.39:0/1177503034 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4143220 con 0x7f0ff41558a0 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0ff3400640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00efc0 tx=0x7f0fec009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec018030 con 0x7f0ff41558a0 2024-04-26T23:26:22.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f34fc010070 con 0x7f351006f7f0 2024-04-26T23:26:22.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fec00cde0 con 0x7f0ff41558a0 2024-04-26T23:26:22.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec003bc0 con 0x7f0ff41558a0 2024-04-26T23:26:22.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0ff9800640 1 -- 172.21.15.39:0/1177503034 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff4143800 con 0x7f0ff41558a0 2024-04-26T23:26:22.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.681+0000 7f0ff9800640 1 -- 172.21.15.39:0/1177503034 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff4143dc0 con 0x7f0ff41558a0 2024-04-26T23:26:22.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.685+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc80052a0 con 0x7f0ff41558a0 2024-04-26T23:26:22.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.685+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fec01b070 con 0x7f0ff41558a0 2024-04-26T23:26:22.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.689+0000 7f0feaa00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 0x7f0fd406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.689+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fec055250 con 0x7f0ff41558a0 2024-04-26T23:26:22.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.689+0000 7f0ff2a00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 0x7f0fd406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.689+0000 7f0ff2a00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 0x7f0fd406a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00b1000 tx=0x7f0fe00a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.693+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0fec022070 con 0x7f0ff41558a0 2024-04-26T23:26:22.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.745+0000 7fcb86000640 1 Processor -- start 2024-04-26T23:26:22.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.745+0000 7fcb86000640 1 -- start start 2024-04-26T23:26:22.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.745+0000 7f3553e00640 1 Processor -- start 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb86000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb800b65f0 0x7fcb800ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb86000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb801604e0 con 0x7fcb800b6210 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb86000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb801607c0 con 0x7fcb800b56a0 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb86000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fcb80160aa0 con 0x7fcb800b65f0 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcb800b6210 0x7fcb8015fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60868/0 (socket says 172.21.15.39:60868) 2024-04-26T23:26:22.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 -- 172.21.15.39:0/165906725 learned_addr learned my addr 172.21.15.39:0/165906725 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:22.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.745+0000 7f3553e00640 1 -- start start 2024-04-26T23:26:22.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869351808 0 0) 0x7fcb801604e0 con 0x7fcb800b6210 2024-04-26T23:26:22.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb64003530 con 0x7fcb800b6210 2024-04-26T23:26:22.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f597b800640 1 Processor -- start 2024-04-26T23:26:22.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 0x7f35540d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 0x7f35540b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 454411056 0 0) 0x7fcb64003530 con 0x7fcb800b6210 2024-04-26T23:26:22.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 >> v2:172.21.15.39:3300/0 conn(0x7fcb800b65f0 msgr2=0x7fcb800ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 --2- 172.21.15.39:0/165906725 >> v2:172.21.15.39:3300/0 conn(0x7fcb800b65f0 0x7fcb800ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 >> v1:172.21.15.71:6789/0 conn(0x7fcb800b56a0 legacy=0x7fcb80145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800b4ea0 con 0x7fcb800b6210 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35540d0db0 con 0x7f355415f650 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f35540b4510 con 0x7f35540d0580 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f35540d1090 con 0x7f35540d3d80 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 0x7f35540b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 0x7f35540b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47640/0 (socket says 172.21.15.39:47640) 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f3553400640 1 -- 172.21.15.39:0/187604738 learned_addr learned my addr 172.21.15.39:0/187604738 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fcb70001680 con 0x7fcb800b6210 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 >> v1:172.21.15.39:6789/0 conn(0x7fcb800b6210 legacy=0x7fcb8015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 0x7fcb64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb64004810 0x7fcb64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb64005240 0x7fcb6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80160aa0 con 0x7fcb64004810 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640149b0 con 0x7fcb640039c0 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb64014bb0 con 0x7fcb64005240 2024-04-26T23:26:22.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7f597b800640 1 -- start start 2024-04-26T23:26:22.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 0x7fcb64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7fe00640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb64005240 0x7fcb6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 -- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb64005240 msgr2=0x7fcb6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb64005240 0x7fcb6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 -- 172.21.15.39:0/165906725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb64004810 msgr2=0x7fcb64004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb64004810 0x7fcb64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7f400640 1 -- 172.21.15.39:0/165906725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800b4ea0 con 0x7fcb640039c0 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.749+0000 7fcb7fe00640 1 -- 172.21.15.39:0/165906725 reap_dead start 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f597b800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f597415f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f597b800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597415fc60 con 0x7f597415afc0 2024-04-26T23:26:22.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f596be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f59740d0890 0x7f597406e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40372/0 (socket says 172.21.15.39:40372) 2024-04-26T23:26:22.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f596be00640 1 -- 172.21.15.39:0/3866740371 learned_addr learned my addr 172.21.15.39:0/3866740371 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:22.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3552000640 1 --2- 172.21.15.39:0/187604738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 0x7f35540d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59740739c0 con 0x7f59740d0890 2024-04-26T23:26:22.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5979800640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f597415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5974073ca0 con 0x7f59740b4e00 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16178201 0 0) 0x7f59740739c0 con 0x7f59740d0890 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5958003530 con 0x7f59740d0890 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4119203038 0 0) 0x7f5958003530 con 0x7f59740d0890 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 msgr2=0x7f597415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f597415f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 >> v1:172.21.15.39:6789/0 conn(0x7f597415afc0 legacy=0x7f597415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5974073f80 con 0x7f59740d0890 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f595c001680 con 0x7f59740d0890 2024-04-26T23:26:22.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 >> v1:172.21.15.71:6789/0 conn(0x7f59740d0890 legacy=0x7f597406e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7fcb7f400640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 0x7fcb64003dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c340 tx=0x7fcb7001f560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133d3f8de73a5e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f5958003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f5958004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5958004d50 0x7f59580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5974073ca0 con 0x7f5958004d50 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5958005b60 con 0x7f59580039c0 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5958005d60 con 0x7f59740b4e00 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 Processor -- start 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70007e30 con 0x7fcb640039c0 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70005ae0 con 0x7fcb640039c0 2024-04-26T23:26:22.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb7e000640 1 -- 172.21.15.39:0/165906725 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70007070 con 0x7fcb640039c0 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 -- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 msgr2=0x7fcb64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 0x7fcb64003dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c340 tx=0x7fcb7001f560 comp rx=0 tx=0).stop 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 -- 172.21.15.39:0/165906725 shutdown_connections 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 --2- 172.21.15.39:0/165906725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb640039c0 0x7fcb64003dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 -- 172.21.15.39:0/165906725 >> 172.21.15.39:0/165906725 conn(0x7fcb8006d4e0 msgr2=0x7fcb8006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 -- 172.21.15.39:0/165906725 shutdown_connections 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 -- 172.21.15.39:0/165906725 wait complete. 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f5958003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5979800640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5958004d50 0x7f59580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f596be00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f5958004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 -- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 msgr2=0x7f5958004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59740b4e00 0x7f5958004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 -- 172.21.15.39:0/3866740371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5958004d50 msgr2=0x7f59580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5958004d50 0x7f59580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f5978e00640 1 -- 172.21.15.39:0/3866740371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5974073f80 con 0x7f59580039c0 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3552000640 1 -- 172.21.15.39:0/187604738 >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 msgr2=0x7f35540b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3552000640 1 --2- 172.21.15.39:0/187604738 >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 0x7f35540b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3551600640 1 -- 172.21.15.39:0/187604738 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2784774836 0 0) 0x7f35540d0db0 con 0x7f355415f650 2024-04-26T23:26:22.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3552000640 1 -- 172.21.15.39:0/187604738 >> v1:172.21.15.39:6789/0 conn(0x7f355415f650 legacy=0x7f35540d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.753+0000 7f3552000640 1 -- 172.21.15.39:0/187604738 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35540d1370 con 0x7f35540d3d80 2024-04-26T23:26:22.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fc1f8a00640 1 Processor -- start 2024-04-26T23:26:22.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f3552000640 1 --2- 172.21.15.39:0/187604738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 0x7f35540d0040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3544009d90 tx=0x7f354401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a0125bebabce5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 -- start start 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd815afc0 0x7f9fd815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fd80b4e00 0x7f9fd806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd815fc60 con 0x7f9fd80d0890 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd80739c0 con 0x7f9fd80b4e00 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f9fdf600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd8073ca0 con 0x7f9fd815afc0 2024-04-26T23:26:22.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fcb86000640 1 Processor -- start 2024-04-26T23:26:22.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7f3551600640 1 -- 172.21.15.39:0/187604738 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440b2070 con 0x7f35540d3d80 2024-04-26T23:26:22.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3551600640 1 -- 172.21.15.39:0/187604738 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35440a5a20 con 0x7f35540d3d80 2024-04-26T23:26:22.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3551600640 1 -- 172.21.15.39:0/187604738 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440a5df0 con 0x7f35540d3d80 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 -- start start 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb8013b1a0 0x7fcb8013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 0x7fcb8014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800b5cb0 con 0x7fcb8015c950 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800b5b30 con 0x7fcb8013b580 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb86000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800ce4b0 con 0x7fcb8013b1a0 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 -- 172.21.15.39:0/187604738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 msgr2=0x7f35540d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 --2- 172.21.15.39:0/187604738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 0x7f35540d0040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3544009d90 tx=0x7f354401c940 comp rx=0 tx=0).stop 2024-04-26T23:26:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 0x7fcb8014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35030/0 (socket says 172.21.15.39:35030) 2024-04-26T23:26:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7ea00640 1 -- 172.21.15.39:0/1904253500 learned_addr learned my addr 172.21.15.39:0/1904253500 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7f400640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb8013b1a0 0x7fcb8013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fd80b4e00 0x7f9fd806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fd80b4e00 0x7f9fd806e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35024/0 (socket says 172.21.15.39:35024) 2024-04-26T23:26:22.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 -- 172.21.15.39:0/259706124 learned_addr learned my addr 172.21.15.39:0/259706124 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.757+0000 7fc1f8a00640 1 -- start start 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0eacd0 0x7fc1ec053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f8a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec058cb0 con 0x7fc1ec058820 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f8a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0544e0 con 0x7fc1ec053990 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec057af0 con 0x7fc1ec0eacd0 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f1400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc1ec053990 0x7fc1ec03c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40384/0 (socket says 172.21.15.39:40384) 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f1400640 1 -- 172.21.15.39:0/980240966 learned_addr learned my addr 172.21.15.39:0/980240966 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 -- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd815afc0 msgr2=0x7f9fd815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 --2- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd815afc0 0x7f9fd815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 -- 172.21.15.39:0/259706124 >> v1:172.21.15.71:6789/0 conn(0x7f9fd80d0890 legacy=0x7f9fd815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 -- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb8013b1a0 msgr2=0x7fcb8013c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb8013b1a0 0x7fcb8013c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 -- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 msgr2=0x7fcb8015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 -- 172.21.15.39:0/1904253500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8015dd90 con 0x7fcb8015c950 2024-04-26T23:26:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7ea00640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f1e00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0eacd0 0x7fc1ec053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790970271 0 0) 0x7fc1ec0544e0 con 0x7fc1ec053990 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d8003530 con 0x7fc1ec053990 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911029138 0 0) 0x7fc1ec058cb0 con 0x7fc1ec058820 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1ec0544e0 con 0x7fc1ec058820 2024-04-26T23:26:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb7fe00640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 0x7fcb8014cde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb800b69d0 tx=0x7fcb7800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 -- 172.21.15.39:0/187604738 shutdown_connections 2024-04-26T23:26:22.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 --2- 172.21.15.39:0/187604738 >> v2:172.21.15.39:3300/0 conn(0x7f35540d0580 0x7f35540b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 --2- 172.21.15.39:0/187604738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35540d3d80 0x7f35540d0040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 -- 172.21.15.39:0/187604738 >> 172.21.15.39:0/187604738 conn(0x7f3554074480 msgr2=0x7f355409e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.1 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2453826924 0 0) 0x7fc1d8003530 con 0x7fc1ec053990 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0eacd0 msgr2=0x7fc1ec053f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0eacd0 0x7fc1ec053f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 >> v1:172.21.15.39:6789/0 conn(0x7fc1ec058820 legacy=0x7fc1ec03c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec057d40 con 0x7fc1ec053990 2024-04-26T23:26:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.1 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fc1e4001680 con 0x7fc1ec053990 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 >> v1:172.21.15.71:6789/0 conn(0x7fc1ec053990 legacy=0x7fc1ec03c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d8004bb0 0x7fc1d8004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d80037b0 0x7fc1d8003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1d8004170 0x7fc1d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec057af0 con 0x7fc1d80037b0 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d800bf40 con 0x7fc1d8004bb0 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d800c140 con 0x7fc1d8004170 2024-04-26T23:26:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f3553e00640 1 -- 172.21.15.39:0/187604738 shutdown_connections 2024-04-26T23:26:22.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7801b070 con 0x7fcb8015c950 2024-04-26T23:26:22.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8015e030 con 0x7fcb8015c950 2024-04-26T23:26:22.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 -- 172.21.15.39:0/187604738 wait complete. 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1d8004170 0x7fc1d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f1400640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d80037b0 0x7fc1d8003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8015e5f0 con 0x7fcb8015c950 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb78013630 con 0x7fcb8015c950 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb580052a0 con 0x7fcb8015c950 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb780139e0 con 0x7fcb8015c950 2024-04-26T23:26:22.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.761+0000 7f9fdd600640 1 -- 172.21.15.39:0/259706124 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd8073f80 con 0x7f9fd80b4e00 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 -- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d8004bb0 msgr2=0x7fc1d8004fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d8004bb0 0x7fc1d8004fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 -- 172.21.15.39:0/980240966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d80037b0 msgr2=0x7fc1d8003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d80037b0 0x7fc1d8003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7fc1f2800640 1 -- 172.21.15.39:0/980240966 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec057d40 con 0x7fc1d8004170 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f5978e00640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f5958003de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5964001780 tx=0x7f596401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec11e6496607f208 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f9fdd600640 1 --2- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd80b4e00 0x7f9fd806e460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80088a0 tx=0x7f9fc801ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d7ea3c7546bd4ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640013a0 con 0x7f59580039c0 2024-04-26T23:26:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640a9070 con 0x7f59580039c0 2024-04-26T23:26:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f5973e00640 1 -- 172.21.15.39:0/3866740371 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964003600 con 0x7f59580039c0 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 Processor -- start 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 -- start start 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35540d0580 0x7f35540ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35540d3d80 0x7f355415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35540b5a80 con 0x7f35540d0580 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35540b5900 con 0x7f35540d3d80 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.765+0000 7f3553e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f35540b5c00 con 0x7f355415f650 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45598/0 (socket says 172.21.15.39:45598) 2024-04-26T23:26:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 -- 172.21.15.39:0/2079135388 learned_addr learned my addr 172.21.15.39:0/2079135388 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 -- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35540d3d80 msgr2=0x7f355415fac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35540d3d80 0x7f355415fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 -- 172.21.15.39:0/2079135388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35540d0580 msgr2=0x7f35540ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35540d0580 0x7f35540ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 -- 172.21.15.39:0/2079135388 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35540c96e0 con 0x7f355415f650 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553400640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e800 tx=0x7f354c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c017070 con 0x7f355415f650 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c00c940 con 0x7f355415f650 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00cd30 con 0x7f355415f650 2024-04-26T23:26:22.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 msgr2=0x7f5958003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f597b800640 1 --2- 172.21.15.39:0/3866740371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f5958003de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5964001780 tx=0x7f596401c420 comp rx=0 tx=0).stop 2024-04-26T23:26:22.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb7801e070 con 0x7fcb8015c950 2024-04-26T23:26:22.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f9fd7400640 1 -- 172.21.15.39:0/259706124 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80ad070 con 0x7f9fd80b4e00 2024-04-26T23:26:22.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35540c99c0 con 0x7f355415f650 2024-04-26T23:26:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f9fd7400640 1 -- 172.21.15.39:0/259706124 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc80a79b0 con 0x7f9fd80b4e00 2024-04-26T23:26:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f9fd7400640 1 -- 172.21.15.39:0/259706124 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80a7d80 con 0x7f9fd80b4e00 2024-04-26T23:26:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f5979800640 1 -- 172.21.15.39:0/3866740371 reap_dead start 2024-04-26T23:26:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35540c9f80 con 0x7f355415f650 2024-04-26T23:26:22.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 shutdown_connections 2024-04-26T23:26:22.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 >> 172.21.15.39:0/3866740371 conn(0x7f597406cd70 msgr2=0x7f59740b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7fc1f2800640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1d8004170 0x7fc1d800b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40519e0 tx=0x7fc1f409b5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8219246878ea5df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7fcb77400640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 0x7fcb6006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.769+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcb780137e0 con 0x7fcb8015c950 2024-04-26T23:26:22.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 shutdown_connections 2024-04-26T23:26:22.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fcb7f400640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 0x7fcb6006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f354c01a070 con 0x7f355415f650 2024-04-26T23:26:22.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4051660 con 0x7fc1d8004170 2024-04-26T23:26:22.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 -- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd80b4e00 msgr2=0x7f9fd806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 --2- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd80b4e00 0x7f9fd806e460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80088a0 tx=0x7f9fc801ea10 comp rx=0 tx=0).stop 2024-04-26T23:26:22.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f406e450 con 0x7fc1d8004170 2024-04-26T23:26:22.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fcb7f400640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 0x7fcb6006aa40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb700af000 tx=0x7fcb700aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f0a00640 1 -- 172.21.15.39:0/980240966 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f406e900 con 0x7fc1d8004170 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f8a00640 1 -- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1d8004170 msgr2=0x7fc1d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/980240966 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1d8004170 0x7fc1d800b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40519e0 tx=0x7fc1f409b5e0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 -- 172.21.15.39:0/259706124 shutdown_connections 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 --2- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd80b4e00 0x7f9fd806e460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 --2- 172.21.15.39:0/259706124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd815afc0 0x7f9fd815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 -- 172.21.15.39:0/259706124 >> 172.21.15.39:0/259706124 conn(0x7f9fd806cd70 msgr2=0x7f9fd80b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f354aa00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 0x7f353008c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 -- 172.21.15.39:0/259706124 shutdown_connections 2024-04-26T23:26:22.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f354c086cf0 con 0x7f355415f650 2024-04-26T23:26:22.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f2800640 1 -- 172.21.15.39:0/980240966 reap_dead start 2024-04-26T23:26:22.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f9fdf600640 1 -- 172.21.15.39:0/259706124 wait complete. 2024-04-26T23:26:22.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f3552a00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 0x7f353008c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f8a00640 1 -- 172.21.15.39:0/980240966 shutdown_connections 2024-04-26T23:26:22.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7fc1f8a00640 1 -- 172.21.15.39:0/980240966 >> 172.21.15.39:0/980240966 conn(0x7fc1ec0559b0 msgr2=0x7fc1ec055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:22.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f597b800640 1 -- 172.21.15.39:0/3866740371 wait complete. 2024-04-26T23:26:22.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f597b800640 1 Processor -- start 2024-04-26T23:26:22.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.773+0000 7f597b800640 1 -- start start 2024-04-26T23:26:22.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7fc1f8a00640 1 -- 172.21.15.39:0/980240966 shutdown_connections 2024-04-26T23:26:22.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35540506d0 con 0x7f355415f650 2024-04-26T23:26:22.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7fc1f8a00640 1 -- 172.21.15.39:0/980240966 wait complete. 2024-04-26T23:26:22.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 0x7f5974151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f3552a00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 0x7f353008c880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f353c007fd0 tx=0x7f353c007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35034/0 (socket says 172.21.15.39:35034) 2024-04-26T23:26:22.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f9fdf600640 1 Processor -- start 2024-04-26T23:26:22.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f596be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f596be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47696/0 (socket says 172.21.15.39:47696) 2024-04-26T23:26:22.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f9fdf600640 1 -- start start 2024-04-26T23:26:22.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 -- 172.21.15.39:0/3465224391 learned_addr learned my addr 172.21.15.39:0/3465224391 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f59740b3380 con 0x7f5974205290 2024-04-26T23:26:22.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59740b3200 con 0x7f59580039c0 2024-04-26T23:26:22.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7fc1f8a00640 1 Processor -- start 2024-04-26T23:26:22.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5979800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 0x7f5974151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f597415b3a0 con 0x7f5974150c90 2024-04-26T23:26:22.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7fc1f8a00640 1 -- start start 2024-04-26T23:26:22.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 -- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 msgr2=0x7f5974151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 0x7f5974151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 -- 172.21.15.39:0/3465224391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 msgr2=0x7f5974205710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5978e00640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597415b750 con 0x7f59580039c0 2024-04-26T23:26:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.777+0000 7f5979800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 0x7f5974151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f596be00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f5978e00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5964005040 tx=0x7f5958005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f354c057210 con 0x7f355415f650 2024-04-26T23:26:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1ec0e07c0 0x7fc1ec0e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 0x7fc1ec0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec038350 con 0x7fc1d8004170 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec058300 con 0x7fc1ec0e07c0 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47704/0 (socket says 172.21.15.39:47704) 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 -- 172.21.15.39:0/1356226267 learned_addr learned my addr 172.21.15.39:0/1356226267 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1400640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1ec0e07c0 0x7fc1ec0e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f2800640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 0x7fc1ec0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec053f00 con 0x7fc1ec0d0b40 2024-04-26T23:26:22.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 0x7f9fd81455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdcc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdcc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45638/0 (socket says 172.21.15.39:45638) 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdcc00640 1 -- 172.21.15.39:0/2077500001 learned_addr learned my addr 172.21.15.39:0/2077500001 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd815afc0 0x7f9fd8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd806f540 con 0x7f9fd80d0890 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd806f3c0 con 0x7f9fd815afc0 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd806f6c0 con 0x7f9fd80b4e00 2024-04-26T23:26:22.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 0x7f9fd81455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 -- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 msgr2=0x7f9fd8148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 -- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd815afc0 msgr2=0x7f9fd8154d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:26:22.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd815afc0 0x7f9fd8154d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd8155800 con 0x7f9fd80d0890 2024-04-26T23:26:22.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964007250 con 0x7f59580039c0 2024-04-26T23:26:22.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640073f0 con 0x7f59580039c0 2024-04-26T23:26:22.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640075a0 con 0x7f59580039c0 2024-04-26T23:26:22.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5974205d50 con 0x7f59580039c0 2024-04-26T23:26:22.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597415b9f0 con 0x7f59580039c0 2024-04-26T23:26:22.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fdcc00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:22.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 -- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 msgr2=0x7fc1ec0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 0x7fc1ec0d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 -- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1ec0e07c0 msgr2=0x7fc1ec0e0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:22.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7f9fd7e00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 0x7f9fd81455f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c6d0 tx=0x7f9fd000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1ec0e07c0 0x7fc1ec0e0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:22.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f1e00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec052910 con 0x7fc1d8004170 2024-04-26T23:26:22.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.781+0000 7fc1f2800640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 0x7fc1ec0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:22.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1f1e00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d480 tx=0x7fc1e000d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0022070 con 0x7f9fd80d0890 2024-04-26T23:26:22.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00125f0 con 0x7fc1d8004170 2024-04-26T23:26:22.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0015b60 con 0x7f9fd80d0890 2024-04-26T23:26:22.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd8155ae0 con 0x7f9fd80d0890 2024-04-26T23:26:22.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000a640 con 0x7f9fd80d0890 2024-04-26T23:26:22.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd8147c50 con 0x7f9fd80d0890 2024-04-26T23:26:22.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e0019070 con 0x7fc1d8004170 2024-04-26T23:26:22.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec051330 con 0x7fc1d8004170 2024-04-26T23:26:22.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec0518f0 con 0x7fc1d8004170 2024-04-26T23:26:22.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb78055eb0 con 0x7fcb8015c950 2024-04-26T23:26:22.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd806a720 con 0x7f9fd80d0890 2024-04-26T23:26:22.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59640be030 con 0x7f59580039c0 2024-04-26T23:26:22.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00129d0 con 0x7fc1d8004170 2024-04-26T23:26:22.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.785+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc0052a0 con 0x7fc1d8004170 2024-04-26T23:26:22.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f5971600640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 0x7f595006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5964120150 con 0x7f59580039c0 2024-04-26T23:26:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594c0052a0 con 0x7f59580039c0 2024-04-26T23:26:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fd0025070 con 0x7f9fd80d0890 2024-04-26T23:26:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f9fd4c00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 0x7f9fb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd008ea30 con 0x7f9fd80d0890 2024-04-26T23:26:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f9fdcc00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 0x7f9fb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f596be00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 0x7f595006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1e0012b70 con 0x7fc1d8004170 2024-04-26T23:26:22.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7fc1ea000640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 0x7fc1d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:22.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1e0086bc0 con 0x7fc1d8004170 2024-04-26T23:26:22.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.789+0000 7f9fdcc00640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 0x7f9fb806a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4007a00 tx=0x7f9fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.793+0000 7f596be00640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 0x7f595006a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59741e5270 tx=0x7f595c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.793+0000 7fc1f1400640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 0x7fc1d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:22.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.793+0000 7fc1f1400640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 0x7fc1d406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1807d0 tx=0x7fc1e4007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:22.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.797+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f59640c5020 con 0x7f59580039c0 2024-04-26T23:26:22.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.801+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9fd005ef50 con 0x7f9fd80d0890 2024-04-26T23:26:22.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.817+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc1e0057170 con 0x7fc1d8004170 2024-04-26T23:26:22.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.993+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f11b80506d0 con 0x7f11b81558a0 2024-04-26T23:26:22.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.993+0000 7f11b5600640 1 -- 172.21.15.39:0/2763726811 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11b814c910 con 0x7f11b81558a0 2024-04-26T23:26:22.999 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:23.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 msgr2=0x7f119806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 0x7f119806a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11a40ac040 tx=0x7f11a40a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:23.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 msgr2=0x7f11b815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11b0014b00 tx=0x7f11b00150c0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 shutdown_connections 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f11980683d0 0x7f119806a890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b81558a0 0x7f11b815c8b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11b80b64e0 0x7f11b8148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 --2- 172.21.15.39:0/2763726811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b806f7f0 0x7f11b8149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 >> 172.21.15.39:0/2763726811 conn(0x7f11b80b2a10 msgr2=0x7f11b815a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 shutdown_connections 2024-04-26T23:26:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:22.997+0000 7f11c0400640 1 -- 172.21.15.39:0/2763726811 wait complete. 2024-04-26T23:26:23.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.017+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0fc8005860 con 0x7f0ff41558a0 2024-04-26T23:26:23.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.017+0000 7f0feaa00640 1 -- 172.21.15.39:0/1177503034 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fec022070 con 0x7f0ff41558a0 2024-04-26T23:26:23.021 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:23.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 msgr2=0x7f0fd406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 0x7f0fd406a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00b1000 tx=0x7f0fe00a9070 comp rx=0 tx=0).stop 2024-04-26T23:26:23.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 msgr2=0x7f0ff4153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00efc0 tx=0x7f0fec009f90 comp rx=0 tx=0).stop 2024-04-26T23:26:23.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 shutdown_connections 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fd4068400 0x7f0fd406a8c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff41558a0 0x7f0ff4153ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40b64e0 0x7f0ff41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 --2- 172.21.15.39:0/1177503034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff406f7f0 0x7f0ff4142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 >> 172.21.15.39:0/1177503034 conn(0x7f0ff40b2a10 msgr2=0x7f0ff4072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 shutdown_connections 2024-04-26T23:26:23.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.021+0000 7f0fdfe00640 1 -- 172.21.15.39:0/1177503034 wait complete. 2024-04-26T23:26:23.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-26T23:26:23.033 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.041+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f34e8005860 con 0x7f351006f7f0 2024-04-26T23:26:23.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.041+0000 7f3506000640 1 -- 172.21.15.39:0/949707381 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34fc007e20 con 0x7f351006f7f0 2024-04-26T23:26:23.045 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:23.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-26T23:26:23.048 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 msgr2=0x7f34f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 0x7f34f006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3500007fd0 tx=0x7f3500007960 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 msgr2=0x7f3510140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f34fc01d4b0 tx=0x7f34fc01d640 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 shutdown_connections 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34f00683b0 0x7f34f006a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f35101558a0 0x7f35100c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35100b64e0 0x7f3510153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 --2- 172.21.15.39:0/949707381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f351006f7f0 0x7f3510140400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 >> 172.21.15.39:0/949707381 conn(0x7f35100b2a10 msgr2=0x7f35100b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 shutdown_connections 2024-04-26T23:26:23.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.045+0000 7f3514c00640 1 -- 172.21.15.39:0/949707381 wait complete. 2024-04-26T23:26:23.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-26T23:26:23.078 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.105+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f35540d3450 con 0x7f355415f650 2024-04-26T23:26:23.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f354aa00640 1 -- 172.21.15.39:0/2079135388 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f354c056b10 con 0x7f355415f650 2024-04-26T23:26:23.112 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-04-26T23:26:23.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 msgr2=0x7f353008c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 0x7f353008c880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f353c007fd0 tx=0x7f353c007940 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 msgr2=0x7f3554160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e800 tx=0x7f354c00ecc0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 shutdown_connections 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f353008a3c0 0x7f353008c880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f355415f650 0x7f3554160000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35540d3d80 0x7f355415fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 --2- 172.21.15.39:0/2079135388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35540d0580 0x7f35540ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 >> 172.21.15.39:0/2079135388 conn(0x7f3554074480 msgr2=0x7f35540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 shutdown_connections 2024-04-26T23:26:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.109+0000 7f3553e00640 1 -- 172.21.15.39:0/2079135388 wait complete. 2024-04-26T23:26:23.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-26T23:26:23.135 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.133+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcb58005590 con 0x7fcb8015c950 2024-04-26T23:26:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.133+0000 7fcb77400640 1 -- 172.21.15.39:0/1904253500 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb7805a1b0 con 0x7fcb8015c950 2024-04-26T23:26:23.138 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 msgr2=0x7fcb6006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 0x7fcb6006aa40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb700af000 tx=0x7fcb700aa000 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 msgr2=0x7fcb8014cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 0x7fcb8014cde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb800b69d0 tx=0x7fcb7800e9e0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 shutdown_connections 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb60068580 0x7fcb6006aa40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb8015c950 0x7fcb8014cde0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb8013b580 0x7fcb8015edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 --2- 172.21.15.39:0/1904253500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb8013b1a0 0x7fcb8013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 >> 172.21.15.39:0/1904253500 conn(0x7fcb8006d4e0 msgr2=0x7fcb800b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 shutdown_connections 2024-04-26T23:26:23.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.137+0000 7fcb86000640 1 -- 172.21.15.39:0/1904253500 wait complete. 2024-04-26T23:26:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.145+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9fd8150a30 con 0x7f9fd80d0890 2024-04-26T23:26:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.145+0000 7f9fd4c00640 1 -- 172.21.15.39:0/2077500001 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fd005e850 con 0x7f9fd80d0890 2024-04-26T23:26:23.151 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2024-04-26T23:26:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 msgr2=0x7f9fb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 0x7f9fb806a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4007a00 tx=0x7f9fc4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 msgr2=0x7f9fd81455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 0x7f9fd81455f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c6d0 tx=0x7f9fd000cb90 comp rx=0 tx=0).stop 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 shutdown_connections 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fb8068380 0x7f9fb806a840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd815afc0 0x7f9fd8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd80d0890 0x7f9fd81455f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 --2- 172.21.15.39:0/2077500001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fd80b4e00 0x7f9fd8148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 >> 172.21.15.39:0/2077500001 conn(0x7f9fd806cd70 msgr2=0x7f9fd81594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 shutdown_connections 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f9fdf600640 1 -- 172.21.15.39:0/2077500001 wait complete. 2024-04-26T23:26:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f594c005590 con 0x7f59580039c0 2024-04-26T23:26:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.149+0000 7f5971600640 1 -- 172.21.15.39:0/3465224391 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5964016130 con 0x7f59580039c0 2024-04-26T23:26:23.155 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 msgr2=0x7f595006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 0x7f595006a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59741e5270 tx=0x7f595c007040 comp rx=0 tx=0).stop 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 msgr2=0x7f59742016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5964005040 tx=0x7f5958005840 comp rx=0 tx=0).stop 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 shutdown_connections 2024-04-26T23:26:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5950068380 0x7f595006a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5974150c90 0x7f5974151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5974205290 0x7f5974205710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 --2- 172.21.15.39:0/3465224391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59580039c0 0x7f59742016f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 >> 172.21.15.39:0/3465224391 conn(0x7f597406cd70 msgr2=0x7f59740af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 shutdown_connections 2024-04-26T23:26:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.153+0000 7f597b800640 1 -- 172.21.15.39:0/3465224391 wait complete. 2024-04-26T23:26:23.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-26T23:26:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.165+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc1cc005590 con 0x7fc1d8004170 2024-04-26T23:26:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1ea000640 1 -- 172.21.15.39:0/1356226267 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1e0056a70 con 0x7fc1d8004170 2024-04-26T23:26:23.172 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-04-26T23:26:23.172 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 msgr2=0x7fc1d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 0x7fc1d406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1807d0 tx=0x7fc1e4007040 comp rx=0 tx=0).stop 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 msgr2=0x7fc1ec0523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d480 tx=0x7fc1e000d940 comp rx=0 tx=0).stop 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 shutdown_connections 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc1d4068380 0x7fc1d406a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1ec0d0b40 0x7fc1ec0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1ec0e07c0 0x7fc1ec0e0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 --2- 172.21.15.39:0/1356226267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1d8004170 0x7fc1ec0523d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 >> 172.21.15.39:0/1356226267 conn(0x7fc1ec0559b0 msgr2=0x7fc1ec039450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 shutdown_connections 2024-04-26T23:26:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.169+0000 7fc1f8a00640 1 -- 172.21.15.39:0/1356226267 wait complete. 2024-04-26T23:26:23.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-26T23:26:23.182 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-26T23:26:23.182 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-04-26T23:26:23.194 DEBUG:teuthology.parallel:result is None 2024-04-26T23:26:23.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:26:23.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:26:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 Processor -- start 2024-04-26T23:26:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 -- start start 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182015d1a0 0x7f1820160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d0b80 0x7f18200cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18200d1380 0x7f18200d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f18200b2dd0 con 0x7f182015d1a0 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f18200b2a80 con 0x7f18200d1380 2024-04-26T23:26:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1827000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1820161520 con 0x7f18200d0b80 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182015d1a0 0x7f1820160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182015d1a0 0x7f1820160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47734/0 (socket says 172.21.15.39:47734) 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 -- 172.21.15.39:0/481903992 learned_addr learned my addr 172.21.15.39:0/481903992 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1826600640 1 --2- 172.21.15.39:0/481903992 >> v2:172.21.15.71:3300/0 conn(0x7f18200d1380 0x7f18200d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825200640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d0b80 0x7f18200cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 -- 172.21.15.39:0/481903992 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d0b80 msgr2=0x7f18200cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d0b80 0x7f18200cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 -- 172.21.15.39:0/481903992 >> v2:172.21.15.71:3300/0 conn(0x7f18200d1380 msgr2=0x7f18200d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 --2- 172.21.15.39:0/481903992 >> v2:172.21.15.71:3300/0 conn(0x7f18200d1380 0x7f18200d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.377+0000 7f1825c00640 1 -- 172.21.15.39:0/481903992 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1820161800 con 0x7f182015d1a0 2024-04-26T23:26:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1825c00640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820160cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18200b2170 tx=0x7f181401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902232aba9d2c776 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f181fe00640 1 -- 172.21.15.39:0/481903992 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140b1070 con 0x7f182015d1a0 2024-04-26T23:26:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f181fe00640 1 -- 172.21.15.39:0/481903992 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140ac410 con 0x7f182015d1a0 2024-04-26T23:26:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f181fe00640 1 -- 172.21.15.39:0/481903992 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140ac7e0 con 0x7f182015d1a0 2024-04-26T23:26:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- 172.21.15.39:0/481903992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 msgr2=0x7f1820160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820160cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18200b2170 tx=0x7f181401c520 comp rx=0 tx=0).stop 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- 172.21.15.39:0/481903992 shutdown_connections 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 --2- 172.21.15.39:0/481903992 >> v2:172.21.15.71:3300/0 conn(0x7f18200d1380 0x7f18200d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d0b80 0x7f18200cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 --2- 172.21.15.39:0/481903992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820160cf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- 172.21.15.39:0/481903992 >> 172.21.15.39:0/481903992 conn(0x7f182009b9e0 msgr2=0x7f182009bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- 172.21.15.39:0/481903992 shutdown_connections 2024-04-26T23:26:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- 172.21.15.39:0/481903992 wait complete. 2024-04-26T23:26:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 Processor -- start 2024-04-26T23:26:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.381+0000 7f1827000640 1 -- start start 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200d0b80 0x7f18201576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d1380 0x7f1820154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f18200ce070 con 0x7f182015d1a0 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18200cdef0 con 0x7f18200d0b80 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18200b3a70 con 0x7f18200d1380 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47736/0 (socket says 172.21.15.39:47736) 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 -- 172.21.15.39:0/3406294524 learned_addr learned my addr 172.21.15.39:0/3406294524 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1825c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200d0b80 0x7f18201576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1825200640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d1380 0x7f1820154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 -- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d1380 msgr2=0x7f1820154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d1380 0x7f1820154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 -- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200d0b80 msgr2=0x7f18201576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200d0b80 0x7f18201576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 -- 172.21.15.39:0/3406294524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1820159890 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1826600640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1818009dd0 tx=0x7f181800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818018020 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1818014480 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818014870 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182015b6b0 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182015bc70 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18200506d0 con 0x7f182015d1a0 2024-04-26T23:26:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.385+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f181801b020 con 0x7f182015d1a0 2024-04-26T23:26:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.389+0000 7f181d600640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 0x7f180006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.389+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1818087600 con 0x7f182015d1a0 2024-04-26T23:26:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.389+0000 7f1825c00640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 0x7f180006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.389+0000 7f1825c00640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 0x7f180006a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18140ae000 tx=0x7f1814008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.393+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1818022030 con 0x7f182015d1a0 2024-04-26T23:26:23.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.553+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f182015a490 con 0x7f1800068380 2024-04-26T23:26:23.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.561+0000 7f181d600640 1 -- 172.21.15.39:0/3406294524 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f182015a490 con 0x7f1800068380 2024-04-26T23:26:23.569 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:23.571 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:26:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 msgr2=0x7f180006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 0x7f180006a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18140ae000 tx=0x7f1814008040 comp rx=0 tx=0).stop 2024-04-26T23:26:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 msgr2=0x7f1820155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1818009dd0 tx=0x7f181800c490 comp rx=0 tx=0).stop 2024-04-26T23:26:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 shutdown_connections 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1800068380 0x7f180006a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182015d1a0 0x7f1820155400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18200d1380 0x7f1820154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 --2- 172.21.15.39:0/3406294524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200d0b80 0x7f18201576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 >> 172.21.15.39:0/3406294524 conn(0x7f182009b9e0 msgr2=0x7f182009bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 shutdown_connections 2024-04-26T23:26:23.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.565+0000 7f1827000640 1 -- 172.21.15.39:0/3406294524 wait complete. 2024-04-26T23:26:23.588 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T23:26:21.658895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227344,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747376,"statfs":{"total":773094113280,"available":772861313024,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.956592"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736763+0000","last_change":"2024-04-26T23:26:14.750190+0000","last_active":"2024-04-26T23:26:15.736763+0000","last_peered":"2024-04-26T23:26:15.736763+0000","last_clean":"2024-04-26T23:26:15.736763+0000","last_became_active":"2024-04-26T23:26:14.749862+0000","last_became_peered":"2024-04-26T23:26:14.749862+0000","last_unstale":"2024-04-26T23:26:15.736763+0000","last_undegraded":"2024-04-26T23:26:15.736763+0000","last_fullsized":"2024-04-26T23:26:15.736763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723865+0000","last_change":"2024-04-26T23:26:14.724978+0000","last_active":"2024-04-26T23:26:15.723865+0000","last_peered":"2024-04-26T23:26:15.723865+0000","last_clean":"2024-04-26T23:26:15.723865+0000","last_became_active":"2024-04-26T23:26:14.724385+0000","last_became_peered":"2024-04-26T23:26:14.724385+0000","last_unstale":"2024-04-26T23:26:15.723865+0000","last_undegraded":"2024-04-26T23:26:15.723865+0000","last_fullsized":"2024-04-26T23:26:15.723865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736625+0000","last_change":"2024-04-26T23:26:14.724918+0000","last_active":"2024-04-26T23:26:15.736625+0000","last_peered":"2024-04-26T23:26:15.736625+0000","last_clean":"2024-04-26T23:26:15.736625+0000","last_became_active":"2024-04-26T23:26:14.724588+0000","last_became_peered":"2024-04-26T23:26:14.724588+0000","last_unstale":"2024-04-26T23:26:15.736625+0000","last_undegraded":"2024-04-26T23:26:15.736625+0000","last_fullsized":"2024-04-26T23:26:15.736625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725084+0000","last_change":"2024-04-26T23:26:14.723378+0000","last_active":"2024-04-26T23:26:15.725084+0000","last_peered":"2024-04-26T23:26:15.725084+0000","last_clean":"2024-04-26T23:26:15.725084+0000","last_became_active":"2024-04-26T23:26:14.722888+0000","last_became_peered":"2024-04-26T23:26:14.722888+0000","last_unstale":"2024-04-26T23:26:15.725084+0000","last_undegraded":"2024-04-26T23:26:15.725084+0000","last_fullsized":"2024-04-26T23:26:15.725084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736482+0000","last_change":"2024-04-26T23:26:14.733728+0000","last_active":"2024-04-26T23:26:15.736482+0000","last_peered":"2024-04-26T23:26:15.736482+0000","last_clean":"2024-04-26T23:26:15.736482+0000","last_became_active":"2024-04-26T23:26:14.733044+0000","last_became_peered":"2024-04-26T23:26:14.733044+0000","last_unstale":"2024-04-26T23:26:15.736482+0000","last_undegraded":"2024-04-26T23:26:15.736482+0000","last_fullsized":"2024-04-26T23:26:15.736482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725262+0000","last_change":"2024-04-26T23:26:14.724291+0000","last_active":"2024-04-26T23:26:15.725262+0000","last_peered":"2024-04-26T23:26:15.725262+0000","last_clean":"2024-04-26T23:26:15.725262+0000","last_became_active":"2024-04-26T23:26:14.724038+0000","last_became_peered":"2024-04-26T23:26:14.724038+0000","last_unstale":"2024-04-26T23:26:15.725262+0000","last_undegraded":"2024-04-26T23:26:15.725262+0000","last_fullsized":"2024-04-26T23:26:15.725262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736072+0000","last_change":"2024-04-26T23:26:14.728422+0000","last_active":"2024-04-26T23:26:15.736072+0000","last_peered":"2024-04-26T23:26:15.736072+0000","last_clean":"2024-04-26T23:26:15.736072+0000","last_became_active":"2024-04-26T23:26:14.728014+0000","last_became_peered":"2024-04-26T23:26:14.728014+0000","last_unstale":"2024-04-26T23:26:15.736072+0000","last_undegraded":"2024-04-26T23:26:15.736072+0000","last_fullsized":"2024-04-26T23:26:15.736072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735326+0000","last_change":"2024-04-26T23:26:14.720678+0000","last_active":"2024-04-26T23:26:15.735326+0000","last_peered":"2024-04-26T23:26:15.735326+0000","last_clean":"2024-04-26T23:26:15.735326+0000","last_became_active":"2024-04-26T23:26:14.720413+0000","last_became_peered":"2024-04-26T23:26:14.720413+0000","last_unstale":"2024-04-26T23:26:15.735326+0000","last_undegraded":"2024-04-26T23:26:15.735326+0000","last_fullsized":"2024-04-26T23:26:15.735326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736984+0000","last_change":"2024-04-26T23:26:14.746576+0000","last_active":"2024-04-26T23:26:15.736984+0000","last_peered":"2024-04-26T23:26:15.736984+0000","last_clean":"2024-04-26T23:26:15.736984+0000","last_became_active":"2024-04-26T23:26:14.745710+0000","last_became_peered":"2024-04-26T23:26:14.745710+0000","last_unstale":"2024-04-26T23:26:15.736984+0000","last_undegraded":"2024-04-26T23:26:15.736984+0000","last_fullsized":"2024-04-26T23:26:15.736984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:04.796305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735909+0000","last_change":"2024-04-26T23:26:14.736993+0000","last_active":"2024-04-26T23:26:15.735909+0000","last_peered":"2024-04-26T23:26:15.735909+0000","last_clean":"2024-04-26T23:26:15.735909+0000","last_became_active":"2024-04-26T23:26:14.736555+0000","last_became_peered":"2024-04-26T23:26:14.736555+0000","last_unstale":"2024-04-26T23:26:15.735909+0000","last_undegraded":"2024-04-26T23:26:15.735909+0000","last_fullsized":"2024-04-26T23:26:15.735909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735781+0000","last_change":"2024-04-26T23:26:14.738192+0000","last_active":"2024-04-26T23:26:15.735781+0000","last_peered":"2024-04-26T23:26:15.735781+0000","last_clean":"2024-04-26T23:26:15.735781+0000","last_became_active":"2024-04-26T23:26:14.735778+0000","last_became_peered":"2024-04-26T23:26:14.735778+0000","last_unstale":"2024-04-26T23:26:15.735781+0000","last_undegraded":"2024-04-26T23:26:15.735781+0000","last_fullsized":"2024-04-26T23:26:15.735781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723687+0000","last_change":"2024-04-26T23:26:14.746898+0000","last_active":"2024-04-26T23:26:15.723687+0000","last_peered":"2024-04-26T23:26:15.723687+0000","last_clean":"2024-04-26T23:26:15.723687+0000","last_became_active":"2024-04-26T23:26:14.743251+0000","last_became_peered":"2024-04-26T23:26:14.743251+0000","last_unstale":"2024-04-26T23:26:15.723687+0000","last_undegraded":"2024-04-26T23:26:15.723687+0000","last_fullsized":"2024-04-26T23:26:15.723687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:20.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737227+0000","last_change":"2024-04-26T23:26:14.740463+0000","last_active":"2024-04-26T23:26:15.737227+0000","last_peered":"2024-04-26T23:26:15.737227+0000","last_clean":"2024-04-26T23:26:15.737227+0000","last_became_active":"2024-04-26T23:26:14.740150+0000","last_became_peered":"2024-04-26T23:26:14.740150+0000","last_unstale":"2024-04-26T23:26:15.737227+0000","last_undegraded":"2024-04-26T23:26:15.737227+0000","last_fullsized":"2024-04-26T23:26:15.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736130+0000","last_change":"2024-04-26T23:26:14.728712+0000","last_active":"2024-04-26T23:26:15.736130+0000","last_peered":"2024-04-26T23:26:15.736130+0000","last_clean":"2024-04-26T23:26:15.736130+0000","last_became_active":"2024-04-26T23:26:14.728390+0000","last_became_peered":"2024-04-26T23:26:14.728390+0000","last_unstale":"2024-04-26T23:26:15.736130+0000","last_undegraded":"2024-04-26T23:26:15.736130+0000","last_fullsized":"2024-04-26T23:26:15.736130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:50.776227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723349+0000","last_change":"2024-04-26T23:26:14.739193+0000","last_active":"2024-04-26T23:26:15.723349+0000","last_peered":"2024-04-26T23:26:15.723349+0000","last_clean":"2024-04-26T23:26:15.723349+0000","last_became_active":"2024-04-26T23:26:14.739006+0000","last_became_peered":"2024-04-26T23:26:14.739006+0000","last_unstale":"2024-04-26T23:26:15.723349+0000","last_undegraded":"2024-04-26T23:26:15.723349+0000","last_fullsized":"2024-04-26T23:26:15.723349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723007+0000","last_change":"2024-04-26T23:26:14.732502+0000","last_active":"2024-04-26T23:26:15.723007+0000","last_peered":"2024-04-26T23:26:15.723007+0000","last_clean":"2024-04-26T23:26:15.723007+0000","last_became_active":"2024-04-26T23:26:14.732194+0000","last_became_peered":"2024-04-26T23:26:14.732194+0000","last_unstale":"2024-04-26T23:26:15.723007+0000","last_undegraded":"2024-04-26T23:26:15.723007+0000","last_fullsized":"2024-04-26T23:26:15.723007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724541+0000","last_change":"2024-04-26T23:26:14.742132+0000","last_active":"2024-04-26T23:26:15.724541+0000","last_peered":"2024-04-26T23:26:15.724541+0000","last_clean":"2024-04-26T23:26:15.724541+0000","last_became_active":"2024-04-26T23:26:14.741783+0000","last_became_peered":"2024-04-26T23:26:14.741783+0000","last_unstale":"2024-04-26T23:26:15.724541+0000","last_undegraded":"2024-04-26T23:26:15.724541+0000","last_fullsized":"2024-04-26T23:26:15.724541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:14.735635+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:14.735055+0000","last_became_peered":"2024-04-26T23:26:14.735055+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736912+0000","last_change":"2024-04-26T23:26:14.732726+0000","last_active":"2024-04-26T23:26:15.736912+0000","last_peered":"2024-04-26T23:26:15.736912+0000","last_clean":"2024-04-26T23:26:15.736912+0000","last_became_active":"2024-04-26T23:26:14.732453+0000","last_became_peered":"2024-04-26T23:26:14.732453+0000","last_unstale":"2024-04-26T23:26:15.736912+0000","last_undegraded":"2024-04-26T23:26:15.736912+0000","last_fullsized":"2024-04-26T23:26:15.736912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:26.906820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735761+0000","last_change":"2024-04-26T23:26:14.739109+0000","last_active":"2024-04-26T23:26:15.735761+0000","last_peered":"2024-04-26T23:26:15.735761+0000","last_clean":"2024-04-26T23:26:15.735761+0000","last_became_active":"2024-04-26T23:26:14.738756+0000","last_became_peered":"2024-04-26T23:26:14.738756+0000","last_unstale":"2024-04-26T23:26:15.735761+0000","last_undegraded":"2024-04-26T23:26:15.735761+0000","last_fullsized":"2024-04-26T23:26:15.735761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736250+0000","last_change":"2024-04-26T23:26:14.743573+0000","last_active":"2024-04-26T23:26:15.736250+0000","last_peered":"2024-04-26T23:26:15.736250+0000","last_clean":"2024-04-26T23:26:15.736250+0000","last_became_active":"2024-04-26T23:26:14.743307+0000","last_became_peered":"2024-04-26T23:26:14.743307+0000","last_unstale":"2024-04-26T23:26:15.736250+0000","last_undegraded":"2024-04-26T23:26:15.736250+0000","last_fullsized":"2024-04-26T23:26:15.736250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724521+0000","last_change":"2024-04-26T23:26:14.735001+0000","last_active":"2024-04-26T23:26:15.724521+0000","last_peered":"2024-04-26T23:26:15.724521+0000","last_clean":"2024-04-26T23:26:15.724521+0000","last_became_active":"2024-04-26T23:26:14.734736+0000","last_became_peered":"2024-04-26T23:26:14.734736+0000","last_unstale":"2024-04-26T23:26:15.724521+0000","last_undegraded":"2024-04-26T23:26:15.724521+0000","last_fullsized":"2024-04-26T23:26:15.724521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735364+0000","last_change":"2024-04-26T23:26:14.740226+0000","last_active":"2024-04-26T23:26:15.735364+0000","last_peered":"2024-04-26T23:26:15.735364+0000","last_clean":"2024-04-26T23:26:15.735364+0000","last_became_active":"2024-04-26T23:26:14.739943+0000","last_became_peered":"2024-04-26T23:26:14.739943+0000","last_unstale":"2024-04-26T23:26:15.735364+0000","last_undegraded":"2024-04-26T23:26:15.735364+0000","last_fullsized":"2024-04-26T23:26:15.735364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723048+0000","last_change":"2024-04-26T23:26:14.724087+0000","last_active":"2024-04-26T23:26:15.723048+0000","last_peered":"2024-04-26T23:26:15.723048+0000","last_clean":"2024-04-26T23:26:15.723048+0000","last_became_active":"2024-04-26T23:26:14.723715+0000","last_became_peered":"2024-04-26T23:26:14.723715+0000","last_unstale":"2024-04-26T23:26:15.723048+0000","last_undegraded":"2024-04-26T23:26:15.723048+0000","last_fullsized":"2024-04-26T23:26:15.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737556+0000","last_change":"2024-04-26T23:26:14.736545+0000","last_active":"2024-04-26T23:26:15.737556+0000","last_peered":"2024-04-26T23:26:15.737556+0000","last_clean":"2024-04-26T23:26:15.737556+0000","last_became_active":"2024-04-26T23:26:14.736290+0000","last_became_peered":"2024-04-26T23:26:14.736290+0000","last_unstale":"2024-04-26T23:26:15.737556+0000","last_undegraded":"2024-04-26T23:26:15.737556+0000","last_fullsized":"2024-04-26T23:26:15.737556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736017+0000","last_change":"2024-04-26T23:26:14.748640+0000","last_active":"2024-04-26T23:26:15.736017+0000","last_peered":"2024-04-26T23:26:15.736017+0000","last_clean":"2024-04-26T23:26:15.736017+0000","last_became_active":"2024-04-26T23:26:14.747387+0000","last_became_peered":"2024-04-26T23:26:14.747387+0000","last_unstale":"2024-04-26T23:26:15.736017+0000","last_undegraded":"2024-04-26T23:26:15.736017+0000","last_fullsized":"2024-04-26T23:26:15.736017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723738+0000","last_change":"2024-04-26T23:26:14.737597+0000","last_active":"2024-04-26T23:26:15.723738+0000","last_peered":"2024-04-26T23:26:15.723738+0000","last_clean":"2024-04-26T23:26:15.723738+0000","last_became_active":"2024-04-26T23:26:14.735590+0000","last_became_peered":"2024-04-26T23:26:14.735590+0000","last_unstale":"2024-04-26T23:26:15.723738+0000","last_undegraded":"2024-04-26T23:26:15.723738+0000","last_fullsized":"2024-04-26T23:26:15.723738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737377+0000","last_change":"2024-04-26T23:26:14.736063+0000","last_active":"2024-04-26T23:26:15.737377+0000","last_peered":"2024-04-26T23:26:15.737377+0000","last_clean":"2024-04-26T23:26:15.737377+0000","last_became_active":"2024-04-26T23:26:14.735857+0000","last_became_peered":"2024-04-26T23:26:14.735857+0000","last_unstale":"2024-04-26T23:26:15.737377+0000","last_undegraded":"2024-04-26T23:26:15.737377+0000","last_fullsized":"2024-04-26T23:26:15.737377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736401+0000","last_change":"2024-04-26T23:26:14.723733+0000","last_active":"2024-04-26T23:26:15.736401+0000","last_peered":"2024-04-26T23:26:15.736401+0000","last_clean":"2024-04-26T23:26:15.736401+0000","last_became_active":"2024-04-26T23:26:14.723459+0000","last_became_peered":"2024-04-26T23:26:14.723459+0000","last_unstale":"2024-04-26T23:26:15.736401+0000","last_undegraded":"2024-04-26T23:26:15.736401+0000","last_fullsized":"2024-04-26T23:26:15.736401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724727+0000","last_change":"2024-04-26T23:26:14.722556+0000","last_active":"2024-04-26T23:26:15.724727+0000","last_peered":"2024-04-26T23:26:15.724727+0000","last_clean":"2024-04-26T23:26:15.724727+0000","last_became_active":"2024-04-26T23:26:14.722259+0000","last_became_peered":"2024-04-26T23:26:14.722259+0000","last_unstale":"2024-04-26T23:26:15.724727+0000","last_undegraded":"2024-04-26T23:26:15.724727+0000","last_fullsized":"2024-04-26T23:26:15.724727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735569+0000","last_change":"2024-04-26T23:26:14.732537+0000","last_active":"2024-04-26T23:26:15.735569+0000","last_peered":"2024-04-26T23:26:15.735569+0000","last_clean":"2024-04-26T23:26:15.735569+0000","last_became_active":"2024-04-26T23:26:14.732051+0000","last_became_peered":"2024-04-26T23:26:14.732051+0000","last_unstale":"2024-04-26T23:26:15.735569+0000","last_undegraded":"2024-04-26T23:26:15.735569+0000","last_fullsized":"2024-04-26T23:26:15.735569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735547+0000","last_change":"2024-04-26T23:26:14.731655+0000","last_active":"2024-04-26T23:26:15.735547+0000","last_peered":"2024-04-26T23:26:15.735547+0000","last_clean":"2024-04-26T23:26:15.735547+0000","last_became_active":"2024-04-26T23:26:14.731379+0000","last_became_peered":"2024-04-26T23:26:14.731379+0000","last_unstale":"2024-04-26T23:26:15.735547+0000","last_undegraded":"2024-04-26T23:26:15.735547+0000","last_fullsized":"2024-04-26T23:26:15.735547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723549+0000","last_change":"2024-04-26T23:26:14.733290+0000","last_active":"2024-04-26T23:26:15.723549+0000","last_peered":"2024-04-26T23:26:15.723549+0000","last_clean":"2024-04-26T23:26:15.723549+0000","last_became_active":"2024-04-26T23:26:14.732863+0000","last_became_peered":"2024-04-26T23:26:14.732863+0000","last_unstale":"2024-04-26T23:26:15.723549+0000","last_undegraded":"2024-04-26T23:26:15.723549+0000","last_fullsized":"2024-04-26T23:26:15.723549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:36.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737262+0000","last_change":"2024-04-26T23:26:13.724097+0000","last_active":"2024-04-26T23:26:15.737262+0000","last_peered":"2024-04-26T23:26:15.737262+0000","last_clean":"2024-04-26T23:26:15.737262+0000","last_became_active":"2024-04-26T23:26:13.723161+0000","last_became_peered":"2024-04-26T23:26:13.723161+0000","last_unstale":"2024-04-26T23:26:15.737262+0000","last_undegraded":"2024-04-26T23:26:15.737262+0000","last_fullsized":"2024-04-26T23:26:15.737262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736414+0000","last_change":"2024-04-26T23:26:14.727155+0000","last_active":"2024-04-26T23:26:15.736414+0000","last_peered":"2024-04-26T23:26:15.736414+0000","last_clean":"2024-04-26T23:26:15.736414+0000","last_became_active":"2024-04-26T23:26:14.726867+0000","last_became_peered":"2024-04-26T23:26:14.726867+0000","last_unstale":"2024-04-26T23:26:15.736414+0000","last_undegraded":"2024-04-26T23:26:15.736414+0000","last_fullsized":"2024-04-26T23:26:15.736414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735577+0000","last_change":"2024-04-26T23:26:13.729977+0000","last_active":"2024-04-26T23:26:15.735577+0000","last_peered":"2024-04-26T23:26:15.735577+0000","last_clean":"2024-04-26T23:26:15.735577+0000","last_became_active":"2024-04-26T23:26:13.728795+0000","last_became_peered":"2024-04-26T23:26:13.728795+0000","last_unstale":"2024-04-26T23:26:15.735577+0000","last_undegraded":"2024-04-26T23:26:15.735577+0000","last_fullsized":"2024-04-26T23:26:15.735577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736357+0000","last_change":"2024-04-26T23:26:13.730567+0000","last_active":"2024-04-26T23:26:15.736357+0000","last_peered":"2024-04-26T23:26:15.736357+0000","last_clean":"2024-04-26T23:26:15.736357+0000","last_became_active":"2024-04-26T23:26:13.730321+0000","last_became_peered":"2024-04-26T23:26:13.730321+0000","last_unstale":"2024-04-26T23:26:15.736357+0000","last_undegraded":"2024-04-26T23:26:15.736357+0000","last_fullsized":"2024-04-26T23:26:15.736357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735371+0000","last_change":"2024-04-26T23:26:14.733324+0000","last_active":"2024-04-26T23:26:15.735371+0000","last_peered":"2024-04-26T23:26:15.735371+0000","last_clean":"2024-04-26T23:26:15.735371+0000","last_became_active":"2024-04-26T23:26:14.733059+0000","last_became_peered":"2024-04-26T23:26:14.733059+0000","last_unstale":"2024-04-26T23:26:15.735371+0000","last_undegraded":"2024-04-26T23:26:15.735371+0000","last_fullsized":"2024-04-26T23:26:15.735371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723137+0000","last_change":"2024-04-26T23:26:13.714305+0000","last_active":"2024-04-26T23:26:15.723137+0000","last_peered":"2024-04-26T23:26:15.723137+0000","last_clean":"2024-04-26T23:26:15.723137+0000","last_became_active":"2024-04-26T23:26:13.713944+0000","last_became_peered":"2024-04-26T23:26:13.713944+0000","last_unstale":"2024-04-26T23:26:15.723137+0000","last_undegraded":"2024-04-26T23:26:15.723137+0000","last_fullsized":"2024-04-26T23:26:15.723137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:14.729913+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:14.729650+0000","last_became_peered":"2024-04-26T23:26:14.729650+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735790+0000","last_change":"2024-04-26T23:26:13.735343+0000","last_active":"2024-04-26T23:26:15.735790+0000","last_peered":"2024-04-26T23:26:15.735790+0000","last_clean":"2024-04-26T23:26:15.735790+0000","last_became_active":"2024-04-26T23:26:13.734994+0000","last_became_peered":"2024-04-26T23:26:13.734994+0000","last_unstale":"2024-04-26T23:26:15.735790+0000","last_undegraded":"2024-04-26T23:26:15.735790+0000","last_fullsized":"2024-04-26T23:26:15.735790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724315+0000","last_change":"2024-04-26T23:26:14.742311+0000","last_active":"2024-04-26T23:26:15.724315+0000","last_peered":"2024-04-26T23:26:15.724315+0000","last_clean":"2024-04-26T23:26:15.724315+0000","last_became_active":"2024-04-26T23:26:14.742033+0000","last_became_peered":"2024-04-26T23:26:14.742033+0000","last_unstale":"2024-04-26T23:26:15.724315+0000","last_undegraded":"2024-04-26T23:26:15.724315+0000","last_fullsized":"2024-04-26T23:26:15.724315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724308+0000","last_change":"2024-04-26T23:26:13.733199+0000","last_active":"2024-04-26T23:26:15.724308+0000","last_peered":"2024-04-26T23:26:15.724308+0000","last_clean":"2024-04-26T23:26:15.724308+0000","last_became_active":"2024-04-26T23:26:13.732940+0000","last_became_peered":"2024-04-26T23:26:13.732940+0000","last_unstale":"2024-04-26T23:26:15.724308+0000","last_undegraded":"2024-04-26T23:26:15.724308+0000","last_fullsized":"2024-04-26T23:26:15.724308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736800+0000","last_change":"2024-04-26T23:26:14.729724+0000","last_active":"2024-04-26T23:26:15.736800+0000","last_peered":"2024-04-26T23:26:15.736800+0000","last_clean":"2024-04-26T23:26:15.736800+0000","last_became_active":"2024-04-26T23:26:14.729430+0000","last_became_peered":"2024-04-26T23:26:14.729430+0000","last_unstale":"2024-04-26T23:26:15.736800+0000","last_undegraded":"2024-04-26T23:26:15.736800+0000","last_fullsized":"2024-04-26T23:26:15.736800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723725+0000","last_change":"2024-04-26T23:26:13.724763+0000","last_active":"2024-04-26T23:26:15.723725+0000","last_peered":"2024-04-26T23:26:15.723725+0000","last_clean":"2024-04-26T23:26:15.723725+0000","last_became_active":"2024-04-26T23:26:13.724483+0000","last_became_peered":"2024-04-26T23:26:13.724483+0000","last_unstale":"2024-04-26T23:26:15.723725+0000","last_undegraded":"2024-04-26T23:26:15.723725+0000","last_fullsized":"2024-04-26T23:26:15.723725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723791+0000","last_change":"2024-04-26T23:26:14.733025+0000","last_active":"2024-04-26T23:26:15.723791+0000","last_peered":"2024-04-26T23:26:15.723791+0000","last_clean":"2024-04-26T23:26:15.723791+0000","last_became_active":"2024-04-26T23:26:14.732739+0000","last_became_peered":"2024-04-26T23:26:14.732739+0000","last_unstale":"2024-04-26T23:26:15.723791+0000","last_undegraded":"2024-04-26T23:26:15.723791+0000","last_fullsized":"2024-04-26T23:26:15.723791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735689+0000","last_change":"2024-04-26T23:26:13.729905+0000","last_active":"2024-04-26T23:26:15.735689+0000","last_peered":"2024-04-26T23:26:15.735689+0000","last_clean":"2024-04-26T23:26:15.735689+0000","last_became_active":"2024-04-26T23:26:13.729641+0000","last_became_peered":"2024-04-26T23:26:13.729641+0000","last_unstale":"2024-04-26T23:26:15.735689+0000","last_undegraded":"2024-04-26T23:26:15.735689+0000","last_fullsized":"2024-04-26T23:26:15.735689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736765+0000","last_change":"2024-04-26T23:26:14.744333+0000","last_active":"2024-04-26T23:26:15.736765+0000","last_peered":"2024-04-26T23:26:15.736765+0000","last_clean":"2024-04-26T23:26:15.736765+0000","last_became_active":"2024-04-26T23:26:14.741477+0000","last_became_peered":"2024-04-26T23:26:14.741477+0000","last_unstale":"2024-04-26T23:26:15.736765+0000","last_undegraded":"2024-04-26T23:26:15.736765+0000","last_fullsized":"2024-04-26T23:26:15.736765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736523+0000","last_change":"2024-04-26T23:26:13.724495+0000","last_active":"2024-04-26T23:26:15.736523+0000","last_peered":"2024-04-26T23:26:15.736523+0000","last_clean":"2024-04-26T23:26:15.736523+0000","last_became_active":"2024-04-26T23:26:13.722127+0000","last_became_peered":"2024-04-26T23:26:13.722127+0000","last_unstale":"2024-04-26T23:26:15.736523+0000","last_undegraded":"2024-04-26T23:26:15.736523+0000","last_fullsized":"2024-04-26T23:26:15.736523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736199+0000","last_change":"2024-04-26T23:26:14.730136+0000","last_active":"2024-04-26T23:26:15.736199+0000","last_peered":"2024-04-26T23:26:15.736199+0000","last_clean":"2024-04-26T23:26:15.736199+0000","last_became_active":"2024-04-26T23:26:14.729903+0000","last_became_peered":"2024-04-26T23:26:14.729903+0000","last_unstale":"2024-04-26T23:26:15.736199+0000","last_undegraded":"2024-04-26T23:26:15.736199+0000","last_fullsized":"2024-04-26T23:26:15.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724823+0000","last_change":"2024-04-26T23:26:13.730110+0000","last_active":"2024-04-26T23:26:15.724823+0000","last_peered":"2024-04-26T23:26:15.724823+0000","last_clean":"2024-04-26T23:26:15.724823+0000","last_became_active":"2024-04-26T23:26:13.729806+0000","last_became_peered":"2024-04-26T23:26:13.729806+0000","last_unstale":"2024-04-26T23:26:15.724823+0000","last_undegraded":"2024-04-26T23:26:15.724823+0000","last_fullsized":"2024-04-26T23:26:15.724823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736577+0000","last_change":"2024-04-26T23:26:14.739556+0000","last_active":"2024-04-26T23:26:15.736577+0000","last_peered":"2024-04-26T23:26:15.736577+0000","last_clean":"2024-04-26T23:26:15.736577+0000","last_became_active":"2024-04-26T23:26:14.739201+0000","last_became_peered":"2024-04-26T23:26:14.739201+0000","last_unstale":"2024-04-26T23:26:15.736577+0000","last_undegraded":"2024-04-26T23:26:15.736577+0000","last_fullsized":"2024-04-26T23:26:15.736577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735986+0000","last_change":"2024-04-26T23:26:13.736521+0000","last_active":"2024-04-26T23:26:15.735986+0000","last_peered":"2024-04-26T23:26:15.735986+0000","last_clean":"2024-04-26T23:26:15.735986+0000","last_became_active":"2024-04-26T23:26:13.736233+0000","last_became_peered":"2024-04-26T23:26:13.736233+0000","last_unstale":"2024-04-26T23:26:15.735986+0000","last_undegraded":"2024-04-26T23:26:15.735986+0000","last_fullsized":"2024-04-26T23:26:15.735986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735936+0000","last_change":"2024-04-26T23:26:14.731078+0000","last_active":"2024-04-26T23:26:15.735936+0000","last_peered":"2024-04-26T23:26:15.735936+0000","last_clean":"2024-04-26T23:26:15.735936+0000","last_became_active":"2024-04-26T23:26:14.730526+0000","last_became_peered":"2024-04-26T23:26:14.730526+0000","last_unstale":"2024-04-26T23:26:15.735936+0000","last_undegraded":"2024-04-26T23:26:15.735936+0000","last_fullsized":"2024-04-26T23:26:15.735936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735491+0000","last_change":"2024-04-26T23:26:13.720259+0000","last_active":"2024-04-26T23:26:15.735491+0000","last_peered":"2024-04-26T23:26:15.735491+0000","last_clean":"2024-04-26T23:26:15.735491+0000","last_became_active":"2024-04-26T23:26:13.719993+0000","last_became_peered":"2024-04-26T23:26:13.719993+0000","last_unstale":"2024-04-26T23:26:15.735491+0000","last_undegraded":"2024-04-26T23:26:15.735491+0000","last_fullsized":"2024-04-26T23:26:15.735491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736174+0000","last_change":"2024-04-26T23:26:14.744189+0000","last_active":"2024-04-26T23:26:15.736174+0000","last_peered":"2024-04-26T23:26:15.736174+0000","last_clean":"2024-04-26T23:26:15.736174+0000","last_became_active":"2024-04-26T23:26:14.742691+0000","last_became_peered":"2024-04-26T23:26:14.742691+0000","last_unstale":"2024-04-26T23:26:15.736174+0000","last_undegraded":"2024-04-26T23:26:15.736174+0000","last_fullsized":"2024-04-26T23:26:15.736174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725515+0000","last_change":"2024-04-26T23:26:13.722716+0000","last_active":"2024-04-26T23:26:15.725515+0000","last_peered":"2024-04-26T23:26:15.725515+0000","last_clean":"2024-04-26T23:26:15.725515+0000","last_became_active":"2024-04-26T23:26:13.722282+0000","last_became_peered":"2024-04-26T23:26:13.722282+0000","last_unstale":"2024-04-26T23:26:15.725515+0000","last_undegraded":"2024-04-26T23:26:15.725515+0000","last_fullsized":"2024-04-26T23:26:15.725515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:03.302571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736807+0000","last_change":"2024-04-26T23:26:14.745739+0000","last_active":"2024-04-26T23:26:15.736807+0000","last_peered":"2024-04-26T23:26:15.736807+0000","last_clean":"2024-04-26T23:26:15.736807+0000","last_became_active":"2024-04-26T23:26:14.745393+0000","last_became_peered":"2024-04-26T23:26:14.745393+0000","last_unstale":"2024-04-26T23:26:15.736807+0000","last_undegraded":"2024-04-26T23:26:15.736807+0000","last_fullsized":"2024-04-26T23:26:15.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736102+0000","last_change":"2024-04-26T23:26:13.720970+0000","last_active":"2024-04-26T23:26:15.736102+0000","last_peered":"2024-04-26T23:26:15.736102+0000","last_clean":"2024-04-26T23:26:15.736102+0000","last_became_active":"2024-04-26T23:26:13.720659+0000","last_became_peered":"2024-04-26T23:26:13.720659+0000","last_unstale":"2024-04-26T23:26:15.736102+0000","last_undegraded":"2024-04-26T23:26:15.736102+0000","last_fullsized":"2024-04-26T23:26:15.736102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736992+0000","last_change":"2024-04-26T23:26:14.746831+0000","last_active":"2024-04-26T23:26:15.736992+0000","last_peered":"2024-04-26T23:26:15.736992+0000","last_clean":"2024-04-26T23:26:15.736992+0000","last_became_active":"2024-04-26T23:26:14.746189+0000","last_became_peered":"2024-04-26T23:26:14.746189+0000","last_unstale":"2024-04-26T23:26:15.736992+0000","last_undegraded":"2024-04-26T23:26:15.736992+0000","last_fullsized":"2024-04-26T23:26:15.736992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:58.384739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723835+0000","last_change":"2024-04-26T23:26:13.716047+0000","last_active":"2024-04-26T23:26:15.723835+0000","last_peered":"2024-04-26T23:26:15.723835+0000","last_clean":"2024-04-26T23:26:15.723835+0000","last_became_active":"2024-04-26T23:26:13.715774+0000","last_became_peered":"2024-04-26T23:26:13.715774+0000","last_unstale":"2024-04-26T23:26:15.723835+0000","last_undegraded":"2024-04-26T23:26:15.723835+0000","last_fullsized":"2024-04-26T23:26:15.723835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725303+0000","last_change":"2024-04-26T23:26:14.723161+0000","last_active":"2024-04-26T23:26:15.725303+0000","last_peered":"2024-04-26T23:26:15.725303+0000","last_clean":"2024-04-26T23:26:15.725303+0000","last_became_active":"2024-04-26T23:26:14.722467+0000","last_became_peered":"2024-04-26T23:26:14.722467+0000","last_unstale":"2024-04-26T23:26:15.725303+0000","last_undegraded":"2024-04-26T23:26:15.725303+0000","last_fullsized":"2024-04-26T23:26:15.725303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735933+0000","last_change":"2024-04-26T23:26:13.723125+0000","last_active":"2024-04-26T23:26:15.735933+0000","last_peered":"2024-04-26T23:26:15.735933+0000","last_clean":"2024-04-26T23:26:15.735933+0000","last_became_active":"2024-04-26T23:26:13.722807+0000","last_became_peered":"2024-04-26T23:26:13.722807+0000","last_unstale":"2024-04-26T23:26:15.735933+0000","last_undegraded":"2024-04-26T23:26:15.735933+0000","last_fullsized":"2024-04-26T23:26:15.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736740+0000","last_change":"2024-04-26T23:26:14.736690+0000","last_active":"2024-04-26T23:26:15.736740+0000","last_peered":"2024-04-26T23:26:15.736740+0000","last_clean":"2024-04-26T23:26:15.736740+0000","last_became_active":"2024-04-26T23:26:14.736316+0000","last_became_peered":"2024-04-26T23:26:14.736316+0000","last_unstale":"2024-04-26T23:26:15.736740+0000","last_undegraded":"2024-04-26T23:26:15.736740+0000","last_fullsized":"2024-04-26T23:26:15.736740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736227+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:26:15.736227+0000","last_peered":"2024-04-26T23:26:15.736227+0000","last_clean":"2024-04-26T23:26:15.736227+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:26:15.736227+0000","last_undegraded":"2024-04-26T23:26:15.736227+0000","last_fullsized":"2024-04-26T23:26:15.736227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723256+0000","last_change":"2024-04-26T23:26:13.722340+0000","last_active":"2024-04-26T23:26:15.723256+0000","last_peered":"2024-04-26T23:26:15.723256+0000","last_clean":"2024-04-26T23:26:15.723256+0000","last_became_active":"2024-04-26T23:26:13.721645+0000","last_became_peered":"2024-04-26T23:26:13.721645+0000","last_unstale":"2024-04-26T23:26:15.723256+0000","last_undegraded":"2024-04-26T23:26:15.723256+0000","last_fullsized":"2024-04-26T23:26:15.723256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736573+0000","last_change":"2024-04-26T23:26:14.733211+0000","last_active":"2024-04-26T23:26:15.736573+0000","last_peered":"2024-04-26T23:26:15.736573+0000","last_clean":"2024-04-26T23:26:15.736573+0000","last_became_active":"2024-04-26T23:26:14.732931+0000","last_became_peered":"2024-04-26T23:26:14.732931+0000","last_unstale":"2024-04-26T23:26:15.736573+0000","last_undegraded":"2024-04-26T23:26:15.736573+0000","last_fullsized":"2024-04-26T23:26:15.736573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:13.726362+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:13.725944+0000","last_became_peered":"2024-04-26T23:26:13.725944+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735941+0000","last_change":"2024-04-26T23:26:14.715493+0000","last_active":"2024-04-26T23:26:15.735941+0000","last_peered":"2024-04-26T23:26:15.735941+0000","last_clean":"2024-04-26T23:26:15.735941+0000","last_became_active":"2024-04-26T23:26:14.715120+0000","last_became_peered":"2024-04-26T23:26:14.715120+0000","last_unstale":"2024-04-26T23:26:15.735941+0000","last_undegraded":"2024-04-26T23:26:15.735941+0000","last_fullsized":"2024-04-26T23:26:15.735941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:14.575559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735840+0000","last_change":"2024-04-26T23:26:13.718666+0000","last_active":"2024-04-26T23:26:15.735840+0000","last_peered":"2024-04-26T23:26:15.735840+0000","last_clean":"2024-04-26T23:26:15.735840+0000","last_became_active":"2024-04-26T23:26:13.718352+0000","last_became_peered":"2024-04-26T23:26:13.718352+0000","last_unstale":"2024-04-26T23:26:15.735840+0000","last_undegraded":"2024-04-26T23:26:15.735840+0000","last_fullsized":"2024-04-26T23:26:15.735840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723353+0000","last_change":"2024-04-26T23:26:14.731553+0000","last_active":"2024-04-26T23:26:15.723353+0000","last_peered":"2024-04-26T23:26:15.723353+0000","last_clean":"2024-04-26T23:26:15.723353+0000","last_became_active":"2024-04-26T23:26:14.730918+0000","last_became_peered":"2024-04-26T23:26:14.730918+0000","last_unstale":"2024-04-26T23:26:15.723353+0000","last_undegraded":"2024-04-26T23:26:15.723353+0000","last_fullsized":"2024-04-26T23:26:15.723353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724912+0000","last_change":"2024-04-26T23:26:13.727250+0000","last_active":"2024-04-26T23:26:15.724912+0000","last_peered":"2024-04-26T23:26:15.724912+0000","last_clean":"2024-04-26T23:26:15.724912+0000","last_became_active":"2024-04-26T23:26:13.726714+0000","last_became_peered":"2024-04-26T23:26:13.726714+0000","last_unstale":"2024-04-26T23:26:15.724912+0000","last_undegraded":"2024-04-26T23:26:15.724912+0000","last_fullsized":"2024-04-26T23:26:15.724912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724072+0000","last_change":"2024-04-26T23:26:14.730947+0000","last_active":"2024-04-26T23:26:15.724072+0000","last_peered":"2024-04-26T23:26:15.724072+0000","last_clean":"2024-04-26T23:26:15.724072+0000","last_became_active":"2024-04-26T23:26:14.730626+0000","last_became_peered":"2024-04-26T23:26:14.730626+0000","last_unstale":"2024-04-26T23:26:15.724072+0000","last_undegraded":"2024-04-26T23:26:15.724072+0000","last_fullsized":"2024-04-26T23:26:15.724072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723662+0000","last_change":"2024-04-26T23:26:13.723935+0000","last_active":"2024-04-26T23:26:15.723662+0000","last_peered":"2024-04-26T23:26:15.723662+0000","last_clean":"2024-04-26T23:26:15.723662+0000","last_became_active":"2024-04-26T23:26:13.723536+0000","last_became_peered":"2024-04-26T23:26:13.723536+0000","last_unstale":"2024-04-26T23:26:15.723662+0000","last_undegraded":"2024-04-26T23:26:15.723662+0000","last_fullsized":"2024-04-26T23:26:15.723662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723671+0000","last_change":"2024-04-26T23:26:14.725964+0000","last_active":"2024-04-26T23:26:15.723671+0000","last_peered":"2024-04-26T23:26:15.723671+0000","last_clean":"2024-04-26T23:26:15.723671+0000","last_became_active":"2024-04-26T23:26:14.724935+0000","last_became_peered":"2024-04-26T23:26:14.724935+0000","last_unstale":"2024-04-26T23:26:15.723671+0000","last_undegraded":"2024-04-26T23:26:15.723671+0000","last_fullsized":"2024-04-26T23:26:15.723671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736960+0000","last_change":"2024-04-26T23:26:13.728354+0000","last_active":"2024-04-26T23:26:15.736960+0000","last_peered":"2024-04-26T23:26:15.736960+0000","last_clean":"2024-04-26T23:26:15.736960+0000","last_became_active":"2024-04-26T23:26:13.727416+0000","last_became_peered":"2024-04-26T23:26:13.727416+0000","last_unstale":"2024-04-26T23:26:15.736960+0000","last_undegraded":"2024-04-26T23:26:15.736960+0000","last_fullsized":"2024-04-26T23:26:15.736960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:22.327383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723520+0000","last_change":"2024-04-26T23:26:14.728202+0000","last_active":"2024-04-26T23:26:15.723520+0000","last_peered":"2024-04-26T23:26:15.723520+0000","last_clean":"2024-04-26T23:26:15.723520+0000","last_became_active":"2024-04-26T23:26:14.725745+0000","last_became_peered":"2024-04-26T23:26:14.725745+0000","last_unstale":"2024-04-26T23:26:15.723520+0000","last_undegraded":"2024-04-26T23:26:15.723520+0000","last_fullsized":"2024-04-26T23:26:15.723520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723857+0000","last_change":"2024-04-26T23:26:13.734188+0000","last_active":"2024-04-26T23:26:15.723857+0000","last_peered":"2024-04-26T23:26:15.723857+0000","last_clean":"2024-04-26T23:26:15.723857+0000","last_became_active":"2024-04-26T23:26:13.733977+0000","last_became_peered":"2024-04-26T23:26:13.733977+0000","last_unstale":"2024-04-26T23:26:15.723857+0000","last_undegraded":"2024-04-26T23:26:15.723857+0000","last_fullsized":"2024-04-26T23:26:15.723857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737564+0000","last_change":"2024-04-26T23:26:14.743925+0000","last_active":"2024-04-26T23:26:15.737564+0000","last_peered":"2024-04-26T23:26:15.737564+0000","last_clean":"2024-04-26T23:26:15.737564+0000","last_became_active":"2024-04-26T23:26:14.743638+0000","last_became_peered":"2024-04-26T23:26:14.743638+0000","last_unstale":"2024-04-26T23:26:15.737564+0000","last_undegraded":"2024-04-26T23:26:15.737564+0000","last_fullsized":"2024-04-26T23:26:15.737564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735918+0000","last_change":"2024-04-26T23:26:13.734100+0000","last_active":"2024-04-26T23:26:15.735918+0000","last_peered":"2024-04-26T23:26:15.735918+0000","last_clean":"2024-04-26T23:26:15.735918+0000","last_became_active":"2024-04-26T23:26:13.733667+0000","last_became_peered":"2024-04-26T23:26:13.733667+0000","last_unstale":"2024-04-26T23:26:15.735918+0000","last_undegraded":"2024-04-26T23:26:15.735918+0000","last_fullsized":"2024-04-26T23:26:15.735918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736866+0000","last_change":"2024-04-26T23:26:14.734618+0000","last_active":"2024-04-26T23:26:15.736866+0000","last_peered":"2024-04-26T23:26:15.736866+0000","last_clean":"2024-04-26T23:26:15.736866+0000","last_became_active":"2024-04-26T23:26:14.734369+0000","last_became_peered":"2024-04-26T23:26:14.734369+0000","last_unstale":"2024-04-26T23:26:15.736866+0000","last_undegraded":"2024-04-26T23:26:15.736866+0000","last_fullsized":"2024-04-26T23:26:15.736866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736054+0000","last_change":"2024-04-26T23:26:13.730845+0000","last_active":"2024-04-26T23:26:15.736054+0000","last_peered":"2024-04-26T23:26:15.736054+0000","last_clean":"2024-04-26T23:26:15.736054+0000","last_became_active":"2024-04-26T23:26:13.730510+0000","last_became_peered":"2024-04-26T23:26:13.730510+0000","last_unstale":"2024-04-26T23:26:15.736054+0000","last_undegraded":"2024-04-26T23:26:15.736054+0000","last_fullsized":"2024-04-26T23:26:15.736054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723134+0000","last_change":"2024-04-26T23:26:14.729756+0000","last_active":"2024-04-26T23:26:15.723134+0000","last_peered":"2024-04-26T23:26:15.723134+0000","last_clean":"2024-04-26T23:26:15.723134+0000","last_became_active":"2024-04-26T23:26:14.729469+0000","last_became_peered":"2024-04-26T23:26:14.729469+0000","last_unstale":"2024-04-26T23:26:15.723134+0000","last_undegraded":"2024-04-26T23:26:15.723134+0000","last_fullsized":"2024-04-26T23:26:15.723134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:40.724145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723464+0000","last_change":"2024-04-26T23:26:13.732419+0000","last_active":"2024-04-26T23:26:15.723464+0000","last_peered":"2024-04-26T23:26:15.723464+0000","last_clean":"2024-04-26T23:26:15.723464+0000","last_became_active":"2024-04-26T23:26:13.732075+0000","last_became_peered":"2024-04-26T23:26:13.732075+0000","last_unstale":"2024-04-26T23:26:15.723464+0000","last_undegraded":"2024-04-26T23:26:15.723464+0000","last_fullsized":"2024-04-26T23:26:15.723464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735487+0000","last_change":"2024-04-26T23:26:14.734658+0000","last_active":"2024-04-26T23:26:15.735487+0000","last_peered":"2024-04-26T23:26:15.735487+0000","last_clean":"2024-04-26T23:26:15.735487+0000","last_became_active":"2024-04-26T23:26:14.734365+0000","last_became_peered":"2024-04-26T23:26:14.734365+0000","last_unstale":"2024-04-26T23:26:15.735487+0000","last_undegraded":"2024-04-26T23:26:15.735487+0000","last_fullsized":"2024-04-26T23:26:15.735487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:13.717076+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:13.716768+0000","last_became_peered":"2024-04-26T23:26:13.716768+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737169+0000","last_change":"2024-04-26T23:26:14.739852+0000","last_active":"2024-04-26T23:26:15.737169+0000","last_peered":"2024-04-26T23:26:15.737169+0000","last_clean":"2024-04-26T23:26:15.737169+0000","last_became_active":"2024-04-26T23:26:14.732086+0000","last_became_peered":"2024-04-26T23:26:14.732086+0000","last_unstale":"2024-04-26T23:26:15.737169+0000","last_undegraded":"2024-04-26T23:26:15.737169+0000","last_fullsized":"2024-04-26T23:26:15.737169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736729+0000","last_change":"2024-04-26T23:26:13.725980+0000","last_active":"2024-04-26T23:26:15.736729+0000","last_peered":"2024-04-26T23:26:15.736729+0000","last_clean":"2024-04-26T23:26:15.736729+0000","last_became_active":"2024-04-26T23:26:13.725692+0000","last_became_peered":"2024-04-26T23:26:13.725692+0000","last_unstale":"2024-04-26T23:26:15.736729+0000","last_undegraded":"2024-04-26T23:26:15.736729+0000","last_fullsized":"2024-04-26T23:26:15.736729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735910+0000","last_change":"2024-04-26T23:26:14.735387+0000","last_active":"2024-04-26T23:26:15.735910+0000","last_peered":"2024-04-26T23:26:15.735910+0000","last_clean":"2024-04-26T23:26:15.735910+0000","last_became_active":"2024-04-26T23:26:14.735036+0000","last_became_peered":"2024-04-26T23:26:14.735036+0000","last_unstale":"2024-04-26T23:26:15.735910+0000","last_undegraded":"2024-04-26T23:26:15.735910+0000","last_fullsized":"2024-04-26T23:26:15.735910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723581+0000","last_change":"2024-04-26T23:26:14.736310+0000","last_active":"2024-04-26T23:26:15.723581+0000","last_peered":"2024-04-26T23:26:15.723581+0000","last_clean":"2024-04-26T23:26:15.723581+0000","last_became_active":"2024-04-26T23:26:14.735927+0000","last_became_peered":"2024-04-26T23:26:14.735927+0000","last_unstale":"2024-04-26T23:26:15.723581+0000","last_undegraded":"2024-04-26T23:26:15.723581+0000","last_fullsized":"2024-04-26T23:26:15.723581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736622+0000","last_change":"2024-04-26T23:26:13.725017+0000","last_active":"2024-04-26T23:26:15.736622+0000","last_peered":"2024-04-26T23:26:15.736622+0000","last_clean":"2024-04-26T23:26:15.736622+0000","last_became_active":"2024-04-26T23:26:13.724363+0000","last_became_peered":"2024-04-26T23:26:13.724363+0000","last_unstale":"2024-04-26T23:26:15.736622+0000","last_undegraded":"2024-04-26T23:26:15.736622+0000","last_fullsized":"2024-04-26T23:26:15.736622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:46.949014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725323+0000","last_change":"2024-04-26T23:26:14.744041+0000","last_active":"2024-04-26T23:26:15.725323+0000","last_peered":"2024-04-26T23:26:15.725323+0000","last_clean":"2024-04-26T23:26:15.725323+0000","last_became_active":"2024-04-26T23:26:14.743726+0000","last_became_peered":"2024-04-26T23:26:14.743726+0000","last_unstale":"2024-04-26T23:26:15.725323+0000","last_undegraded":"2024-04-26T23:26:15.725323+0000","last_fullsized":"2024-04-26T23:26:15.725323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736853+0000","last_change":"2024-04-26T23:26:13.737149+0000","last_active":"2024-04-26T23:26:15.736853+0000","last_peered":"2024-04-26T23:26:15.736853+0000","last_clean":"2024-04-26T23:26:15.736853+0000","last_became_active":"2024-04-26T23:26:13.736573+0000","last_became_peered":"2024-04-26T23:26:13.736573+0000","last_unstale":"2024-04-26T23:26:15.736853+0000","last_undegraded":"2024-04-26T23:26:15.736853+0000","last_fullsized":"2024-04-26T23:26:15.736853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:50.948166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736769+0000","last_change":"2024-04-26T23:26:14.722451+0000","last_active":"2024-04-26T23:26:15.736769+0000","last_peered":"2024-04-26T23:26:15.736769+0000","last_clean":"2024-04-26T23:26:15.736769+0000","last_became_active":"2024-04-26T23:26:14.719570+0000","last_became_peered":"2024-04-26T23:26:14.719570+0000","last_unstale":"2024-04-26T23:26:15.736769+0000","last_undegraded":"2024-04-26T23:26:15.736769+0000","last_fullsized":"2024-04-26T23:26:15.736769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737451+0000","last_change":"2024-04-26T23:26:13.729916+0000","last_active":"2024-04-26T23:26:15.737451+0000","last_peered":"2024-04-26T23:26:15.737451+0000","last_clean":"2024-04-26T23:26:15.737451+0000","last_became_active":"2024-04-26T23:26:13.729382+0000","last_became_peered":"2024-04-26T23:26:13.729382+0000","last_unstale":"2024-04-26T23:26:15.737451+0000","last_undegraded":"2024-04-26T23:26:15.737451+0000","last_fullsized":"2024-04-26T23:26:15.737451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737423+0000","last_change":"2024-04-26T23:26:14.734991+0000","last_active":"2024-04-26T23:26:15.737423+0000","last_peered":"2024-04-26T23:26:15.737423+0000","last_clean":"2024-04-26T23:26:15.737423+0000","last_became_active":"2024-04-26T23:26:14.734727+0000","last_became_peered":"2024-04-26T23:26:14.734727+0000","last_unstale":"2024-04-26T23:26:15.737423+0000","last_undegraded":"2024-04-26T23:26:15.737423+0000","last_fullsized":"2024-04-26T23:26:15.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736858+0000","last_change":"2024-04-26T23:26:13.732964+0000","last_active":"2024-04-26T23:26:15.736858+0000","last_peered":"2024-04-26T23:26:15.736858+0000","last_clean":"2024-04-26T23:26:15.736858+0000","last_became_active":"2024-04-26T23:26:13.732485+0000","last_became_peered":"2024-04-26T23:26:13.732485+0000","last_unstale":"2024-04-26T23:26:15.736858+0000","last_undegraded":"2024-04-26T23:26:15.736858+0000","last_fullsized":"2024-04-26T23:26:15.736858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:26:23.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:26:23.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 Processor -- start 2024-04-26T23:26:23.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 -- start start 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b440cf2a0 0x7f5b4406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 0x7f5b440cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b44160060 con 0x7f5b44145820 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5b4406ff20 con 0x7f5b440cf2a0 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4c400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b440cd5c0 con 0x7f5b4406fab0 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b49000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b440cf2a0 0x7f5b4406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b49000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b440cf2a0 0x7f5b4406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47744/0 (socket says 172.21.15.39:47744) 2024-04-26T23:26:23.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b49000640 1 -- 172.21.15.39:0/1453979199 learned_addr learned my addr 172.21.15.39:0/1453979199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:23.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.769+0000 7f5b4a400640 1 --2- 172.21.15.39:0/1453979199 >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 0x7f5b440cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b49000640 1 -- 172.21.15.39:0/1453979199 >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 msgr2=0x7f5b440cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:23.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b49000640 1 --2- 172.21.15.39:0/1453979199 >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 0x7f5b440cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b49000640 1 -- 172.21.15.39:0/1453979199 >> v1:172.21.15.71:6789/0 conn(0x7f5b44145820 legacy=0x7f5b440b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b49000640 1 -- 172.21.15.39:0/1453979199 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b44160340 con 0x7f5b440cf2a0 2024-04-26T23:26:23.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4a400640 1 --2- 172.21.15.39:0/1453979199 >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 0x7f5b440cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:23.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b49000640 1 --2- 172.21.15.39:0/1453979199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b440cf2a0 0x7f5b4406f570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b440b3710 tx=0x7f5b3001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94660e8c9ef47de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b43e00640 1 -- 172.21.15.39:0/1453979199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b300ab610 con 0x7f5b440cf2a0 2024-04-26T23:26:23.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b43e00640 1 -- 172.21.15.39:0/1453979199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b300b0070 con 0x7f5b440cf2a0 2024-04-26T23:26:23.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b43e00640 1 -- 172.21.15.39:0/1453979199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b300ab9d0 con 0x7f5b440cf2a0 2024-04-26T23:26:23.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 -- 172.21.15.39:0/1453979199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b440cf2a0 msgr2=0x7f5b4406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1453979199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b440cf2a0 0x7f5b4406f570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b440b3710 tx=0x7f5b3001c520 comp rx=0 tx=0).stop 2024-04-26T23:26:23.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 -- 172.21.15.39:0/1453979199 shutdown_connections 2024-04-26T23:26:23.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1453979199 >> v2:172.21.15.71:3300/0 conn(0x7f5b4406fab0 0x7f5b440cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1453979199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b440cf2a0 0x7f5b4406f570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 -- 172.21.15.39:0/1453979199 >> 172.21.15.39:0/1453979199 conn(0x7f5b440b2af0 msgr2=0x7f5b440b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 -- 172.21.15.39:0/1453979199 shutdown_connections 2024-04-26T23:26:23.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.773+0000 7f5b4c400640 1 -- 172.21.15.39:0/1453979199 wait complete. 2024-04-26T23:26:23.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 Processor -- start 2024-04-26T23:26:23.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- start start 2024-04-26T23:26:23.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b4406fab0 0x7f5b4413a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b440cf2a0 0x7f5b4413b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5b44145d80 con 0x7f5b44145820 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b44145c00 con 0x7f5b4406fab0 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4415fc30 con 0x7f5b440cf2a0 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47748/0 (socket says 172.21.15.39:47748) 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 -- 172.21.15.39:0/1795369525 learned_addr learned my addr 172.21.15.39:0/1795369525 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b49a00640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b4406fab0 0x7f5b4413a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b49000640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b440cf2a0 0x7f5b4413b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 -- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b440cf2a0 msgr2=0x7f5b4413b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b440cf2a0 0x7f5b4413b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 -- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b4406fab0 msgr2=0x7f5b4413a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b4406fab0 0x7f5b4413a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 -- 172.21.15.39:0/1795369525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4413a650 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4a400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009fd0 tx=0x7f5b3c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c01a070 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3c003bc0 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4413bab0 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004030 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.777+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b440b0d40 con 0x7f5b44145820 2024-04-26T23:26:23.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b44050740 con 0x7f5b44145820 2024-04-26T23:26:23.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b3c01d070 con 0x7f5b44145820 2024-04-26T23:26:23.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b41600640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:23.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5b3c086c40 con 0x7f5b44145820 2024-04-26T23:26:23.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b49a00640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:23.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.781+0000 7f5b49a00640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001770 tx=0x7f5b38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:23.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.785+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b4413a650 con 0x7f5b44145820 2024-04-26T23:26:23.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.953+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b44166960 con 0x7f5b24068380 2024-04-26T23:26:23.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.957+0000 7f5b41600640 1 -- 172.21.15.39:0/1795369525 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f5b44166960 con 0x7f5b24068380 2024-04-26T23:26:23.966 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:23.967 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:26:23.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 msgr2=0x7f5b2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001770 tx=0x7f5b38009040 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 msgr2=0x7f5b44143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009fd0 tx=0x7f5b3c00d560 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 shutdown_connections 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44145820 0x7f5b44143610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b440cf2a0 0x7f5b4413b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 --2- 172.21.15.39:0/1795369525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b4406fab0 0x7f5b4413a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 >> 172.21.15.39:0/1795369525 conn(0x7f5b440b2af0 msgr2=0x7f5b4406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 shutdown_connections 2024-04-26T23:26:23.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:23.961+0000 7f5b4c400640 1 -- 172.21.15.39:0/1795369525 wait complete. 2024-04-26T23:26:23.985 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T23:26:23.659456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227344,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747376,"statfs":{"total":773094113280,"available":772861313024,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.954737"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736763+0000","last_change":"2024-04-26T23:26:14.750190+0000","last_active":"2024-04-26T23:26:15.736763+0000","last_peered":"2024-04-26T23:26:15.736763+0000","last_clean":"2024-04-26T23:26:15.736763+0000","last_became_active":"2024-04-26T23:26:14.749862+0000","last_became_peered":"2024-04-26T23:26:14.749862+0000","last_unstale":"2024-04-26T23:26:15.736763+0000","last_undegraded":"2024-04-26T23:26:15.736763+0000","last_fullsized":"2024-04-26T23:26:15.736763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723865+0000","last_change":"2024-04-26T23:26:14.724978+0000","last_active":"2024-04-26T23:26:15.723865+0000","last_peered":"2024-04-26T23:26:15.723865+0000","last_clean":"2024-04-26T23:26:15.723865+0000","last_became_active":"2024-04-26T23:26:14.724385+0000","last_became_peered":"2024-04-26T23:26:14.724385+0000","last_unstale":"2024-04-26T23:26:15.723865+0000","last_undegraded":"2024-04-26T23:26:15.723865+0000","last_fullsized":"2024-04-26T23:26:15.723865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736625+0000","last_change":"2024-04-26T23:26:14.724918+0000","last_active":"2024-04-26T23:26:15.736625+0000","last_peered":"2024-04-26T23:26:15.736625+0000","last_clean":"2024-04-26T23:26:15.736625+0000","last_became_active":"2024-04-26T23:26:14.724588+0000","last_became_peered":"2024-04-26T23:26:14.724588+0000","last_unstale":"2024-04-26T23:26:15.736625+0000","last_undegraded":"2024-04-26T23:26:15.736625+0000","last_fullsized":"2024-04-26T23:26:15.736625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725084+0000","last_change":"2024-04-26T23:26:14.723378+0000","last_active":"2024-04-26T23:26:15.725084+0000","last_peered":"2024-04-26T23:26:15.725084+0000","last_clean":"2024-04-26T23:26:15.725084+0000","last_became_active":"2024-04-26T23:26:14.722888+0000","last_became_peered":"2024-04-26T23:26:14.722888+0000","last_unstale":"2024-04-26T23:26:15.725084+0000","last_undegraded":"2024-04-26T23:26:15.725084+0000","last_fullsized":"2024-04-26T23:26:15.725084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736482+0000","last_change":"2024-04-26T23:26:14.733728+0000","last_active":"2024-04-26T23:26:15.736482+0000","last_peered":"2024-04-26T23:26:15.736482+0000","last_clean":"2024-04-26T23:26:15.736482+0000","last_became_active":"2024-04-26T23:26:14.733044+0000","last_became_peered":"2024-04-26T23:26:14.733044+0000","last_unstale":"2024-04-26T23:26:15.736482+0000","last_undegraded":"2024-04-26T23:26:15.736482+0000","last_fullsized":"2024-04-26T23:26:15.736482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725262+0000","last_change":"2024-04-26T23:26:14.724291+0000","last_active":"2024-04-26T23:26:15.725262+0000","last_peered":"2024-04-26T23:26:15.725262+0000","last_clean":"2024-04-26T23:26:15.725262+0000","last_became_active":"2024-04-26T23:26:14.724038+0000","last_became_peered":"2024-04-26T23:26:14.724038+0000","last_unstale":"2024-04-26T23:26:15.725262+0000","last_undegraded":"2024-04-26T23:26:15.725262+0000","last_fullsized":"2024-04-26T23:26:15.725262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:52.114622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736072+0000","last_change":"2024-04-26T23:26:14.728422+0000","last_active":"2024-04-26T23:26:15.736072+0000","last_peered":"2024-04-26T23:26:15.736072+0000","last_clean":"2024-04-26T23:26:15.736072+0000","last_became_active":"2024-04-26T23:26:14.728014+0000","last_became_peered":"2024-04-26T23:26:14.728014+0000","last_unstale":"2024-04-26T23:26:15.736072+0000","last_undegraded":"2024-04-26T23:26:15.736072+0000","last_fullsized":"2024-04-26T23:26:15.736072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735326+0000","last_change":"2024-04-26T23:26:14.720678+0000","last_active":"2024-04-26T23:26:15.735326+0000","last_peered":"2024-04-26T23:26:15.735326+0000","last_clean":"2024-04-26T23:26:15.735326+0000","last_became_active":"2024-04-26T23:26:14.720413+0000","last_became_peered":"2024-04-26T23:26:14.720413+0000","last_unstale":"2024-04-26T23:26:15.735326+0000","last_undegraded":"2024-04-26T23:26:15.735326+0000","last_fullsized":"2024-04-26T23:26:15.735326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736984+0000","last_change":"2024-04-26T23:26:14.746576+0000","last_active":"2024-04-26T23:26:15.736984+0000","last_peered":"2024-04-26T23:26:15.736984+0000","last_clean":"2024-04-26T23:26:15.736984+0000","last_became_active":"2024-04-26T23:26:14.745710+0000","last_became_peered":"2024-04-26T23:26:14.745710+0000","last_unstale":"2024-04-26T23:26:15.736984+0000","last_undegraded":"2024-04-26T23:26:15.736984+0000","last_fullsized":"2024-04-26T23:26:15.736984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:04.796305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735909+0000","last_change":"2024-04-26T23:26:14.736993+0000","last_active":"2024-04-26T23:26:15.735909+0000","last_peered":"2024-04-26T23:26:15.735909+0000","last_clean":"2024-04-26T23:26:15.735909+0000","last_became_active":"2024-04-26T23:26:14.736555+0000","last_became_peered":"2024-04-26T23:26:14.736555+0000","last_unstale":"2024-04-26T23:26:15.735909+0000","last_undegraded":"2024-04-26T23:26:15.735909+0000","last_fullsized":"2024-04-26T23:26:15.735909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735781+0000","last_change":"2024-04-26T23:26:14.738192+0000","last_active":"2024-04-26T23:26:15.735781+0000","last_peered":"2024-04-26T23:26:15.735781+0000","last_clean":"2024-04-26T23:26:15.735781+0000","last_became_active":"2024-04-26T23:26:14.735778+0000","last_became_peered":"2024-04-26T23:26:14.735778+0000","last_unstale":"2024-04-26T23:26:15.735781+0000","last_undegraded":"2024-04-26T23:26:15.735781+0000","last_fullsized":"2024-04-26T23:26:15.735781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723687+0000","last_change":"2024-04-26T23:26:14.746898+0000","last_active":"2024-04-26T23:26:15.723687+0000","last_peered":"2024-04-26T23:26:15.723687+0000","last_clean":"2024-04-26T23:26:15.723687+0000","last_became_active":"2024-04-26T23:26:14.743251+0000","last_became_peered":"2024-04-26T23:26:14.743251+0000","last_unstale":"2024-04-26T23:26:15.723687+0000","last_undegraded":"2024-04-26T23:26:15.723687+0000","last_fullsized":"2024-04-26T23:26:15.723687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:20.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737227+0000","last_change":"2024-04-26T23:26:14.740463+0000","last_active":"2024-04-26T23:26:15.737227+0000","last_peered":"2024-04-26T23:26:15.737227+0000","last_clean":"2024-04-26T23:26:15.737227+0000","last_became_active":"2024-04-26T23:26:14.740150+0000","last_became_peered":"2024-04-26T23:26:14.740150+0000","last_unstale":"2024-04-26T23:26:15.737227+0000","last_undegraded":"2024-04-26T23:26:15.737227+0000","last_fullsized":"2024-04-26T23:26:15.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736130+0000","last_change":"2024-04-26T23:26:14.728712+0000","last_active":"2024-04-26T23:26:15.736130+0000","last_peered":"2024-04-26T23:26:15.736130+0000","last_clean":"2024-04-26T23:26:15.736130+0000","last_became_active":"2024-04-26T23:26:14.728390+0000","last_became_peered":"2024-04-26T23:26:14.728390+0000","last_unstale":"2024-04-26T23:26:15.736130+0000","last_undegraded":"2024-04-26T23:26:15.736130+0000","last_fullsized":"2024-04-26T23:26:15.736130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:50.776227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723349+0000","last_change":"2024-04-26T23:26:14.739193+0000","last_active":"2024-04-26T23:26:15.723349+0000","last_peered":"2024-04-26T23:26:15.723349+0000","last_clean":"2024-04-26T23:26:15.723349+0000","last_became_active":"2024-04-26T23:26:14.739006+0000","last_became_peered":"2024-04-26T23:26:14.739006+0000","last_unstale":"2024-04-26T23:26:15.723349+0000","last_undegraded":"2024-04-26T23:26:15.723349+0000","last_fullsized":"2024-04-26T23:26:15.723349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723007+0000","last_change":"2024-04-26T23:26:14.732502+0000","last_active":"2024-04-26T23:26:15.723007+0000","last_peered":"2024-04-26T23:26:15.723007+0000","last_clean":"2024-04-26T23:26:15.723007+0000","last_became_active":"2024-04-26T23:26:14.732194+0000","last_became_peered":"2024-04-26T23:26:14.732194+0000","last_unstale":"2024-04-26T23:26:15.723007+0000","last_undegraded":"2024-04-26T23:26:15.723007+0000","last_fullsized":"2024-04-26T23:26:15.723007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724541+0000","last_change":"2024-04-26T23:26:14.742132+0000","last_active":"2024-04-26T23:26:15.724541+0000","last_peered":"2024-04-26T23:26:15.724541+0000","last_clean":"2024-04-26T23:26:15.724541+0000","last_became_active":"2024-04-26T23:26:14.741783+0000","last_became_peered":"2024-04-26T23:26:14.741783+0000","last_unstale":"2024-04-26T23:26:15.724541+0000","last_undegraded":"2024-04-26T23:26:15.724541+0000","last_fullsized":"2024-04-26T23:26:15.724541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:01.494364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:14.735635+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:14.735055+0000","last_became_peered":"2024-04-26T23:26:14.735055+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736912+0000","last_change":"2024-04-26T23:26:14.732726+0000","last_active":"2024-04-26T23:26:15.736912+0000","last_peered":"2024-04-26T23:26:15.736912+0000","last_clean":"2024-04-26T23:26:15.736912+0000","last_became_active":"2024-04-26T23:26:14.732453+0000","last_became_peered":"2024-04-26T23:26:14.732453+0000","last_unstale":"2024-04-26T23:26:15.736912+0000","last_undegraded":"2024-04-26T23:26:15.736912+0000","last_fullsized":"2024-04-26T23:26:15.736912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:26.906820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735761+0000","last_change":"2024-04-26T23:26:14.739109+0000","last_active":"2024-04-26T23:26:15.735761+0000","last_peered":"2024-04-26T23:26:15.735761+0000","last_clean":"2024-04-26T23:26:15.735761+0000","last_became_active":"2024-04-26T23:26:14.738756+0000","last_became_peered":"2024-04-26T23:26:14.738756+0000","last_unstale":"2024-04-26T23:26:15.735761+0000","last_undegraded":"2024-04-26T23:26:15.735761+0000","last_fullsized":"2024-04-26T23:26:15.735761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736250+0000","last_change":"2024-04-26T23:26:14.743573+0000","last_active":"2024-04-26T23:26:15.736250+0000","last_peered":"2024-04-26T23:26:15.736250+0000","last_clean":"2024-04-26T23:26:15.736250+0000","last_became_active":"2024-04-26T23:26:14.743307+0000","last_became_peered":"2024-04-26T23:26:14.743307+0000","last_unstale":"2024-04-26T23:26:15.736250+0000","last_undegraded":"2024-04-26T23:26:15.736250+0000","last_fullsized":"2024-04-26T23:26:15.736250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724521+0000","last_change":"2024-04-26T23:26:14.735001+0000","last_active":"2024-04-26T23:26:15.724521+0000","last_peered":"2024-04-26T23:26:15.724521+0000","last_clean":"2024-04-26T23:26:15.724521+0000","last_became_active":"2024-04-26T23:26:14.734736+0000","last_became_peered":"2024-04-26T23:26:14.734736+0000","last_unstale":"2024-04-26T23:26:15.724521+0000","last_undegraded":"2024-04-26T23:26:15.724521+0000","last_fullsized":"2024-04-26T23:26:15.724521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735364+0000","last_change":"2024-04-26T23:26:14.740226+0000","last_active":"2024-04-26T23:26:15.735364+0000","last_peered":"2024-04-26T23:26:15.735364+0000","last_clean":"2024-04-26T23:26:15.735364+0000","last_became_active":"2024-04-26T23:26:14.739943+0000","last_became_peered":"2024-04-26T23:26:14.739943+0000","last_unstale":"2024-04-26T23:26:15.735364+0000","last_undegraded":"2024-04-26T23:26:15.735364+0000","last_fullsized":"2024-04-26T23:26:15.735364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:29.435933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723048+0000","last_change":"2024-04-26T23:26:14.724087+0000","last_active":"2024-04-26T23:26:15.723048+0000","last_peered":"2024-04-26T23:26:15.723048+0000","last_clean":"2024-04-26T23:26:15.723048+0000","last_became_active":"2024-04-26T23:26:14.723715+0000","last_became_peered":"2024-04-26T23:26:14.723715+0000","last_unstale":"2024-04-26T23:26:15.723048+0000","last_undegraded":"2024-04-26T23:26:15.723048+0000","last_fullsized":"2024-04-26T23:26:15.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737556+0000","last_change":"2024-04-26T23:26:14.736545+0000","last_active":"2024-04-26T23:26:15.737556+0000","last_peered":"2024-04-26T23:26:15.737556+0000","last_clean":"2024-04-26T23:26:15.737556+0000","last_became_active":"2024-04-26T23:26:14.736290+0000","last_became_peered":"2024-04-26T23:26:14.736290+0000","last_unstale":"2024-04-26T23:26:15.737556+0000","last_undegraded":"2024-04-26T23:26:15.737556+0000","last_fullsized":"2024-04-26T23:26:15.737556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736017+0000","last_change":"2024-04-26T23:26:14.748640+0000","last_active":"2024-04-26T23:26:15.736017+0000","last_peered":"2024-04-26T23:26:15.736017+0000","last_clean":"2024-04-26T23:26:15.736017+0000","last_became_active":"2024-04-26T23:26:14.747387+0000","last_became_peered":"2024-04-26T23:26:14.747387+0000","last_unstale":"2024-04-26T23:26:15.736017+0000","last_undegraded":"2024-04-26T23:26:15.736017+0000","last_fullsized":"2024-04-26T23:26:15.736017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723738+0000","last_change":"2024-04-26T23:26:14.737597+0000","last_active":"2024-04-26T23:26:15.723738+0000","last_peered":"2024-04-26T23:26:15.723738+0000","last_clean":"2024-04-26T23:26:15.723738+0000","last_became_active":"2024-04-26T23:26:14.735590+0000","last_became_peered":"2024-04-26T23:26:14.735590+0000","last_unstale":"2024-04-26T23:26:15.723738+0000","last_undegraded":"2024-04-26T23:26:15.723738+0000","last_fullsized":"2024-04-26T23:26:15.723738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737377+0000","last_change":"2024-04-26T23:26:14.736063+0000","last_active":"2024-04-26T23:26:15.737377+0000","last_peered":"2024-04-26T23:26:15.737377+0000","last_clean":"2024-04-26T23:26:15.737377+0000","last_became_active":"2024-04-26T23:26:14.735857+0000","last_became_peered":"2024-04-26T23:26:14.735857+0000","last_unstale":"2024-04-26T23:26:15.737377+0000","last_undegraded":"2024-04-26T23:26:15.737377+0000","last_fullsized":"2024-04-26T23:26:15.737377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736401+0000","last_change":"2024-04-26T23:26:14.723733+0000","last_active":"2024-04-26T23:26:15.736401+0000","last_peered":"2024-04-26T23:26:15.736401+0000","last_clean":"2024-04-26T23:26:15.736401+0000","last_became_active":"2024-04-26T23:26:14.723459+0000","last_became_peered":"2024-04-26T23:26:14.723459+0000","last_unstale":"2024-04-26T23:26:15.736401+0000","last_undegraded":"2024-04-26T23:26:15.736401+0000","last_fullsized":"2024-04-26T23:26:15.736401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724727+0000","last_change":"2024-04-26T23:26:14.722556+0000","last_active":"2024-04-26T23:26:15.724727+0000","last_peered":"2024-04-26T23:26:15.724727+0000","last_clean":"2024-04-26T23:26:15.724727+0000","last_became_active":"2024-04-26T23:26:14.722259+0000","last_became_peered":"2024-04-26T23:26:14.722259+0000","last_unstale":"2024-04-26T23:26:15.724727+0000","last_undegraded":"2024-04-26T23:26:15.724727+0000","last_fullsized":"2024-04-26T23:26:15.724727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735569+0000","last_change":"2024-04-26T23:26:14.732537+0000","last_active":"2024-04-26T23:26:15.735569+0000","last_peered":"2024-04-26T23:26:15.735569+0000","last_clean":"2024-04-26T23:26:15.735569+0000","last_became_active":"2024-04-26T23:26:14.732051+0000","last_became_peered":"2024-04-26T23:26:14.732051+0000","last_unstale":"2024-04-26T23:26:15.735569+0000","last_undegraded":"2024-04-26T23:26:15.735569+0000","last_fullsized":"2024-04-26T23:26:15.735569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735547+0000","last_change":"2024-04-26T23:26:14.731655+0000","last_active":"2024-04-26T23:26:15.735547+0000","last_peered":"2024-04-26T23:26:15.735547+0000","last_clean":"2024-04-26T23:26:15.735547+0000","last_became_active":"2024-04-26T23:26:14.731379+0000","last_became_peered":"2024-04-26T23:26:14.731379+0000","last_unstale":"2024-04-26T23:26:15.735547+0000","last_undegraded":"2024-04-26T23:26:15.735547+0000","last_fullsized":"2024-04-26T23:26:15.735547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723549+0000","last_change":"2024-04-26T23:26:14.733290+0000","last_active":"2024-04-26T23:26:15.723549+0000","last_peered":"2024-04-26T23:26:15.723549+0000","last_clean":"2024-04-26T23:26:15.723549+0000","last_became_active":"2024-04-26T23:26:14.732863+0000","last_became_peered":"2024-04-26T23:26:14.732863+0000","last_unstale":"2024-04-26T23:26:15.723549+0000","last_undegraded":"2024-04-26T23:26:15.723549+0000","last_fullsized":"2024-04-26T23:26:15.723549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:36.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737262+0000","last_change":"2024-04-26T23:26:13.724097+0000","last_active":"2024-04-26T23:26:15.737262+0000","last_peered":"2024-04-26T23:26:15.737262+0000","last_clean":"2024-04-26T23:26:15.737262+0000","last_became_active":"2024-04-26T23:26:13.723161+0000","last_became_peered":"2024-04-26T23:26:13.723161+0000","last_unstale":"2024-04-26T23:26:15.737262+0000","last_undegraded":"2024-04-26T23:26:15.737262+0000","last_fullsized":"2024-04-26T23:26:15.737262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736414+0000","last_change":"2024-04-26T23:26:14.727155+0000","last_active":"2024-04-26T23:26:15.736414+0000","last_peered":"2024-04-26T23:26:15.736414+0000","last_clean":"2024-04-26T23:26:15.736414+0000","last_became_active":"2024-04-26T23:26:14.726867+0000","last_became_peered":"2024-04-26T23:26:14.726867+0000","last_unstale":"2024-04-26T23:26:15.736414+0000","last_undegraded":"2024-04-26T23:26:15.736414+0000","last_fullsized":"2024-04-26T23:26:15.736414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735577+0000","last_change":"2024-04-26T23:26:13.729977+0000","last_active":"2024-04-26T23:26:15.735577+0000","last_peered":"2024-04-26T23:26:15.735577+0000","last_clean":"2024-04-26T23:26:15.735577+0000","last_became_active":"2024-04-26T23:26:13.728795+0000","last_became_peered":"2024-04-26T23:26:13.728795+0000","last_unstale":"2024-04-26T23:26:15.735577+0000","last_undegraded":"2024-04-26T23:26:15.735577+0000","last_fullsized":"2024-04-26T23:26:15.735577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736357+0000","last_change":"2024-04-26T23:26:13.730567+0000","last_active":"2024-04-26T23:26:15.736357+0000","last_peered":"2024-04-26T23:26:15.736357+0000","last_clean":"2024-04-26T23:26:15.736357+0000","last_became_active":"2024-04-26T23:26:13.730321+0000","last_became_peered":"2024-04-26T23:26:13.730321+0000","last_unstale":"2024-04-26T23:26:15.736357+0000","last_undegraded":"2024-04-26T23:26:15.736357+0000","last_fullsized":"2024-04-26T23:26:15.736357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735371+0000","last_change":"2024-04-26T23:26:14.733324+0000","last_active":"2024-04-26T23:26:15.735371+0000","last_peered":"2024-04-26T23:26:15.735371+0000","last_clean":"2024-04-26T23:26:15.735371+0000","last_became_active":"2024-04-26T23:26:14.733059+0000","last_became_peered":"2024-04-26T23:26:14.733059+0000","last_unstale":"2024-04-26T23:26:15.735371+0000","last_undegraded":"2024-04-26T23:26:15.735371+0000","last_fullsized":"2024-04-26T23:26:15.735371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723137+0000","last_change":"2024-04-26T23:26:13.714305+0000","last_active":"2024-04-26T23:26:15.723137+0000","last_peered":"2024-04-26T23:26:15.723137+0000","last_clean":"2024-04-26T23:26:15.723137+0000","last_became_active":"2024-04-26T23:26:13.713944+0000","last_became_peered":"2024-04-26T23:26:13.713944+0000","last_unstale":"2024-04-26T23:26:15.723137+0000","last_undegraded":"2024-04-26T23:26:15.723137+0000","last_fullsized":"2024-04-26T23:26:15.723137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:14.729913+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:14.729650+0000","last_became_peered":"2024-04-26T23:26:14.729650+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735790+0000","last_change":"2024-04-26T23:26:13.735343+0000","last_active":"2024-04-26T23:26:15.735790+0000","last_peered":"2024-04-26T23:26:15.735790+0000","last_clean":"2024-04-26T23:26:15.735790+0000","last_became_active":"2024-04-26T23:26:13.734994+0000","last_became_peered":"2024-04-26T23:26:13.734994+0000","last_unstale":"2024-04-26T23:26:15.735790+0000","last_undegraded":"2024-04-26T23:26:15.735790+0000","last_fullsized":"2024-04-26T23:26:15.735790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724315+0000","last_change":"2024-04-26T23:26:14.742311+0000","last_active":"2024-04-26T23:26:15.724315+0000","last_peered":"2024-04-26T23:26:15.724315+0000","last_clean":"2024-04-26T23:26:15.724315+0000","last_became_active":"2024-04-26T23:26:14.742033+0000","last_became_peered":"2024-04-26T23:26:14.742033+0000","last_unstale":"2024-04-26T23:26:15.724315+0000","last_undegraded":"2024-04-26T23:26:15.724315+0000","last_fullsized":"2024-04-26T23:26:15.724315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724308+0000","last_change":"2024-04-26T23:26:13.733199+0000","last_active":"2024-04-26T23:26:15.724308+0000","last_peered":"2024-04-26T23:26:15.724308+0000","last_clean":"2024-04-26T23:26:15.724308+0000","last_became_active":"2024-04-26T23:26:13.732940+0000","last_became_peered":"2024-04-26T23:26:13.732940+0000","last_unstale":"2024-04-26T23:26:15.724308+0000","last_undegraded":"2024-04-26T23:26:15.724308+0000","last_fullsized":"2024-04-26T23:26:15.724308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736800+0000","last_change":"2024-04-26T23:26:14.729724+0000","last_active":"2024-04-26T23:26:15.736800+0000","last_peered":"2024-04-26T23:26:15.736800+0000","last_clean":"2024-04-26T23:26:15.736800+0000","last_became_active":"2024-04-26T23:26:14.729430+0000","last_became_peered":"2024-04-26T23:26:14.729430+0000","last_unstale":"2024-04-26T23:26:15.736800+0000","last_undegraded":"2024-04-26T23:26:15.736800+0000","last_fullsized":"2024-04-26T23:26:15.736800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:40.836753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723725+0000","last_change":"2024-04-26T23:26:13.724763+0000","last_active":"2024-04-26T23:26:15.723725+0000","last_peered":"2024-04-26T23:26:15.723725+0000","last_clean":"2024-04-26T23:26:15.723725+0000","last_became_active":"2024-04-26T23:26:13.724483+0000","last_became_peered":"2024-04-26T23:26:13.724483+0000","last_unstale":"2024-04-26T23:26:15.723725+0000","last_undegraded":"2024-04-26T23:26:15.723725+0000","last_fullsized":"2024-04-26T23:26:15.723725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723791+0000","last_change":"2024-04-26T23:26:14.733025+0000","last_active":"2024-04-26T23:26:15.723791+0000","last_peered":"2024-04-26T23:26:15.723791+0000","last_clean":"2024-04-26T23:26:15.723791+0000","last_became_active":"2024-04-26T23:26:14.732739+0000","last_became_peered":"2024-04-26T23:26:14.732739+0000","last_unstale":"2024-04-26T23:26:15.723791+0000","last_undegraded":"2024-04-26T23:26:15.723791+0000","last_fullsized":"2024-04-26T23:26:15.723791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:58.053426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735689+0000","last_change":"2024-04-26T23:26:13.729905+0000","last_active":"2024-04-26T23:26:15.735689+0000","last_peered":"2024-04-26T23:26:15.735689+0000","last_clean":"2024-04-26T23:26:15.735689+0000","last_became_active":"2024-04-26T23:26:13.729641+0000","last_became_peered":"2024-04-26T23:26:13.729641+0000","last_unstale":"2024-04-26T23:26:15.735689+0000","last_undegraded":"2024-04-26T23:26:15.735689+0000","last_fullsized":"2024-04-26T23:26:15.735689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736765+0000","last_change":"2024-04-26T23:26:14.744333+0000","last_active":"2024-04-26T23:26:15.736765+0000","last_peered":"2024-04-26T23:26:15.736765+0000","last_clean":"2024-04-26T23:26:15.736765+0000","last_became_active":"2024-04-26T23:26:14.741477+0000","last_became_peered":"2024-04-26T23:26:14.741477+0000","last_unstale":"2024-04-26T23:26:15.736765+0000","last_undegraded":"2024-04-26T23:26:15.736765+0000","last_fullsized":"2024-04-26T23:26:15.736765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736523+0000","last_change":"2024-04-26T23:26:13.724495+0000","last_active":"2024-04-26T23:26:15.736523+0000","last_peered":"2024-04-26T23:26:15.736523+0000","last_clean":"2024-04-26T23:26:15.736523+0000","last_became_active":"2024-04-26T23:26:13.722127+0000","last_became_peered":"2024-04-26T23:26:13.722127+0000","last_unstale":"2024-04-26T23:26:15.736523+0000","last_undegraded":"2024-04-26T23:26:15.736523+0000","last_fullsized":"2024-04-26T23:26:15.736523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736199+0000","last_change":"2024-04-26T23:26:14.730136+0000","last_active":"2024-04-26T23:26:15.736199+0000","last_peered":"2024-04-26T23:26:15.736199+0000","last_clean":"2024-04-26T23:26:15.736199+0000","last_became_active":"2024-04-26T23:26:14.729903+0000","last_became_peered":"2024-04-26T23:26:14.729903+0000","last_unstale":"2024-04-26T23:26:15.736199+0000","last_undegraded":"2024-04-26T23:26:15.736199+0000","last_fullsized":"2024-04-26T23:26:15.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:02.834137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724823+0000","last_change":"2024-04-26T23:26:13.730110+0000","last_active":"2024-04-26T23:26:15.724823+0000","last_peered":"2024-04-26T23:26:15.724823+0000","last_clean":"2024-04-26T23:26:15.724823+0000","last_became_active":"2024-04-26T23:26:13.729806+0000","last_became_peered":"2024-04-26T23:26:13.729806+0000","last_unstale":"2024-04-26T23:26:15.724823+0000","last_undegraded":"2024-04-26T23:26:15.724823+0000","last_fullsized":"2024-04-26T23:26:15.724823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736577+0000","last_change":"2024-04-26T23:26:14.739556+0000","last_active":"2024-04-26T23:26:15.736577+0000","last_peered":"2024-04-26T23:26:15.736577+0000","last_clean":"2024-04-26T23:26:15.736577+0000","last_became_active":"2024-04-26T23:26:14.739201+0000","last_became_peered":"2024-04-26T23:26:14.739201+0000","last_unstale":"2024-04-26T23:26:15.736577+0000","last_undegraded":"2024-04-26T23:26:15.736577+0000","last_fullsized":"2024-04-26T23:26:15.736577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:24.003552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735986+0000","last_change":"2024-04-26T23:26:13.736521+0000","last_active":"2024-04-26T23:26:15.735986+0000","last_peered":"2024-04-26T23:26:15.735986+0000","last_clean":"2024-04-26T23:26:15.735986+0000","last_became_active":"2024-04-26T23:26:13.736233+0000","last_became_peered":"2024-04-26T23:26:13.736233+0000","last_unstale":"2024-04-26T23:26:15.735986+0000","last_undegraded":"2024-04-26T23:26:15.735986+0000","last_fullsized":"2024-04-26T23:26:15.735986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735936+0000","last_change":"2024-04-26T23:26:14.731078+0000","last_active":"2024-04-26T23:26:15.735936+0000","last_peered":"2024-04-26T23:26:15.735936+0000","last_clean":"2024-04-26T23:26:15.735936+0000","last_became_active":"2024-04-26T23:26:14.730526+0000","last_became_peered":"2024-04-26T23:26:14.730526+0000","last_unstale":"2024-04-26T23:26:15.735936+0000","last_undegraded":"2024-04-26T23:26:15.735936+0000","last_fullsized":"2024-04-26T23:26:15.735936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735491+0000","last_change":"2024-04-26T23:26:13.720259+0000","last_active":"2024-04-26T23:26:15.735491+0000","last_peered":"2024-04-26T23:26:15.735491+0000","last_clean":"2024-04-26T23:26:15.735491+0000","last_became_active":"2024-04-26T23:26:13.719993+0000","last_became_peered":"2024-04-26T23:26:13.719993+0000","last_unstale":"2024-04-26T23:26:15.735491+0000","last_undegraded":"2024-04-26T23:26:15.735491+0000","last_fullsized":"2024-04-26T23:26:15.735491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736174+0000","last_change":"2024-04-26T23:26:14.744189+0000","last_active":"2024-04-26T23:26:15.736174+0000","last_peered":"2024-04-26T23:26:15.736174+0000","last_clean":"2024-04-26T23:26:15.736174+0000","last_became_active":"2024-04-26T23:26:14.742691+0000","last_became_peered":"2024-04-26T23:26:14.742691+0000","last_unstale":"2024-04-26T23:26:15.736174+0000","last_undegraded":"2024-04-26T23:26:15.736174+0000","last_fullsized":"2024-04-26T23:26:15.736174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.270384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725515+0000","last_change":"2024-04-26T23:26:13.722716+0000","last_active":"2024-04-26T23:26:15.725515+0000","last_peered":"2024-04-26T23:26:15.725515+0000","last_clean":"2024-04-26T23:26:15.725515+0000","last_became_active":"2024-04-26T23:26:13.722282+0000","last_became_peered":"2024-04-26T23:26:13.722282+0000","last_unstale":"2024-04-26T23:26:15.725515+0000","last_undegraded":"2024-04-26T23:26:15.725515+0000","last_fullsized":"2024-04-26T23:26:15.725515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:03.302571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736807+0000","last_change":"2024-04-26T23:26:14.745739+0000","last_active":"2024-04-26T23:26:15.736807+0000","last_peered":"2024-04-26T23:26:15.736807+0000","last_clean":"2024-04-26T23:26:15.736807+0000","last_became_active":"2024-04-26T23:26:14.745393+0000","last_became_peered":"2024-04-26T23:26:14.745393+0000","last_unstale":"2024-04-26T23:26:15.736807+0000","last_undegraded":"2024-04-26T23:26:15.736807+0000","last_fullsized":"2024-04-26T23:26:15.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736102+0000","last_change":"2024-04-26T23:26:13.720970+0000","last_active":"2024-04-26T23:26:15.736102+0000","last_peered":"2024-04-26T23:26:15.736102+0000","last_clean":"2024-04-26T23:26:15.736102+0000","last_became_active":"2024-04-26T23:26:13.720659+0000","last_became_peered":"2024-04-26T23:26:13.720659+0000","last_unstale":"2024-04-26T23:26:15.736102+0000","last_undegraded":"2024-04-26T23:26:15.736102+0000","last_fullsized":"2024-04-26T23:26:15.736102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:50.641344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736992+0000","last_change":"2024-04-26T23:26:14.746831+0000","last_active":"2024-04-26T23:26:15.736992+0000","last_peered":"2024-04-26T23:26:15.736992+0000","last_clean":"2024-04-26T23:26:15.736992+0000","last_became_active":"2024-04-26T23:26:14.746189+0000","last_became_peered":"2024-04-26T23:26:14.746189+0000","last_unstale":"2024-04-26T23:26:15.736992+0000","last_undegraded":"2024-04-26T23:26:15.736992+0000","last_fullsized":"2024-04-26T23:26:15.736992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:58.384739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723835+0000","last_change":"2024-04-26T23:26:13.716047+0000","last_active":"2024-04-26T23:26:15.723835+0000","last_peered":"2024-04-26T23:26:15.723835+0000","last_clean":"2024-04-26T23:26:15.723835+0000","last_became_active":"2024-04-26T23:26:13.715774+0000","last_became_peered":"2024-04-26T23:26:13.715774+0000","last_unstale":"2024-04-26T23:26:15.723835+0000","last_undegraded":"2024-04-26T23:26:15.723835+0000","last_fullsized":"2024-04-26T23:26:15.723835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725303+0000","last_change":"2024-04-26T23:26:14.723161+0000","last_active":"2024-04-26T23:26:15.725303+0000","last_peered":"2024-04-26T23:26:15.725303+0000","last_clean":"2024-04-26T23:26:15.725303+0000","last_became_active":"2024-04-26T23:26:14.722467+0000","last_became_peered":"2024-04-26T23:26:14.722467+0000","last_unstale":"2024-04-26T23:26:15.725303+0000","last_undegraded":"2024-04-26T23:26:15.725303+0000","last_fullsized":"2024-04-26T23:26:15.725303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:26.837295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735933+0000","last_change":"2024-04-26T23:26:13.723125+0000","last_active":"2024-04-26T23:26:15.735933+0000","last_peered":"2024-04-26T23:26:15.735933+0000","last_clean":"2024-04-26T23:26:15.735933+0000","last_became_active":"2024-04-26T23:26:13.722807+0000","last_became_peered":"2024-04-26T23:26:13.722807+0000","last_unstale":"2024-04-26T23:26:15.735933+0000","last_undegraded":"2024-04-26T23:26:15.735933+0000","last_fullsized":"2024-04-26T23:26:15.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736740+0000","last_change":"2024-04-26T23:26:14.736690+0000","last_active":"2024-04-26T23:26:15.736740+0000","last_peered":"2024-04-26T23:26:15.736740+0000","last_clean":"2024-04-26T23:26:15.736740+0000","last_became_active":"2024-04-26T23:26:14.736316+0000","last_became_peered":"2024-04-26T23:26:14.736316+0000","last_unstale":"2024-04-26T23:26:15.736740+0000","last_undegraded":"2024-04-26T23:26:15.736740+0000","last_fullsized":"2024-04-26T23:26:15.736740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.372173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736227+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:26:15.736227+0000","last_peered":"2024-04-26T23:26:15.736227+0000","last_clean":"2024-04-26T23:26:15.736227+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:26:15.736227+0000","last_undegraded":"2024-04-26T23:26:15.736227+0000","last_fullsized":"2024-04-26T23:26:15.736227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723256+0000","last_change":"2024-04-26T23:26:13.722340+0000","last_active":"2024-04-26T23:26:15.723256+0000","last_peered":"2024-04-26T23:26:15.723256+0000","last_clean":"2024-04-26T23:26:15.723256+0000","last_became_active":"2024-04-26T23:26:13.721645+0000","last_became_peered":"2024-04-26T23:26:13.721645+0000","last_unstale":"2024-04-26T23:26:15.723256+0000","last_undegraded":"2024-04-26T23:26:15.723256+0000","last_fullsized":"2024-04-26T23:26:15.723256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736573+0000","last_change":"2024-04-26T23:26:14.733211+0000","last_active":"2024-04-26T23:26:15.736573+0000","last_peered":"2024-04-26T23:26:15.736573+0000","last_clean":"2024-04-26T23:26:15.736573+0000","last_became_active":"2024-04-26T23:26:14.732931+0000","last_became_peered":"2024-04-26T23:26:14.732931+0000","last_unstale":"2024-04-26T23:26:15.736573+0000","last_undegraded":"2024-04-26T23:26:15.736573+0000","last_fullsized":"2024-04-26T23:26:15.736573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736169+0000","last_change":"2024-04-26T23:26:13.726362+0000","last_active":"2024-04-26T23:26:15.736169+0000","last_peered":"2024-04-26T23:26:15.736169+0000","last_clean":"2024-04-26T23:26:15.736169+0000","last_became_active":"2024-04-26T23:26:13.725944+0000","last_became_peered":"2024-04-26T23:26:13.725944+0000","last_unstale":"2024-04-26T23:26:15.736169+0000","last_undegraded":"2024-04-26T23:26:15.736169+0000","last_fullsized":"2024-04-26T23:26:15.736169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735941+0000","last_change":"2024-04-26T23:26:14.715493+0000","last_active":"2024-04-26T23:26:15.735941+0000","last_peered":"2024-04-26T23:26:15.735941+0000","last_clean":"2024-04-26T23:26:15.735941+0000","last_became_active":"2024-04-26T23:26:14.715120+0000","last_became_peered":"2024-04-26T23:26:14.715120+0000","last_unstale":"2024-04-26T23:26:15.735941+0000","last_undegraded":"2024-04-26T23:26:15.735941+0000","last_fullsized":"2024-04-26T23:26:15.735941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:14.575559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735840+0000","last_change":"2024-04-26T23:26:13.718666+0000","last_active":"2024-04-26T23:26:15.735840+0000","last_peered":"2024-04-26T23:26:15.735840+0000","last_clean":"2024-04-26T23:26:15.735840+0000","last_became_active":"2024-04-26T23:26:13.718352+0000","last_became_peered":"2024-04-26T23:26:13.718352+0000","last_unstale":"2024-04-26T23:26:15.735840+0000","last_undegraded":"2024-04-26T23:26:15.735840+0000","last_fullsized":"2024-04-26T23:26:15.735840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723353+0000","last_change":"2024-04-26T23:26:14.731553+0000","last_active":"2024-04-26T23:26:15.723353+0000","last_peered":"2024-04-26T23:26:15.723353+0000","last_clean":"2024-04-26T23:26:15.723353+0000","last_became_active":"2024-04-26T23:26:14.730918+0000","last_became_peered":"2024-04-26T23:26:14.730918+0000","last_unstale":"2024-04-26T23:26:15.723353+0000","last_undegraded":"2024-04-26T23:26:15.723353+0000","last_fullsized":"2024-04-26T23:26:15.723353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:05.589132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724912+0000","last_change":"2024-04-26T23:26:13.727250+0000","last_active":"2024-04-26T23:26:15.724912+0000","last_peered":"2024-04-26T23:26:15.724912+0000","last_clean":"2024-04-26T23:26:15.724912+0000","last_became_active":"2024-04-26T23:26:13.726714+0000","last_became_peered":"2024-04-26T23:26:13.726714+0000","last_unstale":"2024-04-26T23:26:15.724912+0000","last_undegraded":"2024-04-26T23:26:15.724912+0000","last_fullsized":"2024-04-26T23:26:15.724912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:19.518542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.724072+0000","last_change":"2024-04-26T23:26:14.730947+0000","last_active":"2024-04-26T23:26:15.724072+0000","last_peered":"2024-04-26T23:26:15.724072+0000","last_clean":"2024-04-26T23:26:15.724072+0000","last_became_active":"2024-04-26T23:26:14.730626+0000","last_became_peered":"2024-04-26T23:26:14.730626+0000","last_unstale":"2024-04-26T23:26:15.724072+0000","last_undegraded":"2024-04-26T23:26:15.724072+0000","last_fullsized":"2024-04-26T23:26:15.724072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:22.200315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723662+0000","last_change":"2024-04-26T23:26:13.723935+0000","last_active":"2024-04-26T23:26:15.723662+0000","last_peered":"2024-04-26T23:26:15.723662+0000","last_clean":"2024-04-26T23:26:15.723662+0000","last_became_active":"2024-04-26T23:26:13.723536+0000","last_became_peered":"2024-04-26T23:26:13.723536+0000","last_unstale":"2024-04-26T23:26:15.723662+0000","last_undegraded":"2024-04-26T23:26:15.723662+0000","last_fullsized":"2024-04-26T23:26:15.723662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:04:35.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723671+0000","last_change":"2024-04-26T23:26:14.725964+0000","last_active":"2024-04-26T23:26:15.723671+0000","last_peered":"2024-04-26T23:26:15.723671+0000","last_clean":"2024-04-26T23:26:15.723671+0000","last_became_active":"2024-04-26T23:26:14.724935+0000","last_became_peered":"2024-04-26T23:26:14.724935+0000","last_unstale":"2024-04-26T23:26:15.723671+0000","last_undegraded":"2024-04-26T23:26:15.723671+0000","last_fullsized":"2024-04-26T23:26:15.723671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:46.396070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736960+0000","last_change":"2024-04-26T23:26:13.728354+0000","last_active":"2024-04-26T23:26:15.736960+0000","last_peered":"2024-04-26T23:26:15.736960+0000","last_clean":"2024-04-26T23:26:15.736960+0000","last_became_active":"2024-04-26T23:26:13.727416+0000","last_became_peered":"2024-04-26T23:26:13.727416+0000","last_unstale":"2024-04-26T23:26:15.736960+0000","last_undegraded":"2024-04-26T23:26:15.736960+0000","last_fullsized":"2024-04-26T23:26:15.736960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:22.327383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723520+0000","last_change":"2024-04-26T23:26:14.728202+0000","last_active":"2024-04-26T23:26:15.723520+0000","last_peered":"2024-04-26T23:26:15.723520+0000","last_clean":"2024-04-26T23:26:15.723520+0000","last_became_active":"2024-04-26T23:26:14.725745+0000","last_became_peered":"2024-04-26T23:26:14.725745+0000","last_unstale":"2024-04-26T23:26:15.723520+0000","last_undegraded":"2024-04-26T23:26:15.723520+0000","last_fullsized":"2024-04-26T23:26:15.723520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:17.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723857+0000","last_change":"2024-04-26T23:26:13.734188+0000","last_active":"2024-04-26T23:26:15.723857+0000","last_peered":"2024-04-26T23:26:15.723857+0000","last_clean":"2024-04-26T23:26:15.723857+0000","last_became_active":"2024-04-26T23:26:13.733977+0000","last_became_peered":"2024-04-26T23:26:13.733977+0000","last_unstale":"2024-04-26T23:26:15.723857+0000","last_undegraded":"2024-04-26T23:26:15.723857+0000","last_fullsized":"2024-04-26T23:26:15.723857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737564+0000","last_change":"2024-04-26T23:26:14.743925+0000","last_active":"2024-04-26T23:26:15.737564+0000","last_peered":"2024-04-26T23:26:15.737564+0000","last_clean":"2024-04-26T23:26:15.737564+0000","last_became_active":"2024-04-26T23:26:14.743638+0000","last_became_peered":"2024-04-26T23:26:14.743638+0000","last_unstale":"2024-04-26T23:26:15.737564+0000","last_undegraded":"2024-04-26T23:26:15.737564+0000","last_fullsized":"2024-04-26T23:26:15.737564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:55.262212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735918+0000","last_change":"2024-04-26T23:26:13.734100+0000","last_active":"2024-04-26T23:26:15.735918+0000","last_peered":"2024-04-26T23:26:15.735918+0000","last_clean":"2024-04-26T23:26:15.735918+0000","last_became_active":"2024-04-26T23:26:13.733667+0000","last_became_peered":"2024-04-26T23:26:13.733667+0000","last_unstale":"2024-04-26T23:26:15.735918+0000","last_undegraded":"2024-04-26T23:26:15.735918+0000","last_fullsized":"2024-04-26T23:26:15.735918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736866+0000","last_change":"2024-04-26T23:26:14.734618+0000","last_active":"2024-04-26T23:26:15.736866+0000","last_peered":"2024-04-26T23:26:15.736866+0000","last_clean":"2024-04-26T23:26:15.736866+0000","last_became_active":"2024-04-26T23:26:14.734369+0000","last_became_peered":"2024-04-26T23:26:14.734369+0000","last_unstale":"2024-04-26T23:26:15.736866+0000","last_undegraded":"2024-04-26T23:26:15.736866+0000","last_fullsized":"2024-04-26T23:26:15.736866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:43.363694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736054+0000","last_change":"2024-04-26T23:26:13.730845+0000","last_active":"2024-04-26T23:26:15.736054+0000","last_peered":"2024-04-26T23:26:15.736054+0000","last_clean":"2024-04-26T23:26:15.736054+0000","last_became_active":"2024-04-26T23:26:13.730510+0000","last_became_peered":"2024-04-26T23:26:13.730510+0000","last_unstale":"2024-04-26T23:26:15.736054+0000","last_undegraded":"2024-04-26T23:26:15.736054+0000","last_fullsized":"2024-04-26T23:26:15.736054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:57.040459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723134+0000","last_change":"2024-04-26T23:26:14.729756+0000","last_active":"2024-04-26T23:26:15.723134+0000","last_peered":"2024-04-26T23:26:15.723134+0000","last_clean":"2024-04-26T23:26:15.723134+0000","last_became_active":"2024-04-26T23:26:14.729469+0000","last_became_peered":"2024-04-26T23:26:14.729469+0000","last_unstale":"2024-04-26T23:26:15.723134+0000","last_undegraded":"2024-04-26T23:26:15.723134+0000","last_fullsized":"2024-04-26T23:26:15.723134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:40.724145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723464+0000","last_change":"2024-04-26T23:26:13.732419+0000","last_active":"2024-04-26T23:26:15.723464+0000","last_peered":"2024-04-26T23:26:15.723464+0000","last_clean":"2024-04-26T23:26:15.723464+0000","last_became_active":"2024-04-26T23:26:13.732075+0000","last_became_peered":"2024-04-26T23:26:13.732075+0000","last_unstale":"2024-04-26T23:26:15.723464+0000","last_undegraded":"2024-04-26T23:26:15.723464+0000","last_fullsized":"2024-04-26T23:26:15.723464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:18.519721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735487+0000","last_change":"2024-04-26T23:26:14.734658+0000","last_active":"2024-04-26T23:26:15.735487+0000","last_peered":"2024-04-26T23:26:15.735487+0000","last_clean":"2024-04-26T23:26:15.735487+0000","last_became_active":"2024-04-26T23:26:14.734365+0000","last_became_peered":"2024-04-26T23:26:14.734365+0000","last_unstale":"2024-04-26T23:26:15.735487+0000","last_undegraded":"2024-04-26T23:26:15.735487+0000","last_fullsized":"2024-04-26T23:26:15.735487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723439+0000","last_change":"2024-04-26T23:26:13.717076+0000","last_active":"2024-04-26T23:26:15.723439+0000","last_peered":"2024-04-26T23:26:15.723439+0000","last_clean":"2024-04-26T23:26:15.723439+0000","last_became_active":"2024-04-26T23:26:13.716768+0000","last_became_peered":"2024-04-26T23:26:13.716768+0000","last_unstale":"2024-04-26T23:26:15.723439+0000","last_undegraded":"2024-04-26T23:26:15.723439+0000","last_fullsized":"2024-04-26T23:26:15.723439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:39.711179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737169+0000","last_change":"2024-04-26T23:26:14.739852+0000","last_active":"2024-04-26T23:26:15.737169+0000","last_peered":"2024-04-26T23:26:15.737169+0000","last_clean":"2024-04-26T23:26:15.737169+0000","last_became_active":"2024-04-26T23:26:14.732086+0000","last_became_peered":"2024-04-26T23:26:14.732086+0000","last_unstale":"2024-04-26T23:26:15.737169+0000","last_undegraded":"2024-04-26T23:26:15.737169+0000","last_fullsized":"2024-04-26T23:26:15.737169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736729+0000","last_change":"2024-04-26T23:26:13.725980+0000","last_active":"2024-04-26T23:26:15.736729+0000","last_peered":"2024-04-26T23:26:15.736729+0000","last_clean":"2024-04-26T23:26:15.736729+0000","last_became_active":"2024-04-26T23:26:13.725692+0000","last_became_peered":"2024-04-26T23:26:13.725692+0000","last_unstale":"2024-04-26T23:26:15.736729+0000","last_undegraded":"2024-04-26T23:26:15.736729+0000","last_fullsized":"2024-04-26T23:26:15.736729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:21.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.735910+0000","last_change":"2024-04-26T23:26:14.735387+0000","last_active":"2024-04-26T23:26:15.735910+0000","last_peered":"2024-04-26T23:26:15.735910+0000","last_clean":"2024-04-26T23:26:15.735910+0000","last_became_active":"2024-04-26T23:26:14.735036+0000","last_became_peered":"2024-04-26T23:26:14.735036+0000","last_unstale":"2024-04-26T23:26:15.735910+0000","last_undegraded":"2024-04-26T23:26:15.735910+0000","last_fullsized":"2024-04-26T23:26:15.735910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.274898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.723581+0000","last_change":"2024-04-26T23:26:14.736310+0000","last_active":"2024-04-26T23:26:15.723581+0000","last_peered":"2024-04-26T23:26:15.723581+0000","last_clean":"2024-04-26T23:26:15.723581+0000","last_became_active":"2024-04-26T23:26:14.735927+0000","last_became_peered":"2024-04-26T23:26:14.735927+0000","last_unstale":"2024-04-26T23:26:15.723581+0000","last_undegraded":"2024-04-26T23:26:15.723581+0000","last_fullsized":"2024-04-26T23:26:15.723581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736622+0000","last_change":"2024-04-26T23:26:13.725017+0000","last_active":"2024-04-26T23:26:15.736622+0000","last_peered":"2024-04-26T23:26:15.736622+0000","last_clean":"2024-04-26T23:26:15.736622+0000","last_became_active":"2024-04-26T23:26:13.724363+0000","last_became_peered":"2024-04-26T23:26:13.724363+0000","last_unstale":"2024-04-26T23:26:15.736622+0000","last_undegraded":"2024-04-26T23:26:15.736622+0000","last_fullsized":"2024-04-26T23:26:15.736622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:46.949014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.725323+0000","last_change":"2024-04-26T23:26:14.744041+0000","last_active":"2024-04-26T23:26:15.725323+0000","last_peered":"2024-04-26T23:26:15.725323+0000","last_clean":"2024-04-26T23:26:15.725323+0000","last_became_active":"2024-04-26T23:26:14.743726+0000","last_became_peered":"2024-04-26T23:26:14.743726+0000","last_unstale":"2024-04-26T23:26:15.725323+0000","last_undegraded":"2024-04-26T23:26:15.725323+0000","last_fullsized":"2024-04-26T23:26:15.725323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:52.547352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736853+0000","last_change":"2024-04-26T23:26:13.737149+0000","last_active":"2024-04-26T23:26:15.736853+0000","last_peered":"2024-04-26T23:26:15.736853+0000","last_clean":"2024-04-26T23:26:15.736853+0000","last_became_active":"2024-04-26T23:26:13.736573+0000","last_became_peered":"2024-04-26T23:26:13.736573+0000","last_unstale":"2024-04-26T23:26:15.736853+0000","last_undegraded":"2024-04-26T23:26:15.736853+0000","last_fullsized":"2024-04-26T23:26:15.736853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:50.948166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736769+0000","last_change":"2024-04-26T23:26:14.722451+0000","last_active":"2024-04-26T23:26:15.736769+0000","last_peered":"2024-04-26T23:26:15.736769+0000","last_clean":"2024-04-26T23:26:15.736769+0000","last_became_active":"2024-04-26T23:26:14.719570+0000","last_became_peered":"2024-04-26T23:26:14.719570+0000","last_unstale":"2024-04-26T23:26:15.736769+0000","last_undegraded":"2024-04-26T23:26:15.736769+0000","last_fullsized":"2024-04-26T23:26:15.736769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:21.722707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737451+0000","last_change":"2024-04-26T23:26:13.729916+0000","last_active":"2024-04-26T23:26:15.737451+0000","last_peered":"2024-04-26T23:26:15.737451+0000","last_clean":"2024-04-26T23:26:15.737451+0000","last_became_active":"2024-04-26T23:26:13.729382+0000","last_became_peered":"2024-04-26T23:26:13.729382+0000","last_unstale":"2024-04-26T23:26:15.737451+0000","last_undegraded":"2024-04-26T23:26:15.737451+0000","last_fullsized":"2024-04-26T23:26:15.737451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:47.474551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.737423+0000","last_change":"2024-04-26T23:26:14.734991+0000","last_active":"2024-04-26T23:26:15.737423+0000","last_peered":"2024-04-26T23:26:15.737423+0000","last_clean":"2024-04-26T23:26:15.737423+0000","last_became_active":"2024-04-26T23:26:14.734727+0000","last_became_peered":"2024-04-26T23:26:14.734727+0000","last_unstale":"2024-04-26T23:26:15.737423+0000","last_undegraded":"2024-04-26T23:26:15.737423+0000","last_fullsized":"2024-04-26T23:26:15.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:13.695300+0000","last_clean_scrub_stamp":"2024-04-26T23:26:13.695300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:17.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:26:15.736858+0000","last_change":"2024-04-26T23:26:13.732964+0000","last_active":"2024-04-26T23:26:15.736858+0000","last_peered":"2024-04-26T23:26:15.736858+0000","last_clean":"2024-04-26T23:26:15.736858+0000","last_became_active":"2024-04-26T23:26:13.732485+0000","last_became_peered":"2024-04-26T23:26:13.732485+0000","last_unstale":"2024-04-26T23:26:15.736858+0000","last_undegraded":"2024-04-26T23:26:15.736858+0000","last_fullsized":"2024-04-26T23:26:15.736858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:12.682334+0000","last_clean_scrub_stamp":"2024-04-26T23:26:12.682334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:11.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:26:23.989 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:26:23.989 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:26:23.989 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:26:23.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:26:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.161+0000 7fd0f0e00640 1 Processor -- start 2024-04-26T23:26:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.161+0000 7fd0f0e00640 1 -- start start 2024-04-26T23:26:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0f0e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0ec0b7550 0x7fd0ec06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0f0e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec06c910 0x7fd0ec073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0f0e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec0b7930 con 0x7fd0ec073850 2024-04-26T23:26:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0f0e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec06cd70 con 0x7fd0ec0b7550 2024-04-26T23:26:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0f0e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec0d22a0 con 0x7fd0ec06c910 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0ea800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd0ec073850 0x7fd0ec06f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60894/0 (socket says 172.21.15.39:60894) 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0ea800640 1 -- 172.21.15.39:0/1914706074 learned_addr learned my addr 172.21.15.39:0/1914706074 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e3e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec06c910 0x7fd0ec073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/1914706074 >> v2:172.21.15.71:3300/0 conn(0x7fd0ec0b7550 0x7fd0ec06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9400640 1 -- 172.21.15.39:0/1914706074 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778121849 0 0) 0x7fd0ec0b7930 con 0x7fd0ec073850 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9400640 1 -- 172.21.15.39:0/1914706074 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d0003530 con 0x7fd0ec073850 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9e00640 1 -- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec06c910 msgr2=0x7fd0ec073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec06c910 0x7fd0ec073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9e00640 1 -- 172.21.15.39:0/1914706074 >> v1:172.21.15.39:6789/0 conn(0x7fd0ec073850 legacy=0x7fd0ec06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.165+0000 7fd0e9e00640 1 -- 172.21.15.39:0/1914706074 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec074000 con 0x7fd0ec0b7550 2024-04-26T23:26:24.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec06c3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfda5698cf71bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0e9400640 1 -- 172.21.15.39:0/1914706074 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0b2070 con 0x7fd0ec0b7550 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0e9400640 1 -- 172.21.15.39:0/1914706074 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0ad640 con 0x7fd0ec0b7550 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0e9400640 1 -- 172.21.15.39:0/1914706074 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0ad9f0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec0b7550 msgr2=0x7fd0ec06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec06c3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01c470 comp rx=0 tx=0).stop 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- 172.21.15.39:0/1914706074 shutdown_connections 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec06c910 0x7fd0ec073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/1914706074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec06c3d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- 172.21.15.39:0/1914706074 >> 172.21.15.39:0/1914706074 conn(0x7fd0ec0b3c50 msgr2=0x7fd0ec0b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- 172.21.15.39:0/1914706074 shutdown_connections 2024-04-26T23:26:24.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- 172.21.15.39:0/1914706074 wait complete. 2024-04-26T23:26:24.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 Processor -- start 2024-04-26T23:26:24.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.169+0000 7fd0f0e00640 1 -- start start 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec06c910 0x7fd0ec142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec073850 0x7fd0ec0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec163d40 con 0x7fd0ec0b7550 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec163820 con 0x7fd0ec06c910 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec163ec0 con 0x7fd0ec073850 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47750/0 (socket says 172.21.15.39:47750) 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 -- 172.21.15.39:0/2524432574 learned_addr learned my addr 172.21.15.39:0/2524432574 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0e3e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec073850 0x7fd0ec0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec06c910 0x7fd0ec142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 -- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec073850 msgr2=0x7fd0ec0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec073850 0x7fd0ec0af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 -- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec06c910 msgr2=0x7fd0ec142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec06c910 0x7fd0ec142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 -- 172.21.15.39:0/2524432574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec0ae8f0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0ea800640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400cb40 tx=0x7fd0e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4017070 con 0x7fd0ec0b7550 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e400aca0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec0aebd0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4012620 con 0x7fd0ec0b7550 2024-04-26T23:26:24.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec0af190 con 0x7fd0ec0b7550 2024-04-26T23:26:24.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.173+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec050740 con 0x7fd0ec0b7550 2024-04-26T23:26:24.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.177+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0e401a070 con 0x7fd0ec0b7550 2024-04-26T23:26:24.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.177+0000 7fd0e2000640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.177+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd0e4086890 con 0x7fd0ec0b7550 2024-04-26T23:26:24.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.177+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.177+0000 7fd0e9e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 0x7fd0c806a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0af000 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.181+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0e4056db0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.381+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0ec143010 con 0x7fd0ec0b7550 2024-04-26T23:26:24.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.381+0000 7fd0e2000640 1 -- 172.21.15.39:0/2524432574 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd0e40566b0 con 0x7fd0ec0b7550 2024-04-26T23:26:24.386 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:24.386 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:26:24.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 msgr2=0x7fd0c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 0x7fd0c806a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0af000 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2024-04-26T23:26:24.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 msgr2=0x7fd0ec0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400cb40 tx=0x7fd0e400a060 comp rx=0 tx=0).stop 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 shutdown_connections 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0ec0b7550 0x7fd0ec0b0d60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0ec073850 0x7fd0ec0af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 --2- 172.21.15.39:0/2524432574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0ec06c910 0x7fd0ec142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 >> 172.21.15.39:0/2524432574 conn(0x7fd0ec0b3c50 msgr2=0x7fd0ec0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 shutdown_connections 2024-04-26T23:26:24.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.385+0000 7fd0f0e00640 1 -- 172.21.15.39:0/2524432574 wait complete. 2024-04-26T23:26:24.407 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:26:24.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:24.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 Processor -- start 2024-04-26T23:26:24.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 -- start start 2024-04-26T23:26:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7440160b60 0x7f7440160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7440161950 con 0x7f7440161500 2024-04-26T23:26:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f74400b6220 con 0x7f7440160b60 2024-04-26T23:26:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7446600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f74400d1a20 con 0x7f744015cf60 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f743fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7440160b60 0x7f7440160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45692/0 (socket says 172.21.15.39:45692) 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 -- 172.21.15.39:0/1844412286 learned_addr learned my addr 172.21.15.39:0/1844412286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 -- 172.21.15.39:0/1844412286 >> v2:172.21.15.71:3300/0 conn(0x7f7440160b60 msgr2=0x7f7440160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 --2- 172.21.15.39:0/1844412286 >> v2:172.21.15.71:3300/0 conn(0x7f7440160b60 0x7f7440160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 -- 172.21.15.39:0/1844412286 >> v1:172.21.15.71:6789/0 conn(0x7f7440161500 legacy=0x7f74400cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f743f400640 1 -- 172.21.15.39:0/1844412286 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27169304 0 0) 0x7f7440161950 con 0x7f7440161500 2024-04-26T23:26:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.545+0000 7f7445200640 1 -- 172.21.15.39:0/1844412286 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74400d1d00 con 0x7f744015cf60 2024-04-26T23:26:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7445200640 1 --2- 172.21.15.39:0/1844412286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7434006fd0 tx=0x7f743401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea85e012cc5fff8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f743f400640 1 -- 172.21.15.39:0/1844412286 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340b0070 con 0x7f744015cf60 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f743f400640 1 -- 172.21.15.39:0/1844412286 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74340ab600 con 0x7f744015cf60 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f743f400640 1 -- 172.21.15.39:0/1844412286 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340ab9d0 con 0x7f744015cf60 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 -- 172.21.15.39:0/1844412286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 msgr2=0x7f74400d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 --2- 172.21.15.39:0/1844412286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7434006fd0 tx=0x7f743401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 -- 172.21.15.39:0/1844412286 shutdown_connections 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 --2- 172.21.15.39:0/1844412286 >> v2:172.21.15.71:3300/0 conn(0x7f7440160b60 0x7f7440160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 --2- 172.21.15.39:0/1844412286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f74400d12d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 -- 172.21.15.39:0/1844412286 >> 172.21.15.39:0/1844412286 conn(0x7f74400d2d80 msgr2=0x7f74400d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 -- 172.21.15.39:0/1844412286 shutdown_connections 2024-04-26T23:26:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 -- 172.21.15.39:0/1844412286 wait complete. 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.549+0000 7f7446600640 1 Processor -- start 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- start start 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f7440151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7440161500 0x7f7440151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f744016a020 con 0x7f7440160b60 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7440169ea0 con 0x7f7440161500 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f744016a1a0 con 0x7f744015cf60 2024-04-26T23:26:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7445c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7440161500 0x7f7440151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7445200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f7440151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47766/0 (socket says 172.21.15.39:47766) 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 -- 172.21.15.39:0/765989834 learned_addr learned my addr 172.21.15.39:0/765989834 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 -- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 msgr2=0x7f7440151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f7440151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 -- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7440161500 msgr2=0x7f7440151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7440161500 0x7f7440151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 -- 172.21.15.39:0/765989834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74401565a0 con 0x7f7440160b60 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743fe00640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e930 tx=0x7f742c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c017070 con 0x7f7440160b60 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c00ca00 con 0x7f7440160b60 2024-04-26T23:26:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00cdb0 con 0x7f7440160b60 2024-04-26T23:26:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7440156820 con 0x7f7440160b60 2024-04-26T23:26:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74400c8260 con 0x7f7440160b60 2024-04-26T23:26:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.553+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74400506d0 con 0x7f7440160b60 2024-04-26T23:26:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.557+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f742c01a070 con 0x7f7440160b60 2024-04-26T23:26:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.557+0000 7f743cc00640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 0x7f742006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.557+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f742c0869c0 con 0x7f7440160b60 2024-04-26T23:26:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.557+0000 7f7445200640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 0x7f742006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.557+0000 7f7445200640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 0x7f742006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74340ad000 tx=0x7f7434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.561+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f74401565a0 con 0x7f7440160b60 2024-04-26T23:26:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.725+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7440161250 con 0x7f7440160b60 2024-04-26T23:26:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f743cc00640 1 -- 172.21.15.39:0/765989834 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f742c056950 con 0x7f7440160b60 2024-04-26T23:26:24.732 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:24.732 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 msgr2=0x7f742006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 0x7f742006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74340ad000 tx=0x7f7434009040 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 msgr2=0x7f7440156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e930 tx=0x7f742c00edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 shutdown_connections 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7420068380 0x7f742006a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7440161500 0x7f7440151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7440160b60 0x7f7440156060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 --2- 172.21.15.39:0/765989834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f744015cf60 0x7f7440151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 >> 172.21.15.39:0/765989834 conn(0x7f74400d2d80 msgr2=0x7f74400d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 shutdown_connections 2024-04-26T23:26:24.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.729+0000 7f7446600640 1 -- 172.21.15.39:0/765989834 wait complete. 2024-04-26T23:26:24.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:24.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:24.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.893+0000 7fd515c00640 1 Processor -- start 2024-04-26T23:26:24.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.893+0000 7fd515c00640 1 -- start start 2024-04-26T23:26:24.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd515c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd51006d4e0 0x7fd51006d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd515c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd5100d10d0 0x7fd5100d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd515c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51006dfa0 con 0x7fd5100cf8c0 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd515c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd51006e280 con 0x7fd5100d10d0 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd515c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd51006e560 con 0x7fd51006d4e0 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd5100d10d0 0x7fd5100d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50ea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd5100cf8c0 0x7fd5100cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60900/0 (socket says 172.21.15.39:60900) 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50ea00640 1 -- 172.21.15.39:0/3041830848 learned_addr learned my addr 172.21.15.39:0/3041830848 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50e000640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd51006d4e0 0x7fd51006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50f400640 1 -- 172.21.15.39:0/3041830848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd51006d4e0 msgr2=0x7fd51006d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:24.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50f400640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd51006d4e0 0x7fd51006d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50d600640 1 -- 172.21.15.39:0/3041830848 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910098188 0 0) 0x7fd51006dfa0 con 0x7fd5100cf8c0 2024-04-26T23:26:24.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50f400640 1 -- 172.21.15.39:0/3041830848 >> v1:172.21.15.39:6789/0 conn(0x7fd5100cf8c0 legacy=0x7fd5100cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.897+0000 7fd50f400640 1 -- 172.21.15.39:0/3041830848 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100b2ff0 con 0x7fd5100d10d0 2024-04-26T23:26:24.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd50f400640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100d10d0 0x7fd5100d1540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5080097c0 tx=0x7fd50801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72f62ec135414e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd50d600640 1 -- 172.21.15.39:0/3041830848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080aa5f0 con 0x7fd5100d10d0 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd50d600640 1 -- 172.21.15.39:0/3041830848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080af070 con 0x7fd5100d10d0 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd50d600640 1 -- 172.21.15.39:0/3041830848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080aa9b0 con 0x7fd5100d10d0 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- 172.21.15.39:0/3041830848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100d10d0 msgr2=0x7fd5100d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100d10d0 0x7fd5100d1540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5080097c0 tx=0x7fd50801c470 comp rx=0 tx=0).stop 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- 172.21.15.39:0/3041830848 shutdown_connections 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100d10d0 0x7fd5100d1540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- 172.21.15.39:0/3041830848 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd51006d4e0 0x7fd51006d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- 172.21.15.39:0/3041830848 >> 172.21.15.39:0/3041830848 conn(0x7fd5100d3040 msgr2=0x7fd5100d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- 172.21.15.39:0/3041830848 shutdown_connections 2024-04-26T23:26:24.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- 172.21.15.39:0/3041830848 wait complete. 2024-04-26T23:26:24.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 Processor -- start 2024-04-26T23:26:24.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- start start 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd51006d4e0 0x7fd510157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5100d10d0 0x7fd5101558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd51016bf10 con 0x7fd5100cf8c0 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd51015f780 con 0x7fd51006d4e0 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.901+0000 7fd515c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd51016c090 con 0x7fd5100d10d0 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47780/0 (socket says 172.21.15.39:47780) 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 -- 172.21.15.39:0/3504159265 learned_addr learned my addr 172.21.15.39:0/3504159265 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50ea00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd51006d4e0 0x7fd510157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50f400640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5100d10d0 0x7fd5101558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 -- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5100d10d0 msgr2=0x7fd5101558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5100d10d0 0x7fd5101558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 -- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd51006d4e0 msgr2=0x7fd510157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd51006d4e0 0x7fd510157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 -- 172.21.15.39:0/3504159265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100b5dd0 con 0x7fd5100cf8c0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd50e000640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00e870 tx=0x7fd4fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc017070 con 0x7fd5100cf8c0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00c940 con 0x7fd5100cf8c0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00ccf0 con 0x7fd5100cf8c0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5100b60b0 con 0x7fd5100cf8c0 2024-04-26T23:26:24.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5100b6670 con 0x7fd5100cf8c0 2024-04-26T23:26:24.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51006a720 con 0x7fd5100cf8c0 2024-04-26T23:26:24.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.905+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd4fc01a070 con 0x7fd5100cf8c0 2024-04-26T23:26:24.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.909+0000 7fd506a00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:24.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.909+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd4fc086880 con 0x7fd5100cf8c0 2024-04-26T23:26:24.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.909+0000 7fd50ea00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:24.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.909+0000 7fd50ea00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 0x7fd4f006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd5000012f0 tx=0x7fd500001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:24.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:24.913+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd4fc056750 con 0x7fd5100cf8c0 2024-04-26T23:26:25.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5100cf6a0 con 0x7fd5100cf8c0 2024-04-26T23:26:25.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd506a00640 1 -- 172.21.15.39:0/3504159265 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd4fc05aa50 con 0x7fd5100cf8c0 2024-04-26T23:26:25.082 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 msgr2=0x7fd4f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 0x7fd4f006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd5000012f0 tx=0x7fd500001690 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 msgr2=0x7fd510155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.077+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00e870 tx=0x7fd4fc00ec70 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 shutdown_connections 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5100d10d0 0x7fd5101558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5100cf8c0 0x7fd510155390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 --2- 172.21.15.39:0/3504159265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd51006d4e0 0x7fd510157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 >> 172.21.15.39:0/3504159265 conn(0x7fd5100d3040 msgr2=0x7fd5100cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 shutdown_connections 2024-04-26T23:26:25.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.081+0000 7fd515c00640 1 -- 172.21.15.39:0/3504159265 wait complete. 2024-04-26T23:26:25.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:25.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 Processor -- start 2024-04-26T23:26:25.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 -- start start 2024-04-26T23:26:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40ac073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40ac06c3d0 0x7f40ac06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ac070200 con 0x7f40ac160150 2024-04-26T23:26:25.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f40ac073970 con 0x7f40ac06c3d0 2024-04-26T23:26:25.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40b1000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f40ac073320 con 0x7f40ac160530 2024-04-26T23:26:25.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f40ac160150 0x7f40ac06f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60916/0 (socket says 172.21.15.39:60916) 2024-04-26T23:26:25.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9e00640 1 -- 172.21.15.39:0/1439958628 learned_addr learned my addr 172.21.15.39:0/1439958628 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a1400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40ac073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40aa800640 1 --2- 172.21.15.39:0/1439958628 >> v2:172.21.15.71:3300/0 conn(0x7f40ac06c3d0 0x7f40ac06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229564055 0 0) 0x7f40ac070200 con 0x7f40ac160150 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4090003530 con 0x7f40ac160150 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352856661 0 0) 0x7f4090003530 con 0x7f40ac160150 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 msgr2=0x7f40ac073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40ac073e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 >> v2:172.21.15.71:3300/0 conn(0x7f40ac06c3d0 msgr2=0x7f40ac06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 --2- 172.21.15.39:0/1439958628 >> v2:172.21.15.71:3300/0 conn(0x7f40ac06c3d0 0x7f40ac06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac073600 con 0x7f40ac160150 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f409c001a00 con 0x7f40ac160150 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 >> v1:172.21.15.39:6789/0 conn(0x7f40ac160150 legacy=0x7f40ac06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40900039c0 0x7f4090003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4090004810 0x7f4090004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.241+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac073970 con 0x7f40900039c0 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac073320 con 0x7f4090004810 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f409000b9d0 con 0x7f40ac160530 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40900039c0 0x7f4090003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40aa800640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a1400640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4090004810 0x7f4090004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 -- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 msgr2=0x7f40900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 -- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4090004810 msgr2=0x7f4090004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4090004810 0x7f4090004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 -- 172.21.15.39:0/1439958628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4090003530 con 0x7f40900039c0 2024-04-26T23:26:25.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40aa800640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40ac160530 0x7f40900051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9e00640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40900039c0 0x7f4090003de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f409c00a8d0 tx=0x7f409c01d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68467aea3546f8d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c00a4c0 con 0x7f40900039c0 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c0ad650 con 0x7f40900039c0 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40a9400640 1 -- 172.21.15.39:0/1439958628 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0ada40 con 0x7f40900039c0 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40b1000640 1 -- 172.21.15.39:0/1439958628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40900039c0 msgr2=0x7f4090003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.245+0000 7f40b1000640 1 --2- 172.21.15.39:0/1439958628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40900039c0 0x7f4090003de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f409c00a8d0 tx=0x7f409c01d3c0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 -- 172.21.15.39:0/1439958628 reap_dead start 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- 172.21.15.39:0/1439958628 shutdown_connections 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- 172.21.15.39:0/1439958628 >> 172.21.15.39:0/1439958628 conn(0x7f40ac06dfd0 msgr2=0x7f40ac0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- 172.21.15.39:0/1439958628 shutdown_connections 2024-04-26T23:26:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- 172.21.15.39:0/1439958628 wait complete. 2024-04-26T23:26:25.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 Processor -- start 2024-04-26T23:26:25.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- start start 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40900039c0 0x7f40ac166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac1561e0 0x7f40ac1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac0b5f80 con 0x7f40ac1584f0 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac0b5e00 con 0x7f40ac1561e0 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40b1000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f40ac0b6100 con 0x7f40900039c0 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47792/0 (socket says 172.21.15.39:47792) 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 -- 172.21.15.39:0/4079585617 learned_addr learned my addr 172.21.15.39:0/4079585617 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40a1400640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac1561e0 0x7f40ac1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40a9e00640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40900039c0 0x7f40ac166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 -- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40900039c0 msgr2=0x7f40ac166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40900039c0 0x7f40ac166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 -- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac1561e0 msgr2=0x7f40ac1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac1561e0 0x7f40ac1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 -- 172.21.15.39:0/4079585617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac165930 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40aa800640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40ac073180 tx=0x7f40a4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.249+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004230 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a40043f0 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4015970 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac157d00 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac165eb0 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ac06a720 con 0x7f40ac1584f0 2024-04-26T23:26:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f40a4015b10 con 0x7f40ac1584f0 2024-04-26T23:26:25.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a2a00640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 0x7f408806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40a4086910 con 0x7f40ac1584f0 2024-04-26T23:26:25.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.253+0000 7f40a9e00640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 0x7f408806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.257+0000 7f40a9e00640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 0x7f408806a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f409c0ad000 tx=0x7f409c001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.257+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40a4019020 con 0x7f40ac1584f0 2024-04-26T23:26:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.421+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f40ac0b51c0 con 0x7f40ac1584f0 2024-04-26T23:26:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.421+0000 7f40a2a00640 1 -- 172.21.15.39:0/4079585617 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f40a4056870 con 0x7f40ac1584f0 2024-04-26T23:26:25.427 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 msgr2=0x7f408806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 0x7f408806a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f409c0ad000 tx=0x7f409c001e40 comp rx=0 tx=0).stop 2024-04-26T23:26:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 msgr2=0x7f40ac159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40ac073180 tx=0x7f40a4011920 comp rx=0 tx=0).stop 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 shutdown_connections 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f40880683b0 0x7f408806a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac1584f0 0x7f40ac159ec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac1561e0 0x7f40ac1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 --2- 172.21.15.39:0/4079585617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40900039c0 0x7f40ac166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 >> 172.21.15.39:0/4079585617 conn(0x7f40ac06dfd0 msgr2=0x7f40ac0d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 shutdown_connections 2024-04-26T23:26:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.425+0000 7f40b1000640 1 -- 172.21.15.39:0/4079585617 wait complete. 2024-04-26T23:26:25.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 Processor -- start 2024-04-26T23:26:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 -- start start 2024-04-26T23:26:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4cc072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc072180 con 0x7fe4cc1458d0 2024-04-26T23:26:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc0739a0 con 0x7fe4cc072e50 2024-04-26T23:26:25.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d3a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc073c80 con 0x7fe4cc073400 2024-04-26T23:26:25.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d1000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe4cc1458d0 0x7fe4cc0b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60924/0 (socket says 172.21.15.39:60924) 2024-04-26T23:26:25.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.585+0000 7fe4d1000640 1 -- 172.21.15.39:0/730727795 learned_addr learned my addr 172.21.15.39:0/730727795 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:25.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513113662 0 0) 0x7fe4cc072180 con 0x7fe4cc1458d0 2024-04-26T23:26:25.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b0003530 con 0x7fe4cc1458d0 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4c3e00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4cc072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3905778861 0 0) 0x7fe4b0003530 con 0x7fe4cc1458d0 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 msgr2=0x7fe4cc072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4cc072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 >> v1:172.21.15.71:6789/0 conn(0x7fe4cc072e50 legacy=0x7fe4cc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc145cb0 con 0x7fe4cc1458d0 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fe4bc001680 con 0x7fe4cc1458d0 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4c3e00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4cc072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 >> v1:172.21.15.39:6789/0 conn(0x7fe4cc1458d0 legacy=0x7fe4cc0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4b00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4b0003fe0 0x7fe4b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc073c80 con 0x7fe4b0004d50 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b000ddd0 con 0x7fe4b0003fe0 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b000dfd0 con 0x7fe4cc073400 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1000640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4b00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4c3e00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4b0003fe0 0x7fe4b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 -- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 msgr2=0x7fe4b00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4b00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 -- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4b0003fe0 msgr2=0x7fe4b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4b0003fe0 0x7fe4b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1a00640 1 -- 172.21.15.39:0/730727795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b0003530 con 0x7fe4b0004d50 2024-04-26T23:26:25.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.589+0000 7fe4d1000640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4cc073400 0x7fe4b00039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:25.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001e70 tx=0x7fe4c401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97f0fe2c3dede25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4001a90 con 0x7fe4b0004d50 2024-04-26T23:26:25.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4003b80 con 0x7fe4b0004d50 2024-04-26T23:26:25.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4cbe00640 1 -- 172.21.15.39:0/730727795 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4005080 con 0x7fe4b0004d50 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- 172.21.15.39:0/730727795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b0004d50 msgr2=0x7fe4b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/730727795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001e70 tx=0x7fe4c401c780 comp rx=0 tx=0).stop 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d1a00640 1 -- 172.21.15.39:0/730727795 reap_dead start 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- 172.21.15.39:0/730727795 shutdown_connections 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- 172.21.15.39:0/730727795 >> 172.21.15.39:0/730727795 conn(0x7fe4cc06c7d0 msgr2=0x7fe4cc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- 172.21.15.39:0/730727795 shutdown_connections 2024-04-26T23:26:25.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- 172.21.15.39:0/730727795 wait complete. 2024-04-26T23:26:25.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 Processor -- start 2024-04-26T23:26:25.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- start start 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4b0004d50 0x7fe4cc1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4cc139cd0 0x7fe4cc1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0cee70 con 0x7fe4cc13a130 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0cecf0 con 0x7fe4cc139cd0 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.593+0000 7fe4d3a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc072910 con 0x7fe4b0004d50 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47814/0 (socket says 172.21.15.39:47814) 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 -- 172.21.15.39:0/2576582191 learned_addr learned my addr 172.21.15.39:0/2576582191 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1000640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4b0004d50 0x7fe4cc1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4c3e00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4cc139cd0 0x7fe4cc1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 -- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4b0004d50 msgr2=0x7fe4cc1407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4b0004d50 0x7fe4cc1407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 -- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4cc139cd0 msgr2=0x7fe4cc1f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4cc139cd0 0x7fe4cc1f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 -- 172.21.15.39:0/2576582191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc13cf70 con 0x7fe4cc13a130 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d1a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4098190 tx=0x7fe4b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40ba070 con 0x7fe4cc13a130 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4005820 con 0x7fe4cc13a130 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc1f4d60 con 0x7fe4cc13a130 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc007d40 con 0x7fe4cc13a130 2024-04-26T23:26:25.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc13c6d0 con 0x7fe4cc13a130 2024-04-26T23:26:25.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc06a720 con 0x7fe4cc13a130 2024-04-26T23:26:25.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.597+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4c40bd070 con 0x7fe4cc13a130 2024-04-26T23:26:25.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.601+0000 7fe4c9600640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 0x7fe4a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.601+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4c4120140 con 0x7fe4cc13a130 2024-04-26T23:26:25.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.601+0000 7fe4d1000640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 0x7fe4a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.601+0000 7fe4d1000640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 0x7fe4a806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc001000 tx=0x7fe4bc001ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.605+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4cc1f4d60 con 0x7fe4cc13a130 2024-04-26T23:26:25.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4cc145000 con 0x7fe4cc13a130 2024-04-26T23:26:25.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4c9600640 1 -- 172.21.15.39:0/2576582191 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe4c40ac020 con 0x7fe4cc13a130 2024-04-26T23:26:25.773 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 msgr2=0x7fe4a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 0x7fe4a806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc001000 tx=0x7fe4bc001ca0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 msgr2=0x7fe4cc1f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4098190 tx=0x7fe4b0005840 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 shutdown_connections 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe4a8068380 0x7fe4a806a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4cc13a130 0x7fe4cc1f4440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4cc139cd0 0x7fe4cc1f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 --2- 172.21.15.39:0/2576582191 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4b0004d50 0x7fe4cc1407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 >> 172.21.15.39:0/2576582191 conn(0x7fe4cc06c7d0 msgr2=0x7fe4cc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 shutdown_connections 2024-04-26T23:26:25.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.769+0000 7fe4d3a00640 1 -- 172.21.15.39:0/2576582191 wait complete. 2024-04-26T23:26:25.793 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 Processor -- start 2024-04-26T23:26:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 -- start start 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5680cd810 0x7fc5680742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5680d0550 con 0x7fc5680cfe00 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5680d0830 con 0x7fc5680cdbf0 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc56dc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc5680d0b10 con 0x7fc5680cd810 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc55e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc5680cfe00 0x7fc568144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60940/0 (socket says 172.21.15.39:60940) 2024-04-26T23:26:25.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc55e000640 1 -- 172.21.15.39:0/3910271366 learned_addr learned my addr 172.21.15.39:0/3910271366 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566a00640 1 --2- 172.21.15.39:0/3910271366 >> v2:172.21.15.71:3300/0 conn(0x7fc5680cd810 0x7fc5680742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010634502 0 0) 0x7fc5680d0550 con 0x7fc5680cfe00 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc54c003530 con 0x7fc5680cfe00 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673204079 0 0) 0x7fc54c003530 con 0x7fc5680cfe00 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 >> v2:172.21.15.71:3300/0 conn(0x7fc5680cd810 msgr2=0x7fc5680742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 --2- 172.21.15.39:0/3910271366 >> v2:172.21.15.71:3300/0 conn(0x7fc5680cd810 0x7fc5680742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 >> v1:172.21.15.71:6789/0 conn(0x7fc5680cdbf0 legacy=0x7fc56806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56806e600 con 0x7fc5680cfe00 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fc550001680 con 0x7fc5680cfe00 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 >> v1:172.21.15.39:6789/0 conn(0x7fc5680cfe00 legacy=0x7fc568144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c0039c0 0x7fc54c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 0x7fc54c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c0051d0 0x7fc54c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680d0b10 con 0x7fc54c004810 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00c170 con 0x7fc54c0051d0 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c00c370 con 0x7fc54c0039c0 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc55e000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 0x7fc54c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.929+0000 7fc566a00640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c0039c0 0x7fc54c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc567400640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c0051d0 0x7fc54c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 -- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c0039c0 msgr2=0x7fc54c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c0039c0 0x7fc54c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 -- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c0051d0 msgr2=0x7fc54c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c0051d0 0x7fc54c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 -- 172.21.15.39:0/3910271366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c003530 con 0x7fc54c004810 2024-04-26T23:26:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc567400640 1 -- 172.21.15.39:0/3910271366 reap_dead start 2024-04-26T23:26:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc55e000640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 0x7fc54c004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c240 tx=0x7fc55001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbb366404f49db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550007d20 con 0x7fc54c004810 2024-04-26T23:26:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5500a9070 con 0x7fc54c004810 2024-04-26T23:26:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc566000640 1 -- 172.21.15.39:0/3910271366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550005d80 con 0x7fc54c004810 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 -- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 msgr2=0x7fc54c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 0x7fc54c004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c240 tx=0x7fc55001cc80 comp rx=0 tx=0).stop 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 -- 172.21.15.39:0/3910271366 shutdown_connections 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 --2- 172.21.15.39:0/3910271366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc54c004810 0x7fc54c004c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 -- 172.21.15.39:0/3910271366 >> 172.21.15.39:0/3910271366 conn(0x7fc5680b2af0 msgr2=0x7fc5680b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 -- 172.21.15.39:0/3910271366 shutdown_connections 2024-04-26T23:26:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.933+0000 7fc56dc00640 1 -- 172.21.15.39:0/3910271366 wait complete. 2024-04-26T23:26:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 Processor -- start 2024-04-26T23:26:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 -- start start 2024-04-26T23:26:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c004810 0x7fc568140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5681ea5d0 0x7fc5681eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680ce180 con 0x7fc5681e8cb0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680ce000 con 0x7fc5681ea5d0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc568143bb0 con 0x7fc54c004810 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47836/0 (socket says 172.21.15.39:47836) 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 -- 172.21.15.39:0/2763290787 learned_addr learned my addr 172.21.15.39:0/2763290787 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc566a00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c004810 0x7fc568140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc55e000640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5681ea5d0 0x7fc5681eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 -- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c004810 msgr2=0x7fc568140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c004810 0x7fc568140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 -- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5681ea5d0 msgr2=0x7fc5681eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5681ea5d0 0x7fc5681eaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 -- 172.21.15.39:0/2763290787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5681e9a00 con 0x7fc5681e8cb0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc567400640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5680b37e0 tx=0x7fc56000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560019070 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560006d70 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560003bc0 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.937+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5681e9ce0 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56815d910 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc568050740 con 0x7fc5681e8cb0 2024-04-26T23:26:25.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc560005070 con 0x7fc5681e8cb0 2024-04-26T23:26:25.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc55f400640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 0x7fc54406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:25.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc560085d60 con 0x7fc5681e8cb0 2024-04-26T23:26:25.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc566a00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 0x7fc54406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:25.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.941+0000 7fc566a00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 0x7fc54406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc558009c60 tx=0x7fc558009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:25.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:25.945+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc560055cc0 con 0x7fc5681e8cb0 2024-04-26T23:26:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5680d1340 con 0x7fc5681e8cb0 2024-04-26T23:26:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc55f400640 1 -- 172.21.15.39:0/2763290787 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7fc560059fc0 con 0x7fc5681e8cb0 2024-04-26T23:26:26.157 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:26.157 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 msgr2=0x7fc54406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 0x7fc54406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc558009c60 tx=0x7fc558009190 comp rx=0 tx=0).stop 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 msgr2=0x7fc5681e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5680b37e0 tx=0x7fc56000e8a0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 shutdown_connections 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc544068380 0x7fc54406a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5681e8cb0 0x7fc5681e9130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5681ea5d0 0x7fc5681eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 --2- 172.21.15.39:0/2763290787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc54c004810 0x7fc568140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 >> 172.21.15.39:0/2763290787 conn(0x7fc5680b2af0 msgr2=0x7fc568073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 shutdown_connections 2024-04-26T23:26:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.153+0000 7fc56dc00640 1 -- 172.21.15.39:0/2763290787 wait complete. 2024-04-26T23:26:26.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:26.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 Processor -- start 2024-04-26T23:26:26.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 -- start start 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fea240d12d0 0x7fea24161270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 0x7fea240b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea240d1760 con 0x7fea2415cf60 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fea240b6220 con 0x7fea240d12d0 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2b000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fea240d1a20 con 0x7fea240b66b0 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea29c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fea2415cf60 0x7fea24160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60952/0 (socket says 172.21.15.39:60952) 2024-04-26T23:26:26.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea29c00640 1 -- 172.21.15.39:0/2947556187 learned_addr learned my addr 172.21.15.39:0/2947556187 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:26.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2a600640 1 --2- 172.21.15.39:0/2947556187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 0x7fea240b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735139720 0 0) 0x7fea240d1760 con 0x7fea2415cf60 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea29200640 1 --2- 172.21.15.39:0/2947556187 >> v2:172.21.15.71:3300/0 conn(0x7fea240d12d0 0x7fea24161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea0c003530 con 0x7fea2415cf60 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1444157919 0 0) 0x7fea0c003530 con 0x7fea2415cf60 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2a600640 1 -- 172.21.15.39:0/2947556187 >> v2:172.21.15.71:3300/0 conn(0x7fea240d12d0 msgr2=0x7fea24161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2a600640 1 --2- 172.21.15.39:0/2947556187 >> v2:172.21.15.71:3300/0 conn(0x7fea240d12d0 0x7fea24161270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2a600640 1 -- 172.21.15.39:0/2947556187 >> v1:172.21.15.39:6789/0 conn(0x7fea2415cf60 legacy=0x7fea24160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.317+0000 7fea2a600640 1 -- 172.21.15.39:0/2947556187 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea240d1d00 con 0x7fea240b66b0 2024-04-26T23:26:26.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2a600640 1 --2- 172.21.15.39:0/2947556187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 0x7fea240b6b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009d90 tx=0x7fea1c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51396c565d0aee6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0ac070 con 0x7fea240b66b0 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1c0a6410 con 0x7fea240b66b0 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea23e00640 1 -- 172.21.15.39:0/2947556187 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18001800 con 0x7fea240b66b0 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 -- 172.21.15.39:0/2947556187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 msgr2=0x7fea240b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 --2- 172.21.15.39:0/2947556187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 0x7fea240b6b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009d90 tx=0x7fea1c01c800 comp rx=0 tx=0).stop 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 -- 172.21.15.39:0/2947556187 shutdown_connections 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 --2- 172.21.15.39:0/2947556187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea240b66b0 0x7fea240b6b00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 --2- 172.21.15.39:0/2947556187 >> v2:172.21.15.71:3300/0 conn(0x7fea240d12d0 0x7fea24161270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 -- 172.21.15.39:0/2947556187 >> 172.21.15.39:0/2947556187 conn(0x7fea240d2d80 msgr2=0x7fea240d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 -- 172.21.15.39:0/2947556187 shutdown_connections 2024-04-26T23:26:26.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.321+0000 7fea2b000640 1 -- 172.21.15.39:0/2947556187 wait complete. 2024-04-26T23:26:26.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 Processor -- start 2024-04-26T23:26:26.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- start start 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea240b66b0 0x7fea241f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea2415cf60 0x7fea24150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea24161930 con 0x7fea240d12d0 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea241617b0 con 0x7fea240b66b0 2024-04-26T23:26:26.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fea24169ea0 con 0x7fea2415cf60 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47842/0 (socket says 172.21.15.39:47842) 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 -- 172.21.15.39:0/3983341584 learned_addr learned my addr 172.21.15.39:0/3983341584 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29c00640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea240b66b0 0x7fea241f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2a600640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea2415cf60 0x7fea24150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 -- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea2415cf60 msgr2=0x7fea24150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea2415cf60 0x7fea24150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 -- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea240b66b0 msgr2=0x7fea241f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea240b66b0 0x7fea241f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 -- 172.21.15.39:0/3983341584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241f8a30 con 0x7fea240d12d0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea29200640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea1000e930 tx=0x7fea1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10017070 con 0x7fea240d12d0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1000ca00 con 0x7fea240d12d0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea241f8d10 con 0x7fea240d12d0 2024-04-26T23:26:26.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1000cdb0 con 0x7fea240d12d0 2024-04-26T23:26:26.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea241f92d0 con 0x7fea240d12d0 2024-04-26T23:26:26.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.325+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea240506d0 con 0x7fea240d12d0 2024-04-26T23:26:26.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.329+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea1001a070 con 0x7fea240d12d0 2024-04-26T23:26:26.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.329+0000 7fea21600640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 0x7fea0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.329+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fea10086a30 con 0x7fea240d12d0 2024-04-26T23:26:26.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.329+0000 7fea29c00640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 0x7fea0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.329+0000 7fea29c00640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 0x7fea0406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea18007900 tx=0x7fea18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.333+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea100570a0 con 0x7fea240d12d0 2024-04-26T23:26:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.501+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea240c65c0 con 0x7fea240d12d0 2024-04-26T23:26:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.501+0000 7fea21600640 1 -- 172.21.15.39:0/3983341584 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7fea100569a0 con 0x7fea240d12d0 2024-04-26T23:26:26.507 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:26.507 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 msgr2=0x7fea0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 0x7fea0406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea18007900 tx=0x7fea18009040 comp rx=0 tx=0).stop 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 msgr2=0x7fea240c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea1000e930 tx=0x7fea1000edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 shutdown_connections 2024-04-26T23:26:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fea04068380 0x7fea0406a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea2415cf60 0x7fea24150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea240d12d0 0x7fea240c9280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 --2- 172.21.15.39:0/3983341584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea240b66b0 0x7fea241f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 >> 172.21.15.39:0/3983341584 conn(0x7fea240d2d80 msgr2=0x7fea240cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 shutdown_connections 2024-04-26T23:26:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.505+0000 7fea2b000640 1 -- 172.21.15.39:0/3983341584 wait complete. 2024-04-26T23:26:26.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:26.530 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:26.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 Processor -- start 2024-04-26T23:26:26.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 -- start start 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 0x7f876c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f876c0b41f0 0x7f876c0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876c072cf0 con 0x7f876c0d11e0 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f876c072fd0 con 0x7f876c0b41f0 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8773a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f876c0732b0 con 0x7f876c06f2b0 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8771000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f876c0d11e0 0x7f876c0d15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60968/0 (socket says 172.21.15.39:60968) 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8771000640 1 -- 172.21.15.39:0/4068177178 learned_addr learned my addr 172.21.15.39:0/4068177178 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876be00640 1 --2- 172.21.15.39:0/4068177178 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 0x7f876c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f8771a00640 1 --2- 172.21.15.39:0/4068177178 >> v2:172.21.15.71:3300/0 conn(0x7f876c0b41f0 0x7f876c0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876b400640 1 -- 172.21.15.39:0/4068177178 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379656069 0 0) 0x7f876c072cf0 con 0x7f876c0d11e0 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876b400640 1 -- 172.21.15.39:0/4068177178 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8754003530 con 0x7f876c0d11e0 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876be00640 1 -- 172.21.15.39:0/4068177178 >> v2:172.21.15.71:3300/0 conn(0x7f876c0b41f0 msgr2=0x7f876c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876be00640 1 --2- 172.21.15.39:0/4068177178 >> v2:172.21.15.71:3300/0 conn(0x7f876c0b41f0 0x7f876c0b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876be00640 1 -- 172.21.15.39:0/4068177178 >> v1:172.21.15.39:6789/0 conn(0x7f876c0d11e0 legacy=0x7f876c0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.669+0000 7f876be00640 1 -- 172.21.15.39:0/4068177178 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c073590 con 0x7f876c06f2b0 2024-04-26T23:26:26.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f876be00640 1 --2- 172.21.15.39:0/4068177178 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 0x7f876c0723c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87580097c0 tx=0x7f875801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da93fdc969a8e971 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f876b400640 1 -- 172.21.15.39:0/4068177178 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87580b1070 con 0x7f876c06f2b0 2024-04-26T23:26:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f876b400640 1 -- 172.21.15.39:0/4068177178 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87580ac600 con 0x7f876c06f2b0 2024-04-26T23:26:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f876b400640 1 -- 172.21.15.39:0/4068177178 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87580ac9d0 con 0x7f876c06f2b0 2024-04-26T23:26:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 -- 172.21.15.39:0/4068177178 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 msgr2=0x7f876c0723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 --2- 172.21.15.39:0/4068177178 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 0x7f876c0723c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87580097c0 tx=0x7f875801c380 comp rx=0 tx=0).stop 2024-04-26T23:26:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 -- 172.21.15.39:0/4068177178 shutdown_connections 2024-04-26T23:26:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 --2- 172.21.15.39:0/4068177178 >> v2:172.21.15.71:3300/0 conn(0x7f876c0b41f0 0x7f876c0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 --2- 172.21.15.39:0/4068177178 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c06f2b0 0x7f876c0723c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 -- 172.21.15.39:0/4068177178 >> 172.21.15.39:0/4068177178 conn(0x7f876c06c7d0 msgr2=0x7f876c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 -- 172.21.15.39:0/4068177178 shutdown_connections 2024-04-26T23:26:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.673+0000 7f8773a00640 1 -- 172.21.15.39:0/4068177178 wait complete. 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 Processor -- start 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- start start 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 0x7f876c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 0x7f876c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f876c16c1c0 con 0x7f876c0d11e0 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f876c162c00 con 0x7f876c06f2b0 2024-04-26T23:26:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f876c16c340 con 0x7f876c0b41f0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47854/0 (socket says 172.21.15.39:47854) 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 -- 172.21.15.39:0/2359273281 learned_addr learned my addr 172.21.15.39:0/2359273281 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771000640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 0x7f876c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f876be00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 0x7f876c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 -- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 msgr2=0x7f876c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 0x7f876c151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 -- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 msgr2=0x7f876c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 0x7f876c14b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 -- 172.21.15.39:0/2359273281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c152000 con 0x7f876c0d11e0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771000640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 0x7f876c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f876be00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 0x7f876c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8771a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f876400efc0 tx=0x7f876400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764018020 con 0x7f876c0d11e0 2024-04-26T23:26:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764014480 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764014870 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c14a8c0 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c14ae80 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.677+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c06a720 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.681+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f876401b020 con 0x7f876c0d11e0 2024-04-26T23:26:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.681+0000 7f8768c00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 0x7f874c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.681+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8764087480 con 0x7f876c0d11e0 2024-04-26T23:26:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.681+0000 7f8771000640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 0x7f874c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.681+0000 7f8771000640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 0x7f874c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8760005890 tx=0x7f8760009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.685+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8764022070 con 0x7f876c0d11e0 2024-04-26T23:26:26.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f876c06cbb0 con 0x7f876c0d11e0 2024-04-26T23:26:26.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8768c00640 1 -- 172.21.15.39:0/2359273281 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f8764010040 con 0x7f876c0d11e0 2024-04-26T23:26:26.853 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 msgr2=0x7f874c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 0x7f874c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8760005890 tx=0x7f8760009040 comp rx=0 tx=0).stop 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 msgr2=0x7f876c14ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f876400efc0 tx=0x7f876400c490 comp rx=0 tx=0).stop 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 shutdown_connections 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f874c068380 0x7f874c06a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f876c0d11e0 0x7f876c14ecb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f876c0b41f0 0x7f876c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 --2- 172.21.15.39:0/2359273281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f876c06f2b0 0x7f876c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:26.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 >> 172.21.15.39:0/2359273281 conn(0x7f876c06c7d0 msgr2=0x7f876c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:26.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 shutdown_connections 2024-04-26T23:26:26.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:26.849+0000 7f8773a00640 1 -- 172.21.15.39:0/2359273281 wait complete. 2024-04-26T23:26:26.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:27.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 Processor -- start 2024-04-26T23:26:27.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 -- start start 2024-04-26T23:26:27.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 0x7f84e40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f84e40b55c0 0x7f84e4072b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e40b5ab0 con 0x7f84e415b7e0 2024-04-26T23:26:27.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40d18f0 con 0x7f84e40b55c0 2024-04-26T23:26:27.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84eb600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f84e40ce1a0 con 0x7f84e40cdd40 2024-04-26T23:26:27.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 0x7f84e40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e9600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f84e40b55c0 0x7f84e4072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e8c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f84e415b7e0 0x7f84e40d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40444/0 (socket says 172.21.15.39:40444) 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 0x7f84e40b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:45850/0 (socket says 172.21.15.39:45850) 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e8c00640 1 -- 172.21.15.39:0/2017548099 learned_addr learned my addr 172.21.15.39:0/2017548099 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e9600640 1 -- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 msgr2=0x7f84e40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e9600640 1 --2- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 0x7f84e40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e9600640 1 -- 172.21.15.39:0/2017548099 >> v1:172.21.15.71:6789/0 conn(0x7f84e415b7e0 legacy=0x7f84e40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.013+0000 7f84e9600640 1 -- 172.21.15.39:0/2017548099 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e40b5d90 con 0x7f84e40b55c0 2024-04-26T23:26:27.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84e9600640 1 --2- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e40b55c0 0x7f84e4072b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097c0 tx=0x7f84dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae32d67a5ead97d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84e3e00640 1 -- 172.21.15.39:0/2017548099 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0b0070 con 0x7f84e40b55c0 2024-04-26T23:26:27.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84e3e00640 1 -- 172.21.15.39:0/2017548099 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc0ab600 con 0x7f84e40b55c0 2024-04-26T23:26:27.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84e3e00640 1 -- 172.21.15.39:0/2017548099 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0ab9d0 con 0x7f84e40b55c0 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 -- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e40b55c0 msgr2=0x7f84e4072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 --2- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e40b55c0 0x7f84e4072b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097c0 tx=0x7f84dc01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 -- 172.21.15.39:0/2017548099 shutdown_connections 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 --2- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e40b55c0 0x7f84e4072b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 --2- 172.21.15.39:0/2017548099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40cdd40 0x7f84e40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 -- 172.21.15.39:0/2017548099 >> 172.21.15.39:0/2017548099 conn(0x7f84e406c7d0 msgr2=0x7f84e406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 -- 172.21.15.39:0/2017548099 shutdown_connections 2024-04-26T23:26:27.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.017+0000 7f84eb600640 1 -- 172.21.15.39:0/2017548099 wait complete. 2024-04-26T23:26:27.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 Processor -- start 2024-04-26T23:26:27.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- start start 2024-04-26T23:26:27.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40b55c0 0x7f84e414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 0x7f84e4157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40727c0 con 0x7f84e40cdd40 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4072640 con 0x7f84e415b7e0 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f84e406f7f0 con 0x7f84e40b55c0 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47858/0 (socket says 172.21.15.39:47858) 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 -- 172.21.15.39:0/3118365263 learned_addr learned my addr 172.21.15.39:0/3118365263 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e8c00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40b55c0 0x7f84e414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e9600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 0x7f84e4157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 -- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40b55c0 msgr2=0x7f84e414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40b55c0 0x7f84e414a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 -- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 msgr2=0x7f84e4157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 0x7f84e4157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 -- 172.21.15.39:0/3118365263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41fcb50 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e9600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 0x7f84e4157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84dbe00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00e930 tx=0x7f84cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc017070 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc00ca00 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00cdb0 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e414e5d0 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e414eb90 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.021+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e406a720 con 0x7f84e40cdd40 2024-04-26T23:26:27.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.025+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84cc01a070 con 0x7f84e40cdd40 2024-04-26T23:26:27.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.025+0000 7f84e1600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 0x7f84c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.025+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84cc086da0 con 0x7f84e40cdd40 2024-04-26T23:26:27.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.025+0000 7f84e8c00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 0x7f84c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.025+0000 7f84e8c00640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 0x7f84c006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84d40012f0 tx=0x7f84d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.029+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f84cc057410 con 0x7f84e40cdd40 2024-04-26T23:26:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84e40d0500 con 0x7f84e40cdd40 2024-04-26T23:26:27.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84e1600640 1 -- 172.21.15.39:0/3118365263 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f84cc056d10 con 0x7f84e40cdd40 2024-04-26T23:26:27.197 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 msgr2=0x7f84c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 0x7f84c006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84d40012f0 tx=0x7f84d4009040 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 msgr2=0x7f84e414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00e930 tx=0x7f84cc00edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 shutdown_connections 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f84c0068380 0x7f84c006a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e415b7e0 0x7f84e4157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e40cdd40 0x7f84e414f0b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 --2- 172.21.15.39:0/3118365263 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84e40b55c0 0x7f84e414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 >> 172.21.15.39:0/3118365263 conn(0x7f84e406c7d0 msgr2=0x7f84e40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 shutdown_connections 2024-04-26T23:26:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.193+0000 7f84eb600640 1 -- 172.21.15.39:0/3118365263 wait complete. 2024-04-26T23:26:27.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:27.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 Processor -- start 2024-04-26T23:26:27.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 -- start start 2024-04-26T23:26:27.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e7c1458d0 0x7f2e7c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c072180 con 0x7f2e7c0ce5e0 2024-04-26T23:26:27.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c0739a0 con 0x7f2e7c073400 2024-04-26T23:26:27.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e81600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c073c80 con 0x7f2e7c1458d0 2024-04-26T23:26:27.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e7b400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2e7c0ce5e0 0x7f2e7c06f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60978/0 (socket says 172.21.15.39:60978) 2024-04-26T23:26:27.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e7b400640 1 -- 172.21.15.39:0/1106922371 learned_addr learned my addr 172.21.15.39:0/1106922371 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:27.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.357+0000 7f2e7aa00640 1 --2- 172.21.15.39:0/1106922371 >> v2:172.21.15.71:3300/0 conn(0x7f2e7c1458d0 0x7f2e7c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7a000640 1 -- 172.21.15.39:0/1106922371 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362994999 0 0) 0x7f2e7c072180 con 0x7f2e7c0ce5e0 2024-04-26T23:26:27.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7a000640 1 -- 172.21.15.39:0/1106922371 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e60003530 con 0x7f2e7c0ce5e0 2024-04-26T23:26:27.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7aa00640 1 -- 172.21.15.39:0/1106922371 >> v1:172.21.15.71:6789/0 conn(0x7f2e7c073400 legacy=0x7f2e7c072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7aa00640 1 -- 172.21.15.39:0/1106922371 >> v1:172.21.15.39:6789/0 conn(0x7f2e7c0ce5e0 legacy=0x7f2e7c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7aa00640 1 -- 172.21.15.39:0/1106922371 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c145cb0 con 0x7f2e7c1458d0 2024-04-26T23:26:27.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7aa00640 1 --2- 172.21.15.39:0/1106922371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c1458d0 0x7f2e7c0b4890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097f0 tx=0x7f2e6c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d46ceffb26535af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7a000640 1 -- 172.21.15.39:0/1106922371 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0b0070 con 0x7f2e7c1458d0 2024-04-26T23:26:27.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7a000640 1 -- 172.21.15.39:0/1106922371 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0ab600 con 0x7f2e7c1458d0 2024-04-26T23:26:27.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.361+0000 7f2e7a000640 1 -- 172.21.15.39:0/1106922371 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0ab9d0 con 0x7f2e7c1458d0 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- 172.21.15.39:0/1106922371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c1458d0 msgr2=0x7f2e7c0b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 --2- 172.21.15.39:0/1106922371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c1458d0 0x7f2e7c0b4890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097f0 tx=0x7f2e6c01c410 comp rx=0 tx=0).stop 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- 172.21.15.39:0/1106922371 shutdown_connections 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 --2- 172.21.15.39:0/1106922371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c1458d0 0x7f2e7c0b4890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- 172.21.15.39:0/1106922371 >> 172.21.15.39:0/1106922371 conn(0x7f2e7c06c7d0 msgr2=0x7f2e7c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- 172.21.15.39:0/1106922371 shutdown_connections 2024-04-26T23:26:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- 172.21.15.39:0/1106922371 wait complete. 2024-04-26T23:26:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 Processor -- start 2024-04-26T23:26:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- start start 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c0ce5e0 0x7f2e7c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e7c1458d0 0x7f2e7c143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c06fe00 con 0x7f2e7c073400 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c06fc80 con 0x7f2e7c0ce5e0 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e81600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c0ce9f0 con 0x7f2e7c1458d0 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47862/0 (socket says 172.21.15.39:47862) 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 -- 172.21.15.39:0/2209968005 learned_addr learned my addr 172.21.15.39:0/2209968005 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:27.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7b400640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e7c1458d0 0x7f2e7c143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e72000640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c0ce5e0 0x7f2e7c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 -- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e7c1458d0 msgr2=0x7f2e7c143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e7c1458d0 0x7f2e7c143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 -- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c0ce5e0 msgr2=0x7f2e7c143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c0ce5e0 0x7f2e7c143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 -- 172.21.15.39:0/2209968005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c0c8dc0 con 0x7f2e7c073400 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.365+0000 7f2e7aa00640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097f0 tx=0x7f2e6c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0b0040 con 0x7f2e7c073400 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c004030 con 0x7f2e7c073400 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c006e20 con 0x7f2e7c073400 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c0c90a0 con 0x7f2e7c073400 2024-04-26T23:26:27.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c0cab60 con 0x7f2e7c073400 2024-04-26T23:26:27.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c06a720 con 0x7f2e7c073400 2024-04-26T23:26:27.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e6c003620 con 0x7f2e7c073400 2024-04-26T23:26:27.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 0x7f2e5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2e6c121400 con 0x7f2e7c073400 2024-04-26T23:26:27.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.369+0000 7f2e72000640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 0x7f2e5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.373+0000 7f2e72000640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 0x7f2e5806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0cc910 tx=0x7f2e64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.373+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2e6c016090 con 0x7f2e7c073400 2024-04-26T23:26:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.537+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2e7c0b50b0 con 0x7f2e7c073400 2024-04-26T23:26:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.537+0000 7f2e73400640 1 -- 172.21.15.39:0/2209968005 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2e6c0bf3a0 con 0x7f2e7c073400 2024-04-26T23:26:27.543 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 msgr2=0x7f2e5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 0x7f2e5806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0cc910 tx=0x7f2e64009040 comp rx=0 tx=0).stop 2024-04-26T23:26:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 msgr2=0x7f2e7c1fbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097f0 tx=0x7f2e6c01ac50 comp rx=0 tx=0).stop 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 shutdown_connections 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2e58068380 0x7f2e5806a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e7c1458d0 0x7f2e7c143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e7c0ce5e0 0x7f2e7c143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 --2- 172.21.15.39:0/2209968005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7c073400 0x7f2e7c1fbeb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 >> 172.21.15.39:0/2209968005 conn(0x7f2e7c06c7d0 msgr2=0x7f2e7c144330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 shutdown_connections 2024-04-26T23:26:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.541+0000 7f2e81600640 1 -- 172.21.15.39:0/2209968005 wait complete. 2024-04-26T23:26:27.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:27.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 Processor -- start 2024-04-26T23:26:27.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 -- start start 2024-04-26T23:26:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88015f340 0x7fe8800d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe88009c0f0 0x7fe8800b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800cd810 con 0x7fe8800b5710 2024-04-26T23:26:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe8800d26a0 con 0x7fe88009c0f0 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe885a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8800ce140 con 0x7fe88015f340 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88015f340 0x7fe8800d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe88009c0f0 0x7fe8800b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe88009c0f0 0x7fe8800b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35306/0 (socket says 172.21.15.39:35306) 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 -- 172.21.15.39:0/2679090692 learned_addr learned my addr 172.21.15.39:0/2679090692 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe877e00640 1 --1- 172.21.15.39:0/2679090692 >> v1:172.21.15.71:6789/0 conn(0x7fe8800b5710 0x7fe88009b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40462/0 (socket says 172.21.15.39:40462) 2024-04-26T23:26:27.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 -- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88015f340 msgr2=0x7fe8800d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:27.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 --2- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88015f340 0x7fe8800d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 -- 172.21.15.39:0/2679090692 >> v1:172.21.15.71:6789/0 conn(0x7fe8800b5710 legacy=0x7fe88009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.701+0000 7fe87f400640 1 -- 172.21.15.39:0/2679090692 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8800cdaf0 con 0x7fe88009c0f0 2024-04-26T23:26:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe87f400640 1 --2- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe88009c0f0 0x7fe8800b82a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe878009e50 tx=0x7fe87801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce116c4e7bac697 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe87e000640 1 -- 172.21.15.39:0/2679090692 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780a5850 con 0x7fe88009c0f0 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe87e000640 1 -- 172.21.15.39:0/2679090692 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8780a59f0 con 0x7fe88009c0f0 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe87e000640 1 -- 172.21.15.39:0/2679090692 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780a5dc0 con 0x7fe88009c0f0 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 -- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe88009c0f0 msgr2=0x7fe8800b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 --2- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe88009c0f0 0x7fe8800b82a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe878009e50 tx=0x7fe87801c970 comp rx=0 tx=0).stop 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 -- 172.21.15.39:0/2679090692 shutdown_connections 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 --2- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe88009c0f0 0x7fe8800b82a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 --2- 172.21.15.39:0/2679090692 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88015f340 0x7fe8800d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 -- 172.21.15.39:0/2679090692 >> 172.21.15.39:0/2679090692 conn(0x7fe8800b4b80 msgr2=0x7fe8800b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 -- 172.21.15.39:0/2679090692 shutdown_connections 2024-04-26T23:26:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.705+0000 7fe885a00640 1 -- 172.21.15.39:0/2679090692 wait complete. 2024-04-26T23:26:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 Processor -- start 2024-04-26T23:26:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- start start 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88009c0f0 0x7fe88014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 0x7fe880158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe8800ce730 con 0x7fe88015f340 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe8800ce5b0 con 0x7fe8800b5710 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8800ce8b0 con 0x7fe88009c0f0 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47876/0 (socket says 172.21.15.39:47876) 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 -- 172.21.15.39:0/492068551 learned_addr learned my addr 172.21.15.39:0/492068551 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe877e00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 0x7fe880158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87ea00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88009c0f0 0x7fe88014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 -- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88009c0f0 msgr2=0x7fe88014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88009c0f0 0x7fe88014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 -- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 msgr2=0x7fe880158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 0x7fe880158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 -- 172.21.15.39:0/492068551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801575b0 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe877e00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 0x7fe880158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe87f400640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8780af040 tx=0x7fe878019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780bc020 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8780b8670 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780b8a40 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe880157890 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.709+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe880158170 con 0x7fe88015f340 2024-04-26T23:26:27.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880050740 con 0x7fe88015f340 2024-04-26T23:26:27.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8780bf020 con 0x7fe88015f340 2024-04-26T23:26:27.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe876a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 0x7fe85c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:27.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe878121b70 con 0x7fe88015f340 2024-04-26T23:26:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe87ea00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 0x7fe85c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.713+0000 7fe87ea00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 0x7fe85c06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe88015ea30 tx=0x7fe870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:27.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.717+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe8780c6030 con 0x7fe88015f340 2024-04-26T23:26:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.917+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8800cd450 con 0x7fe88015f340 2024-04-26T23:26:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.917+0000 7fe876a00640 1 -- 172.21.15.39:0/492068551 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7fe878016620 con 0x7fe88015f340 2024-04-26T23:26:27.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:27.923 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 msgr2=0x7fe85c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 0x7fe85c06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe88015ea30 tx=0x7fe870008040 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 msgr2=0x7fe880156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8780af040 tx=0x7fe878019710 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 shutdown_connections 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe85c068380 0x7fe85c06a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe88015f340 0x7fe880156af0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8800b5710 0x7fe880158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 --2- 172.21.15.39:0/492068551 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe88009c0f0 0x7fe88014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 >> 172.21.15.39:0/492068551 conn(0x7fe8800b4b80 msgr2=0x7fe88015c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 shutdown_connections 2024-04-26T23:26:27.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:27.921+0000 7fe885a00640 1 -- 172.21.15.39:0/492068551 wait complete. 2024-04-26T23:26:27.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 Processor -- start 2024-04-26T23:26:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 -- start start 2024-04-26T23:26:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 0x7f58c40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 0x7f58c409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c40cd810 con 0x7f58c415f720 2024-04-26T23:26:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f58c40d26a0 con 0x7f58c415f340 2024-04-26T23:26:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40ce140 con 0x7f58c40b5710 2024-04-26T23:26:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c1e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 0x7f58c40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58b9400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 0x7f58c409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c1e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 0x7f58c40d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35320/0 (socket says 172.21.15.39:35320) 2024-04-26T23:26:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c1e00640 1 -- 172.21.15.39:0/2479149455 learned_addr learned my addr 172.21.15.39:0/2479149455 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:28.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58c2800640 1 --1- 172.21.15.39:0/2479149455 >> v1:172.21.15.71:6789/0 conn(0x7f58c415f720 0x7f58c40b82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:40466/0 (socket says 172.21.15.39:40466) 2024-04-26T23:26:28.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58b9400640 1 -- 172.21.15.39:0/2479149455 >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 msgr2=0x7f58c40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:28.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58b9400640 1 --2- 172.21.15.39:0/2479149455 >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 0x7f58c40d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58b9400640 1 -- 172.21.15.39:0/2479149455 >> v1:172.21.15.71:6789/0 conn(0x7f58c415f720 legacy=0x7f58c40b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.081+0000 7f58b9400640 1 -- 172.21.15.39:0/2479149455 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c40cdaf0 con 0x7f58c40b5710 2024-04-26T23:26:28.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.085+0000 7f58b9400640 1 --2- 172.21.15.39:0/2479149455 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 0x7f58c409b9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097c0 tx=0x7f58ac01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6975edd5d4fdf13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.085+0000 7f58c1400640 1 -- 172.21.15.39:0/2479149455 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0b0070 con 0x7f58c40b5710 2024-04-26T23:26:28.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.085+0000 7f58c1400640 1 -- 172.21.15.39:0/2479149455 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0ab600 con 0x7f58c40b5710 2024-04-26T23:26:28.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.085+0000 7f58c1400640 1 -- 172.21.15.39:0/2479149455 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0ab9d0 con 0x7f58c40b5710 2024-04-26T23:26:28.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- 172.21.15.39:0/2479149455 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 msgr2=0x7f58c409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- 172.21.15.39:0/2479149455 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 0x7f58c409b9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097c0 tx=0x7f58ac01c3e0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- 172.21.15.39:0/2479149455 shutdown_connections 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- 172.21.15.39:0/2479149455 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c40b5710 0x7f58c409b9e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- 172.21.15.39:0/2479149455 >> v2:172.21.15.71:3300/0 conn(0x7f58c415f340 0x7f58c40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- 172.21.15.39:0/2479149455 >> 172.21.15.39:0/2479149455 conn(0x7f58c40b4b80 msgr2=0x7f58c40b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- 172.21.15.39:0/2479149455 shutdown_connections 2024-04-26T23:26:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- 172.21.15.39:0/2479149455 wait complete. 2024-04-26T23:26:28.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 Processor -- start 2024-04-26T23:26:28.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- start start 2024-04-26T23:26:28.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 0x7f58c4161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c415f340 0x7f58c40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40b8f40 con 0x7f58c415f720 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40b8dc0 con 0x7f58c40b5710 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40cedc0 con 0x7f58c415f340 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47878/0 (socket says 172.21.15.39:47878) 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c2800640 1 -- 172.21.15.39:0/865988856 learned_addr learned my addr 172.21.15.39:0/865988856 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58c1e00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 0x7f58c4161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.089+0000 7f58b9400640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c415f340 0x7f58c40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 -- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c415f340 msgr2=0x7f58c40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c415f340 0x7f58c40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 -- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 msgr2=0x7f58c4161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 0x7f58c4161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 -- 172.21.15.39:0/865988856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c40c8470 con 0x7f58c415f720 2024-04-26T23:26:28.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c1e00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 0x7f58c4161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c2800640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c390 tx=0x7f58bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0074e0 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc007680 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0049f0 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c40c8750 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c40c8ff0 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c4050740 con 0x7f58c415f720 2024-04-26T23:26:28.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.093+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58bc01a020 con 0x7f58c415f720 2024-04-26T23:26:28.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.097+0000 7f58baa00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 0x7f58a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.097+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58bc085fb0 con 0x7f58c415f720 2024-04-26T23:26:28.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.097+0000 7f58c1e00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 0x7f58a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.097+0000 7f58c1e00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 0x7f58a006a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58c4162be0 tx=0x7f58b400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.101+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f58bc055f20 con 0x7f58c415f720 2024-04-26T23:26:28.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.265+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c40cd450 con 0x7f58c415f720 2024-04-26T23:26:28.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.265+0000 7f58baa00640 1 -- 172.21.15.39:0/865988856 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f58bc05a220 con 0x7f58c415f720 2024-04-26T23:26:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:28.271 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:28.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 msgr2=0x7f58a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 0x7f58a006a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58c4162be0 tx=0x7f58b400b040 comp rx=0 tx=0).stop 2024-04-26T23:26:28.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 msgr2=0x7f58c4144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c390 tx=0x7f58bc00c850 comp rx=0 tx=0).stop 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 shutdown_connections 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f58a0068380 0x7f58a006a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58c415f720 0x7f58c4144c60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58c415f340 0x7f58c40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 --2- 172.21.15.39:0/865988856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58c40b5710 0x7f58c4161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 >> 172.21.15.39:0/865988856 conn(0x7f58c40b4b80 msgr2=0x7f58c40b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 shutdown_connections 2024-04-26T23:26:28.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.269+0000 7f58c8a00640 1 -- 172.21.15.39:0/865988856 wait complete. 2024-04-26T23:26:28.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:28.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 Processor -- start 2024-04-26T23:26:28.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 -- start start 2024-04-26T23:26:28.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73840cf2a0 0x7f738406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f738406fab0 0x7f73840cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7384160060 con 0x7f7384145820 2024-04-26T23:26:28.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f738406ff20 con 0x7f738406fab0 2024-04-26T23:26:28.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f738a800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f73840cd5c0 con 0x7f73840cf2a0 2024-04-26T23:26:28.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f7383e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f738406fab0 0x7f73840cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f7383400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7384145820 0x7f73840b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60986/0 (socket says 172.21.15.39:60986) 2024-04-26T23:26:28.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f7383400640 1 -- 172.21.15.39:0/4096559702 learned_addr learned my addr 172.21.15.39:0/4096559702 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:28.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.429+0000 7f737aa00640 1 --2- 172.21.15.39:0/4096559702 >> v2:172.21.15.71:3300/0 conn(0x7f73840cf2a0 0x7f738406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7383e00640 1 -- 172.21.15.39:0/4096559702 >> v2:172.21.15.71:3300/0 conn(0x7f73840cf2a0 msgr2=0x7f738406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:28.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7383e00640 1 --2- 172.21.15.39:0/4096559702 >> v2:172.21.15.71:3300/0 conn(0x7f73840cf2a0 0x7f738406f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7383e00640 1 -- 172.21.15.39:0/4096559702 >> v1:172.21.15.39:6789/0 conn(0x7f7384145820 legacy=0x7f73840b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7383e00640 1 -- 172.21.15.39:0/4096559702 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7384160340 con 0x7f738406fab0 2024-04-26T23:26:28.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7383e00640 1 --2- 172.21.15.39:0/4096559702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738406fab0 0x7f73840cda50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73840ce9b0 tx=0x7f737c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e04a3c38d3da16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7382a00640 1 -- 172.21.15.39:0/4096559702 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b4070 con 0x7f738406fab0 2024-04-26T23:26:28.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7382a00640 1 -- 172.21.15.39:0/4096559702 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c0a7b00 con 0x7f738406fab0 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f7382a00640 1 -- 172.21.15.39:0/4096559702 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0af440 con 0x7f738406fab0 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 -- 172.21.15.39:0/4096559702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738406fab0 msgr2=0x7f73840cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 --2- 172.21.15.39:0/4096559702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738406fab0 0x7f73840cda50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73840ce9b0 tx=0x7f737c01eb40 comp rx=0 tx=0).stop 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 -- 172.21.15.39:0/4096559702 shutdown_connections 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 --2- 172.21.15.39:0/4096559702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738406fab0 0x7f73840cda50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 --2- 172.21.15.39:0/4096559702 >> v2:172.21.15.71:3300/0 conn(0x7f73840cf2a0 0x7f738406f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 -- 172.21.15.39:0/4096559702 >> 172.21.15.39:0/4096559702 conn(0x7f73840b2af0 msgr2=0x7f73840b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 -- 172.21.15.39:0/4096559702 shutdown_connections 2024-04-26T23:26:28.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.433+0000 7f738a800640 1 -- 172.21.15.39:0/4096559702 wait complete. 2024-04-26T23:26:28.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 Processor -- start 2024-04-26T23:26:28.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 -- start start 2024-04-26T23:26:28.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f738406fab0 0x7f73841f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73840cf2a0 0x7f73841f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7384145d80 con 0x7f7384145820 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7384145c00 con 0x7f738406fab0 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f738415fc30 con 0x7f73840cf2a0 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47908/0 (socket says 172.21.15.39:47908) 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 -- 172.21.15.39:0/2548675414 learned_addr learned my addr 172.21.15.39:0/2548675414 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383400640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f738406fab0 0x7f73841f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f737aa00640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73840cf2a0 0x7f73841f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 -- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73840cf2a0 msgr2=0x7f73841f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73840cf2a0 0x7f73841f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 -- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f738406fab0 msgr2=0x7f73841f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f738406fab0 0x7f73841f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 -- 172.21.15.39:0/2548675414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73841f5110 con 0x7f7384145820 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f7383e00640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f737c01b750 tx=0x7f737c01b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b4050 con 0x7f7384145820 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c0c0070 con 0x7f7384145820 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c009450 con 0x7f7384145820 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.437+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7384143490 con 0x7f7384145820 2024-04-26T23:26:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738413d5e0 con 0x7f7384145820 2024-04-26T23:26:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7384050740 con 0x7f7384145820 2024-04-26T23:26:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f737c0c5460 con 0x7f7384145820 2024-04-26T23:26:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f737be00640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f737c123fd0 con 0x7f7384145820 2024-04-26T23:26:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f7383400640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.441+0000 7f7383400640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 0x7f736006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7374000f70 tx=0x7f7374007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:28.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.445+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f737c018730 con 0x7f7384145820 2024-04-26T23:26:28.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73841f5940 con 0x7f7384145820 2024-04-26T23:26:28.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f737be00640 1 -- 172.21.15.39:0/2548675414 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f737c0f4050 con 0x7f7384145820 2024-04-26T23:26:28.653 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:28.654 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:28.654 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:28.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 msgr2=0x7f736006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 0x7f736006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7374000f70 tx=0x7f7374007e90 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 msgr2=0x7f73840b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f737c01b750 tx=0x7f737c01b8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 shutdown_connections 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384145820 0x7f73840b1ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73840cf2a0 0x7f73841f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 --2- 172.21.15.39:0/2548675414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f738406fab0 0x7f73841f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 >> 172.21.15.39:0/2548675414 conn(0x7f73840b2af0 msgr2=0x7f73841574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 shutdown_connections 2024-04-26T23:26:28.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:28.649+0000 7f738a800640 1 -- 172.21.15.39:0/2548675414 wait complete. 2024-04-26T23:26:29.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:26:14.110510+0000', 'modified': '2024-04-26T23:26:17.119947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6837/1341599225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6835', 'nonce': 1341599225}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 1341599225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-04-26T23:26:29.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:26:29.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:26:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 Processor -- start 2024-04-26T23:26:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 -- start start 2024-04-26T23:26:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 0x7fee680cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 0x7fee6806d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee680d01e0 con 0x7fee680d10d0 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fee6806dfa0 con 0x7fee680cf8c0 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.217+0000 7fee6d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fee6806e280 con 0x7fee6806d4e0 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee66800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fee680d10d0 0x7fee680b37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60998/0 (socket says 172.21.15.39:60998) 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee66800640 1 -- 172.21.15.39:0/888471091 learned_addr learned my addr 172.21.15.39:0/888471091 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65e00640 1 --2- 172.21.15.39:0/888471091 >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 0x7fee680cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 --2- 172.21.15.39:0/888471091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 0x7fee6806d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee64a00640 1 -- 172.21.15.39:0/888471091 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986170209 0 0) 0x7fee680d01e0 con 0x7fee680d10d0 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee64a00640 1 -- 172.21.15.39:0/888471091 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee4c003530 con 0x7fee680d10d0 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 -- 172.21.15.39:0/888471091 >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 msgr2=0x7fee680cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 --2- 172.21.15.39:0/888471091 >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 0x7fee680cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 -- 172.21.15.39:0/888471091 >> v1:172.21.15.39:6789/0 conn(0x7fee680d10d0 legacy=0x7fee680b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 -- 172.21.15.39:0/888471091 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6806e560 con 0x7fee6806d4e0 2024-04-26T23:26:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65e00640 1 --2- 172.21.15.39:0/888471091 >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 0x7fee680cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:29.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee65400640 1 --2- 172.21.15.39:0/888471091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 0x7fee6806d970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee540097c0 tx=0x7fee5401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b428795e49d136ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee64a00640 1 -- 172.21.15.39:0/888471091 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540a7070 con 0x7fee6806d4e0 2024-04-26T23:26:29.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee64a00640 1 -- 172.21.15.39:0/888471091 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee540b0070 con 0x7fee6806d4e0 2024-04-26T23:26:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.221+0000 7fee64a00640 1 -- 172.21.15.39:0/888471091 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab890 con 0x7fee6806d4e0 2024-04-26T23:26:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- 172.21.15.39:0/888471091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 msgr2=0x7fee6806d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- 172.21.15.39:0/888471091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 0x7fee6806d970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee540097c0 tx=0x7fee5401c470 comp rx=0 tx=0).stop 2024-04-26T23:26:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- 172.21.15.39:0/888471091 shutdown_connections 2024-04-26T23:26:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- 172.21.15.39:0/888471091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6806d4e0 0x7fee6806d970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- 172.21.15.39:0/888471091 >> v2:172.21.15.71:3300/0 conn(0x7fee680cf8c0 0x7fee680cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- 172.21.15.39:0/888471091 >> 172.21.15.39:0/888471091 conn(0x7fee680d3040 msgr2=0x7fee680d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- 172.21.15.39:0/888471091 shutdown_connections 2024-04-26T23:26:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- 172.21.15.39:0/888471091 wait complete. 2024-04-26T23:26:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 Processor -- start 2024-04-26T23:26:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- start start 2024-04-26T23:26:29.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee6806d4e0 0x7fee68159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee680cf8c0 0x7fee681535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fee6815f570 con 0x7fee680d10d0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee680b4730 con 0x7fee6806d4e0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee6d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fee6815f6f0 con 0x7fee680cf8c0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee66800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee66800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47920/0 (socket says 172.21.15.39:47920) 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee66800640 1 -- 172.21.15.39:0/1426721882 learned_addr learned my addr 172.21.15.39:0/1426721882 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee65e00640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee6806d4e0 0x7fee68159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.225+0000 7fee65400640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee680cf8c0 0x7fee681535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 -- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee680cf8c0 msgr2=0x7fee681535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee680cf8c0 0x7fee681535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 -- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee6806d4e0 msgr2=0x7fee68159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee6806d4e0 0x7fee68159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 -- 172.21.15.39:0/1426721882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68159200 con 0x7fee680d10d0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee66800640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ca20 tx=0x7fee6000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 -- 172.21.15.39:0/1426721882 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60017070 con 0x7fee680d10d0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 -- 172.21.15.39:0/1426721882 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6000abd0 con 0x7fee680d10d0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 -- 172.21.15.39:0/1426721882 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60012400 con 0x7fee680d10d0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee680ca1b0 con 0x7fee680d10d0 2024-04-26T23:26:29.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee680ca770 con 0x7fee680d10d0 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 -- 172.21.15.39:0/1426721882 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee6001a070 con 0x7fee680d10d0 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 0x7fee4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.229+0000 7fee5e000640 1 -- 172.21.15.39:0/1426721882 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee600865b0 con 0x7fee680d10d0 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee65e00640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 0x7fee4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 Processor -- start 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- start start 2024-04-26T23:26:29.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee65e00640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 0x7fee4806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fee58009580 tx=0x7fee58009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a4700 0x56503c6a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 0x56503c65b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56503c513140 con 0x56503c65b740 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56503c4a8e00 con 0x56503c6a4700 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x56503c461a00 con 0x56503c6a5020 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47932/0 (socket says 172.21.15.39:47932) 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 -- 172.21.15.39:0/471276243 learned_addr learned my addr 172.21.15.39:0/471276243 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee65e00640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a4700 0x56503c6a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee65400640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 0x56503c65b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 -- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 msgr2=0x56503c65b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 0x56503c65b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 -- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a4700 msgr2=0x56503c6a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a4700 0x56503c6a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 -- 172.21.15.39:0/471276243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56503c4660e0 con 0x56503c65b740 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee65400640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 0x56503c65b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee66800640 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee60056210 tx=0x7fee60056650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9842a5b19e102188 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee52a00640 1 -- 172.21.15.39:0/471276243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60052b80 con 0x56503c65b740 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee52a00640 1 -- 172.21.15.39:0/471276243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6005ebb0 con 0x56503c65b740 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee52a00640 1 -- 172.21.15.39:0/471276243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60052d20 con 0x56503c65b740 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- 172.21.15.39:0/471276243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 msgr2=0x56503c65bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee60056210 tx=0x7fee60056650 comp rx=0 tx=0).stop 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- 172.21.15.39:0/471276243 shutdown_connections 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c65bb20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a5020 0x56503c65b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 --2- 172.21.15.39:0/471276243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a4700 0x56503c6a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- 172.21.15.39:0/471276243 >> 172.21.15.39:0/471276243 conn(0x56503c6576f0 msgr2=0x56503c659ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- 172.21.15.39:0/471276243 shutdown_connections 2024-04-26T23:26:29.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- 172.21.15.39:0/471276243 wait complete. 2024-04-26T23:26:29.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.233+0000 7fee706ca000 1 -- start start 2024-04-26T23:26:29.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 Processor -- start 2024-04-26T23:26:29.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c6665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c666b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56503c4b6200 con 0x56503c65b740 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56503c44ce80 con 0x56503c6a5020 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x56503c4a3ae0 con 0x56503c6a4700 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 10 client.0 _ll_register_callbacks cb 0x56503c4b5da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47946/0 (socket says 172.21.15.39:47946) 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 -- 172.21.15.39:0/1091628035 learned_addr learned my addr 172.21.15.39:0/1091628035 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65400640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c6665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee66800640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c666b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 -- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 msgr2=0x56503c6665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c6665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 -- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 msgr2=0x56503c666b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c666b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 -- 172.21.15.39:0/1091628035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56503c4484e0 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65400640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c6665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65e00640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee580036c0 tx=0x7fee580046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b959c67804859200 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58027070 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6005ebb0 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee58017720 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fee58031050 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 10 client.4608 fetch_fsmap learned FSMap version 8 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56503c42ee80 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6005ebb0 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fee58034020 con 0x56503c65b740 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:26:29.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 10 client.4608 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 20 client.4608 populate_metadata read hostname 'smithi039' 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c667530 0x56503c6b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 4 client.4608 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 --> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56503c441bc0 con 0x56503c667530 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65400640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c667530 0x56503c6b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee65400640 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c667530 0x56503c6b67b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d6f63cf227cd64 server_cookie=462a0680c97af136 in_seq=0 out_seq=0 2024-04-26T23:26:29.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.237+0000 7fee47400640 10 client.4608 ms_handle_connect on v2:172.21.15.71:6835/1341599225 2024-04-26T23:26:29.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee47400640 1 -- 172.21.15.39:0/1091628035 <== mds.0 v2:172.21.15.71:6835/1341599225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56503c441bc0 con 0x56503c667530 2024-04-26T23:26:29.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee47400640 10 client.4608 handle_command_reply: tid=0 2024-04-26T23:26:29.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 client.4608 shutdown 2024-04-26T23:26:29.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 msgr2=0x56503c6660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee580036c0 tx=0x7fee580046d0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 shutdown_connections 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c667530 0x56503c6b67b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c6665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 --2- 172.21.15.39:0/1091628035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c6660a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee47400640 0 client.4608 ms_handle_reset on v2:172.21.15.71:6835/1341599225 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 >> 172.21.15.39:0/1091628035 conn(0x56503c6576f0 msgr2=0x56503c65a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 shutdown_connections 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 1 -- 172.21.15.39:0/1091628035 wait complete. 2024-04-26T23:26:29.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.241+0000 7fee706ca000 20 client.4608 trim_cache size 0 max 16384 2024-04-26T23:26:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.257+0000 7fee706ca000 1 Processor -- start 2024-04-26T23:26:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.257+0000 7fee706ca000 1 -- start start 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c65a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c65a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fee68203cb0 con 0x56503c65b740 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee68157e20 con 0x56503c6a5020 2024-04-26T23:26:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fee68154980 con 0x56503c6a4700 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47958/0 (socket says 172.21.15.39:47958) 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 -- 172.21.15.39:0/3056063143 learned_addr learned my addr 172.21.15.39:0/3056063143 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee66800640 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c65a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65400640 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c65a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 -- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 msgr2=0x56503c65a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c65a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 -- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 msgr2=0x56503c65a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c65a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 -- 172.21.15.39:0/3056063143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56503c461c50 con 0x56503c65b740 2024-04-26T23:26:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee58011690 tx=0x7fee5801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a63949ff601f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee52000640 1 -- 172.21.15.39:0/3056063143 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58027040 con 0x56503c65b740 2024-04-26T23:26:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee52000640 1 -- 172.21.15.39:0/3056063143 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5801b030 con 0x56503c65b740 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee52000640 1 -- 172.21.15.39:0/3056063143 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee580177f0 con 0x56503c65b740 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- 172.21.15.39:0/3056063143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 msgr2=0x56503c659ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee58011690 tx=0x7fee5801d000 comp rx=0 tx=0).stop 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- 172.21.15.39:0/3056063143 shutdown_connections 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c65a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c6a4700 0x56503c65a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- 172.21.15.39:0/3056063143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c65b740 0x56503c659ae0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- 172.21.15.39:0/3056063143 >> 172.21.15.39:0/3056063143 conn(0x56503c6576f0 msgr2=0x56503c666930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- 172.21.15.39:0/3056063143 shutdown_connections 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- 172.21.15.39:0/3056063143 wait complete. 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- start start 2024-04-26T23:26:29.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 Processor -- start 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 0x56503c6b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c6d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56503c4a8110 con 0x56503c6a4700 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56503c43e7b0 con 0x56503c6a5020 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x56503c4ad430 con 0x56503c65b740 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee706ca000 10 client.0 _ll_register_callbacks cb 0x7fee58011ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47964/0 (socket says 172.21.15.39:47964) 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 0x56503c6b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee65400640 1 -- 172.21.15.39:0/1176960495 learned_addr learned my addr 172.21.15.39:0/1176960495 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.261+0000 7fee66800640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c6d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 -- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 msgr2=0x56503c6b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 0x56503c6b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 -- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 msgr2=0x56503c6d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c6d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 -- 172.21.15.39:0/1176960495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56503c52b160 con 0x56503c6a4700 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65e00640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 0x56503c6b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65400640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee540097c0 tx=0x7fee5401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715ae7de48ef9e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab6b0 con 0x56503c6a4700 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee540ab850 con 0x56503c6a4700 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5801b030 con 0x56503c6a4700 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fee540d0050 con 0x56503c6a4700 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 10 client.4614 fetch_fsmap learned FSMap version 8 2024-04-26T23:26:29.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56503c1620c0 con 0x56503c6a4700 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5801b030 con 0x56503c6a4700 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fee540aba50 con 0x56503c6a4700 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 10 client.4614 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 20 client.4614 populate_metadata read hostname 'smithi039' 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c6d0c40 0x56503c71b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 4 client.4614 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 --> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] -- command(tid 0: {"prefix": "status"}) -- 0x56503c4b6a10 con 0x56503c6d0c40 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65e00640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c6d0c40 0x56503c71b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee65e00640 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c6d0c40 0x56503c71b7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1aa27d3ad942530 server_cookie=3a5aabe6c42da4ee in_seq=0 out_seq=0 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 10 client.4614 ms_handle_connect on v2:172.21.15.71:6835/1341599225 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 1 -- 172.21.15.39:0/1176960495 <== mds.0 v2:172.21.15.71:6835/1341599225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56503c4b6a10 con 0x56503c6d0c40 2024-04-26T23:26:29.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 10 client.4614 handle_command_reply: tid=0 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 client.4614 shutdown 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 msgr2=0x56503c6b9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee540097c0 tx=0x7fee5401acb0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 shutdown_connections 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:6835/1341599225,v1:172.21.15.71:6837/1341599225] conn(0x56503c6d0c40 0x56503c71b7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56503c6a5020 0x56503c6d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56503c6a4700 0x56503c6b9470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 --2- 172.21.15.39:0/1176960495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56503c65b740 0x56503c6b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee47400640 0 client.4614 ms_handle_reset on v2:172.21.15.71:6835/1341599225 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 >> 172.21.15.39:0/1176960495 conn(0x56503c6576f0 msgr2=0x56503c6b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 shutdown_connections 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 1 -- 172.21.15.39:0/1176960495 wait complete. 2024-04-26T23:26:29.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee706ca000 20 client.4614 trim_cache size 0 max 16384 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "65ff9fdb-1208-4558-966c-a36e641138f0", 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4300, 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 14.564269309, 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 8, 2024-04-26T23:26:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 20, 2024-04-26T23:26:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 20, 2024-04-26T23:26:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 21.864657638000001 2024-04-26T23:26:29.276 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 msgr2=0x7fee4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 0x7fee4806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fee58009580 tx=0x7fee58009190 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 msgr2=0x7fee68071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ca20 tx=0x7fee6000cee0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 shutdown_connections 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fee480683b0 0x7fee4806a870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee680d10d0 0x7fee68071490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee680cf8c0 0x7fee681535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 --2- 172.21.15.39:0/1426721882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee6806d4e0 0x7fee68159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 >> 172.21.15.39:0/1426721882 conn(0x7fee680d3040 msgr2=0x7fee680cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.265+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 shutdown_connections 2024-04-26T23:26:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.269+0000 7fee6d200640 1 -- 172.21.15.39:0/1426721882 wait complete. 2024-04-26T23:26:29.290 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:26:29.319 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:26:29.319 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:26:29.320 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:26:29.320 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T23:26:29.349 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T23:26:29.349 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T23:26:29.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.350 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:26:29.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.360 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-04-26T23:26:29.430 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-04-26T23:26:29.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:26:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.432 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:26:29.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-04-26T23:26:29.553 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-04-26T23:26:29.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:26:29.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.556 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:26:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-04-26T23:26:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-04-26T23:26:29.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:26:29.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.637 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:26:29.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:29.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-04-26T23:26:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-04-26T23:26:29.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:26:29.760 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-26T23:26:29.760 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:26:29.761 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:26:29.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:26:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 Processor -- start 2024-04-26T23:26:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 -- start start 2024-04-26T23:26:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 0x7f573406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 0x7f57340cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5734160060 con 0x7f5734145820 2024-04-26T23:26:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f57340cd5c0 con 0x7f573406fab0 2024-04-26T23:26:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f573ae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5734160340 con 0x7f57340cf2a0 2024-04-26T23:26:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5733e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5734145820 0x7f57340b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32782/0 (socket says 172.21.15.39:32782) 2024-04-26T23:26:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5733e00640 1 -- 172.21.15.39:0/4234955820 learned_addr learned my addr 172.21.15.39:0/4234955820 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f572be00640 1 --2- 172.21.15.39:0/4234955820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 0x7f573406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5738e00640 1 --2- 172.21.15.39:0/4234955820 >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 0x7f57340cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5733400640 1 -- 172.21.15.39:0/4234955820 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588723528 0 0) 0x7f5734160060 con 0x7f5734145820 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5733400640 1 -- 172.21.15.39:0/4234955820 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5718003530 con 0x7f5734145820 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f572be00640 1 -- 172.21.15.39:0/4234955820 >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 msgr2=0x7f57340cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f572be00640 1 --2- 172.21.15.39:0/4234955820 >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 0x7f57340cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f572be00640 1 -- 172.21.15.39:0/4234955820 >> v1:172.21.15.39:6789/0 conn(0x7f5734145820 legacy=0x7f57340b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f572be00640 1 -- 172.21.15.39:0/4234955820 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734160620 con 0x7f57340cf2a0 2024-04-26T23:26:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.897+0000 7f5738e00640 1 --2- 172.21.15.39:0/4234955820 >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 0x7f57340cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:29.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f572be00640 1 --2- 172.21.15.39:0/4234955820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 0x7f573406f570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f571c0097c0 tx=0x7f571c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c630a5e82f00ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f5733400640 1 -- 172.21.15.39:0/4234955820 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c0b0070 con 0x7f57340cf2a0 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f5733400640 1 -- 172.21.15.39:0/4234955820 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c0ab600 con 0x7f57340cf2a0 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f5733400640 1 -- 172.21.15.39:0/4234955820 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c0ab9b0 con 0x7f57340cf2a0 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 -- 172.21.15.39:0/4234955820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 msgr2=0x7f573406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 --2- 172.21.15.39:0/4234955820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 0x7f573406f570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f571c0097c0 tx=0x7f571c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 -- 172.21.15.39:0/4234955820 shutdown_connections 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 --2- 172.21.15.39:0/4234955820 >> v2:172.21.15.71:3300/0 conn(0x7f573406fab0 0x7f57340cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 --2- 172.21.15.39:0/4234955820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57340cf2a0 0x7f573406f570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 -- 172.21.15.39:0/4234955820 >> 172.21.15.39:0/4234955820 conn(0x7f57340b2af0 msgr2=0x7f57340b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:29.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 -- 172.21.15.39:0/4234955820 shutdown_connections 2024-04-26T23:26:29.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.901+0000 7f573ae00640 1 -- 172.21.15.39:0/4234955820 wait complete. 2024-04-26T23:26:29.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 Processor -- start 2024-04-26T23:26:29.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- start start 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f573406fab0 0x7f5734138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57340cf2a0 0x7f57340b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f573415fdb0 con 0x7f5734145820 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f573415fc30 con 0x7f57340cf2a0 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f573406e460 con 0x7f573406fab0 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47972/0 (socket says 172.21.15.39:47972) 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 -- 172.21.15.39:0/3834476537 learned_addr learned my addr 172.21.15.39:0/3834476537 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:29.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f572be00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57340cf2a0 0x7f57340b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5733e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f573406fab0 0x7f5734138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 -- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f573406fab0 msgr2=0x7f5734138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f573406fab0 0x7f5734138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 -- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57340cf2a0 msgr2=0x7f57340b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57340cf2a0 0x7f57340b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 -- 172.21.15.39:0/3834476537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734155750 con 0x7f5734145820 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5738e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f572c009f00 tx=0x7f572c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c018030 con 0x7f5734145820 2024-04-26T23:26:29.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c00ce50 con 0x7f5734145820 2024-04-26T23:26:29.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c003bc0 con 0x7f5734145820 2024-04-26T23:26:29.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57340b0b00 con 0x7f5734145820 2024-04-26T23:26:29.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.905+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734157520 con 0x7f5734145820 2024-04-26T23:26:29.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734075c00 con 0x7f5734145820 2024-04-26T23:26:29.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f572c01b070 con 0x7f5734145820 2024-04-26T23:26:29.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f5730c00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 0x7f571006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:29.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f572c087310 con 0x7f5734145820 2024-04-26T23:26:29.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f5733e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 0x7f571006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:29.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.909+0000 7f5733e00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 0x7f571006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5724007fd0 tx=0x7f5724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:29.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:29.913+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f572c010040 con 0x7f5734145820 2024-04-26T23:26:30.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.113+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5734154290 con 0x7f5734145820 2024-04-26T23:26:30.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.113+0000 7f5730c00640 1 -- 172.21.15.39:0/3834476537 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f572c0571e0 con 0x7f5734145820 2024-04-26T23:26:30.119 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 msgr2=0x7f571006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 0x7f571006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5724007fd0 tx=0x7f5724009040 comp rx=0 tx=0).stop 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 msgr2=0x7f5734156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f572c009f00 tx=0x7f572c00c490 comp rx=0 tx=0).stop 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 shutdown_connections 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5710068380 0x7f571006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5734145820 0x7f5734156fe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57340cf2a0 0x7f57340b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:30.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 --2- 172.21.15.39:0/3834476537 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f573406fab0 0x7f5734138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:30.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 >> 172.21.15.39:0/3834476537 conn(0x7f57340b2af0 msgr2=0x7f57340d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:30.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 shutdown_connections 2024-04-26T23:26:30.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30.117+0000 7f573ae00640 1 -- 172.21.15.39:0/3834476537 wait complete. 2024-04-26T23:26:30.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:26:30.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:26:30.141 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:26:30.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:30.142 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-04-26T23:26:30.151 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:26:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:23:a8:f7:18 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:26:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:30.154 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:26:30.154 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:30.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:30.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:30.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:30.314 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:26:30.333 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-04-26T23:26:30.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:30.335 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:26:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:26:30.400 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:30.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:30.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:30.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:30.535 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:26:30.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:30.545 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-04-26T23:26:30.603 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:30.603 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:30.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:26:30.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T23:26:30.604 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:30.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:30.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:30.729 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T23:26:30.730 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:30.730 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:30.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T23:26:30.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:26:30.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T23:26:30.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T23:26:30.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T23:26:30.731 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:30.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:30.943 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:30.944 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:30.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-04-26T23:26:30.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:26:30.944 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:31.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:31.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:31.030 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:26:31.079 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:26:31.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:31.080 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:26:31.131 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:26:31.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:31.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:26:31.229 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:26:31.229 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:26:31.229 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:31.979 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:26:31.979 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:26:31.979 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:31.980 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:31.980 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:26:31.993 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:26:31.997 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:26:31.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:31.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:26:32.019 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:32.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:32.157 INFO:teuthology.orchestra.run.smithi039.stdout:client4550 2024-04-26T23:26:32.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:32.158 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:32.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:32.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:32.278 INFO:teuthology.orchestra.run.smithi039.stdout:client4550 2024-04-26T23:26:32.279 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:32.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:32.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:32.345 INFO:teuthology.orchestra.run.smithi039.stdout:client4550 2024-04-26T23:26:32.345 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/65ff9fdb-1208-4558-966c-a36e641138f0.client4550/status') 2024-04-26T23:26:32.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:32.414 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4550 (3)172.21.15.39:0/2671851215 2024-04-26T23:26:32.414 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-04-26T23:26:32.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-04-26T23:26:32.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-04-26T23:26:32.414 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 7.2656e-05 s, 963 kB/s 2024-04-26T23:26:32.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:32.422 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-26T23:26:32.422 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:26:32.422 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:26:32.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:26:32.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.557+0000 7f72d3200640 1 Processor -- start 2024-04-26T23:26:32.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 -- start start 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72d415d110 0x7f72d4068140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72d40d1f20 0x7f72d40b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d40cde00 con 0x7f72d40b65f0 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f72d4068680 con 0x7f72d40d1f20 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d3200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f72d40b6f10 con 0x7f72d415d110 2024-04-26T23:26:32.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72d40d1f20 0x7f72d40b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72d40d1f20 0x7f72d40b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35682/0 (socket says 172.21.15.39:35682) 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 -- 172.21.15.39:0/48809011 learned_addr learned my addr 172.21.15.39:0/48809011 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72d1e00640 1 --2- 172.21.15.39:0/48809011 >> v2:172.21.15.71:3300/0 conn(0x7f72d415d110 0x7f72d4068140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 -- 172.21.15.39:0/48809011 >> v2:172.21.15.71:3300/0 conn(0x7f72d415d110 msgr2=0x7f72d4068140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 --2- 172.21.15.39:0/48809011 >> v2:172.21.15.71:3300/0 conn(0x7f72d415d110 0x7f72d4068140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 -- 172.21.15.39:0/48809011 >> v1:172.21.15.71:6789/0 conn(0x7f72d40b65f0 legacy=0x7f72d4073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.561+0000 7f72c9400640 1 -- 172.21.15.39:0/48809011 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d40ce0e0 con 0x7f72d40d1f20 2024-04-26T23:26:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72c9400640 1 --2- 172.21.15.39:0/48809011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d40d1f20 0x7f72d40b60b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72d4073720 tx=0x7f72bc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5edb7bd7bc08134 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d1400640 1 -- 172.21.15.39:0/48809011 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0b5070 con 0x7f72d40d1f20 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d1400640 1 -- 172.21.15.39:0/48809011 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a89d0 con 0x7f72d40d1f20 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d1400640 1 -- 172.21.15.39:0/48809011 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a8da0 con 0x7f72d40d1f20 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- 172.21.15.39:0/48809011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d40d1f20 msgr2=0x7f72d40b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 --2- 172.21.15.39:0/48809011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d40d1f20 0x7f72d40b60b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72d4073720 tx=0x7f72bc01ecd0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- 172.21.15.39:0/48809011 shutdown_connections 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 --2- 172.21.15.39:0/48809011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d40d1f20 0x7f72d40b60b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 --2- 172.21.15.39:0/48809011 >> v2:172.21.15.71:3300/0 conn(0x7f72d415d110 0x7f72d4068140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- 172.21.15.39:0/48809011 >> 172.21.15.39:0/48809011 conn(0x7f72d40d1400 msgr2=0x7f72d40d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- 172.21.15.39:0/48809011 shutdown_connections 2024-04-26T23:26:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- 172.21.15.39:0/48809011 wait complete. 2024-04-26T23:26:32.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 Processor -- start 2024-04-26T23:26:32.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.565+0000 7f72d3200640 1 -- start start 2024-04-26T23:26:32.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72d40b65f0 0x7f72d4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72d40d1f20 0x7f72d409b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f72d40ce6a0 con 0x7f72d415d110 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f72d40b6a30 con 0x7f72d40b65f0 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f72d40b2080 con 0x7f72d40d1f20 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72d40b65f0 0x7f72d4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35686/0 (socket says 172.21.15.39:35686) 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 -- 172.21.15.39:0/4233689453 learned_addr learned my addr 172.21.15.39:0/4233689453 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72c9400640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72d40d1f20 0x7f72d409b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 -- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72d40d1f20 msgr2=0x7f72d409b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72d40d1f20 0x7f72d409b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 -- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72d40b65f0 msgr2=0x7f72d4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72d40b65f0 0x7f72d4159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 -- 172.21.15.39:0/4233689453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d41f48b0 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d2800640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b970 tx=0x7f72cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc019070 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc00cb40 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d415c100 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc014440 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d415a5c0 con 0x7f72d415d110 2024-04-26T23:26:32.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d40506d0 con 0x7f72d415d110 2024-04-26T23:26:32.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.569+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72cc01c070 con 0x7f72d415d110 2024-04-26T23:26:32.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.573+0000 7f72caa00640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 0x7f72b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:32.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.573+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72cc086600 con 0x7f72d415d110 2024-04-26T23:26:32.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.573+0000 7f72d1e00640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 0x7f72b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:32.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.573+0000 7f72d1e00640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 0x7f72b006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72c4007a60 tx=0x7f72c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:32.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.577+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f72cc0564d0 con 0x7f72d415d110 2024-04-26T23:26:32.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.777+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f72d4068a80 con 0x7f72d415d110 2024-04-26T23:26:32.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.777+0000 7f72caa00640 1 -- 172.21.15.39:0/4233689453 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f72cc05a7d0 con 0x7f72d415d110 2024-04-26T23:26:32.784 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 msgr2=0x7f72b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 0x7f72b006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72c4007a60 tx=0x7f72c4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 msgr2=0x7f72d415b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b970 tx=0x7f72cc00be30 comp rx=0 tx=0).stop 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 shutdown_connections 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72b0068380 0x7f72b006a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72d415d110 0x7f72d415b380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72d40d1f20 0x7f72d409b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 --2- 172.21.15.39:0/4233689453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72d40b65f0 0x7f72d4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 >> 172.21.15.39:0/4233689453 conn(0x7f72d40d1400 msgr2=0x7f72d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 shutdown_connections 2024-04-26T23:26:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:32.781+0000 7f72d3200640 1 -- 172.21.15.39:0/4233689453 wait complete. 2024-04-26T23:26:32.805 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:26:32.805 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:26:32.805 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-04-26T23:26:32.805 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T23:26:32.806 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:26:32.806 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:26:32.806 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:26:32.806 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:26:32.806 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:26:32.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:32.806 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-04-26T23:26:32.816 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:32.816 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:32.816 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:32.816 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.816 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42436sec preferred_lft 42436sec 2024-04-26T23:26:32.817 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:23:a8:f7:18 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:26:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:32.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:32.819 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:26:32.882 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-04-26T23:26:32.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:32.884 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-04-26T23:26:32.937 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-04-26T23:26:32.937 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:26:32.937 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:26:32.937 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:26:32.937 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:26:32.938 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:26:32.938 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:33.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:33.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.080 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:26:33.136 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:26:33.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.137 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-04-26T23:26:33.187 INFO:teuthology.orchestra.run.smithi039.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T23:26:33.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:33.189 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:33.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:26:33.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T23:26:33.189 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:33.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:33.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether b2:da:e9:f1:de:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:26:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:26:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::b0da:e9ff:fef1:de4d/64 scope link 2024-04-26T23:26:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.382 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:26:33.448 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:33.448 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:33.448 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:33.448 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether b2:da:e9:f1:de:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::b0da:e9ff:fef1:de4d/64 scope link 2024-04-26T23:26:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:33.450 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T23:26:33.451 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T23:26:33.452 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:33.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:33.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:33.634 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:33.634 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:26:33.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.1 up 2024-04-26T23:26:33.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:26:33.634 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:26:33.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:33.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:33.766 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T23:26:33.775 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:26:33.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:33.775 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:26:33.827 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:26:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.827 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-26T23:26:33.916 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-26T23:26:33.916 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-26T23:26:33.916 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:33.931 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-26T23:26:33.931 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-26T23:26:33.932 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:33.932 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:33.932 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:33.941 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:26:33.942 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:26:33.946 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:26:33.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:33.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:26:33.966 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:34.065 INFO:teuthology.orchestra.run.smithi039.stdout:client4556 2024-04-26T23:26:34.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:34.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:34.078 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:34.177 INFO:teuthology.orchestra.run.smithi039.stdout:client4556 2024-04-26T23:26:34.178 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:34.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:34.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:34.236 INFO:teuthology.orchestra.run.smithi039.stdout:client4556 2024-04-26T23:26:34.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/65ff9fdb-1208-4558-966c-a36e641138f0.client4556/status') 2024-04-26T23:26:34.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:34.295 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4556 (3)172.21.15.39:0/2817789284 2024-04-26T23:26:34.296 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-04-26T23:26:34.296 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-04-26T23:26:34.296 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-04-26T23:26:34.296 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 6.1902e-05 s, 1.1 MB/s 2024-04-26T23:26:34.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:34.306 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-26T23:26:34.307 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:26:34.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:26:34.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:26:34.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.485+0000 7fb34ae00640 1 Processor -- start 2024-04-26T23:26:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.485+0000 7fb34ae00640 1 -- start start 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb34ae00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 0x7fb3440cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb34ae00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb34406fc80 0x7fb3440b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb34ae00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb344160060 con 0x7fb3440b4950 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb34ae00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440cd5c0 con 0x7fb34406fc80 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb34ae00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb344160340 con 0x7fb344145820 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb348e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb34406fc80 0x7fb3440b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb33be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb3440b4950 0x7fb34406f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60736/0 (socket says 172.21.15.39:60736) 2024-04-26T23:26:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb33be00640 1 -- 172.21.15.39:0/201665669 learned_addr learned my addr 172.21.15.39:0/201665669 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb343e00640 1 --2- 172.21.15.39:0/201665669 >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 0x7fb3440cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb348e00640 1 -- 172.21.15.39:0/201665669 >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 msgr2=0x7fb3440cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb348e00640 1 --2- 172.21.15.39:0/201665669 >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 0x7fb3440cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb348e00640 1 -- 172.21.15.39:0/201665669 >> v1:172.21.15.39:6789/0 conn(0x7fb3440b4950 legacy=0x7fb34406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb348e00640 1 -- 172.21.15.39:0/201665669 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344160620 con 0x7fb34406fc80 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb343e00640 1 --2- 172.21.15.39:0/201665669 >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 0x7fb3440cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.489+0000 7fb343400640 1 -- 172.21.15.39:0/201665669 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250955487 0 0) 0x7fb344160060 con 0x7fb3440b4950 2024-04-26T23:26:34.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb348e00640 1 --2- 172.21.15.39:0/201665669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb34406fc80 0x7fb3440b4d70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009d90 tx=0x7fb33c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0c3bfb923bbbbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb343400640 1 -- 172.21.15.39:0/201665669 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0b2070 con 0x7fb34406fc80 2024-04-26T23:26:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb343400640 1 -- 172.21.15.39:0/201665669 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0a59e0 con 0x7fb34406fc80 2024-04-26T23:26:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb343400640 1 -- 172.21.15.39:0/201665669 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0a5db0 con 0x7fb34406fc80 2024-04-26T23:26:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- 172.21.15.39:0/201665669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb34406fc80 msgr2=0x7fb3440b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 --2- 172.21.15.39:0/201665669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb34406fc80 0x7fb3440b4d70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009d90 tx=0x7fb33c01c900 comp rx=0 tx=0).stop 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- 172.21.15.39:0/201665669 shutdown_connections 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 --2- 172.21.15.39:0/201665669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb34406fc80 0x7fb3440b4d70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 --2- 172.21.15.39:0/201665669 >> v2:172.21.15.71:3300/0 conn(0x7fb344145820 0x7fb3440cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- 172.21.15.39:0/201665669 >> 172.21.15.39:0/201665669 conn(0x7fb3440b2af0 msgr2=0x7fb3440b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- 172.21.15.39:0/201665669 shutdown_connections 2024-04-26T23:26:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- 172.21.15.39:0/201665669 wait complete. 2024-04-26T23:26:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 Processor -- start 2024-04-26T23:26:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.493+0000 7fb34ae00640 1 -- start start 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb34406fc80 0x7fb344142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb344145820 0x7fb34413c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb3440ce260 con 0x7fb3440b4950 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb34415fe40 con 0x7fb344145820 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb3440ce3e0 con 0x7fb34406fc80 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35706/0 (socket says 172.21.15.39:35706) 2024-04-26T23:26:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 -- 172.21.15.39:0/524777802 learned_addr learned my addr 172.21.15.39:0/524777802 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 -- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb34406fc80 msgr2=0x7fb344142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb34406fc80 0x7fb344142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 -- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb344145820 msgr2=0x7fb34413c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb344145820 0x7fb34413c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 -- 172.21.15.39:0/524777802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344143360 con 0x7fb3440b4950 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb33be00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c520 tx=0x7fb32c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c018070 con 0x7fb3440b4950 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0074e0 con 0x7fb3440b4950 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0049f0 con 0x7fb3440b4950 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb344073b30 con 0x7fb3440b4950 2024-04-26T23:26:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3440740f0 con 0x7fb3440b4950 2024-04-26T23:26:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb344050740 con 0x7fb3440b4950 2024-04-26T23:26:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.497+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb32c004b90 con 0x7fb3440b4950 2024-04-26T23:26:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.501+0000 7fb340c00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 0x7fb32006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.501+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb32c085e70 con 0x7fb3440b4950 2024-04-26T23:26:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.501+0000 7fb343e00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 0x7fb32006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:34.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.501+0000 7fb343e00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 0x7fb32006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb33400a890 tx=0x7fb334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.505+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb32c056300 con 0x7fb3440b4950 2024-04-26T23:26:34.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.705+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb344155dc0 con 0x7fb3440b4950 2024-04-26T23:26:34.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.705+0000 7fb340c00640 1 -- 172.21.15.39:0/524777802 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb32c055c00 con 0x7fb3440b4950 2024-04-26T23:26:34.712 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 msgr2=0x7fb32006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 0x7fb32006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb33400a890 tx=0x7fb334008040 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 msgr2=0x7fb3440b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c520 tx=0x7fb32c00c9e0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 shutdown_connections 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb320068380 0x7fb32006a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb344145820 0x7fb34413c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3440b4950 0x7fb3440b15b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 --2- 172.21.15.39:0/524777802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb34406fc80 0x7fb344142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 >> 172.21.15.39:0/524777802 conn(0x7fb3440b2af0 msgr2=0x7fb34406e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 shutdown_connections 2024-04-26T23:26:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:34.709+0000 7fb34ae00640 1 -- 172.21.15.39:0/524777802 wait complete. 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:26:34.733 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:26:34.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:34.734 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-26T23:26:34.743 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 02:42:96:98:d1:ab brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:26:34.745 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:34.746 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:26:34.746 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:34.746 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:34.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:26:34.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-04-26T23:26:34.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-04-26T23:26:34.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:26:34.747 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:34.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:34.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:34.909 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:26:34.927 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:26:34.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:34.929 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-26T23:26:35.002 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:35.004 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:26:35.004 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:35.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:35.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:35.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:35.141 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:26:35.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:35.151 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-04-26T23:26:35.200 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:35.200 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:35.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:26:35.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T23:26:35.200 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:35.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:35.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:35.326 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T23:26:35.326 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:35.326 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:35.326 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T23:26:35.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:26:35.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T23:26:35.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T23:26:35.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T23:26:35.327 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:35.484 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:35.484 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:35.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-26T23:26:35.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:26:35.485 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:35.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:35.568 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:26:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:26:35.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:35.619 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:26:35.674 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:26:35.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:35.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:26:35.762 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:26:35.762 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:26:35.762 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:26:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:26:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:26:36.379 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:26:36.383 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:26:36.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:36.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:26:36.403 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:36.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:36.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:36.508 INFO:teuthology.orchestra.run.smithi071.stdout:client4678 2024-04-26T23:26:36.508 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:36.508 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:36.517 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:36.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:36.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:36.617 INFO:teuthology.orchestra.run.smithi071.stdout:client4678 2024-04-26T23:26:36.618 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:36.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:36.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:36.673 INFO:teuthology.orchestra.run.smithi071.stdout:client4678 2024-04-26T23:26:36.674 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/65ff9fdb-1208-4558-966c-a36e641138f0.client4678/status') 2024-04-26T23:26:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:36.733 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4678 (3)192.168.0.1:0/3766892765 2024-04-26T23:26:36.733 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2024-04-26T23:26:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2024-04-26T23:26:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2024-04-26T23:26:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:69 bytes copied, 4.9628e-05 s, 1.4 MB/s 2024-04-26T23:26:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:36.741 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-26T23:26:36.741 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:26:36.741 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:26:36.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:26:36.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 Processor -- start 2024-04-26T23:26:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 -- start start 2024-04-26T23:26:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7ec06dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7ec0d2460 0x7fc7ec06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ec0d13c0 con 0x7fc7ec15f020 2024-04-26T23:26:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc7ec0d1190 con 0x7fc7ec0d2460 2024-04-26T23:26:36.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f2600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec0d16a0 con 0x7fc7ec163440 2024-04-26T23:26:36.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f1200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc7ec15f020 0x7fc7ec162d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60744/0 (socket says 172.21.15.39:60744) 2024-04-26T23:26:36.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f1200640 1 -- 172.21.15.39:0/960971027 learned_addr learned my addr 172.21.15.39:0/960971027 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918416724 0 0) 0x7fc7ec0d13c0 con 0x7fc7ec15f020 2024-04-26T23:26:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7ec06dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7d0003530 con 0x7fc7ec15f020 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7f1c00640 1 --2- 172.21.15.39:0/960971027 >> v2:172.21.15.71:3300/0 conn(0x7fc7ec0d2460 0x7fc7ec06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 490400819 0 0) 0x7fc7d0003530 con 0x7fc7ec15f020 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 msgr2=0x7fc7ec06dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7ec06dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 >> v2:172.21.15.71:3300/0 conn(0x7fc7ec0d2460 msgr2=0x7fc7ec06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 --2- 172.21.15.39:0/960971027 >> v2:172.21.15.71:3300/0 conn(0x7fc7ec0d2460 0x7fc7ec06e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0d1980 con 0x7fc7ec15f020 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fc7dc001680 con 0x7fc7ec15f020 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 >> v1:172.21.15.39:6789/0 conn(0x7fc7ec15f020 legacy=0x7fc7ec162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d00039c0 0x7fc7d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.889+0000 7fc7ebe00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d0004d50 0x7fc7d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec0d16a0 con 0x7fc7d0004d50 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d000b9d0 con 0x7fc7d00039c0 2024-04-26T23:26:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d000bb50 con 0x7fc7ec163440 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7f1200640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d00039c0 0x7fc7d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7f1c00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d0004d50 0x7fc7d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 -- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d00039c0 msgr2=0x7fc7d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d00039c0 0x7fc7d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 -- 172.21.15.39:0/960971027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d0004d50 msgr2=0x7fc7d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d0004d50 0x7fc7d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 -- 172.21.15.39:0/960971027 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d0003530 con 0x7fc7ec163440 2024-04-26T23:26:36.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7d0004810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009ae0 tx=0x7fc7d401cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7c6ca3f38f76c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:36.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40b2070 con 0x7fc7ec163440 2024-04-26T23:26:36.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d40a56a0 con 0x7fc7ec163440 2024-04-26T23:26:36.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.893+0000 7fc7ebe00640 1 -- 172.21.15.39:0/960971027 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40096b0 con 0x7fc7ec163440 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 msgr2=0x7fc7d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 --2- 172.21.15.39:0/960971027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec163440 0x7fc7d0004810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009ae0 tx=0x7fc7d401cab0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1c00640 1 -- 172.21.15.39:0/960971027 reap_dead start 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- 172.21.15.39:0/960971027 shutdown_connections 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- 172.21.15.39:0/960971027 >> 172.21.15.39:0/960971027 conn(0x7fc7ec0d2d90 msgr2=0x7fc7ec0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:36.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- 172.21.15.39:0/960971027 shutdown_connections 2024-04-26T23:26:36.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- 172.21.15.39:0/960971027 wait complete. 2024-04-26T23:26:36.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 Processor -- start 2024-04-26T23:26:36.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- start start 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 0x7fc7ec0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7ec15c3c0 0x7fc7ec15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec160410 con 0x7fc7ec163440 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec0d1f40 con 0x7fc7ec15c3c0 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f2600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec160590 con 0x7fc7ec149440 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7e3e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 0x7fc7ec0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35734/0 (socket says 172.21.15.39:35734) 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7ec15c3c0 0x7fc7ec15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 -- 172.21.15.39:0/1499803374 learned_addr learned my addr 172.21.15.39:0/1499803374 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 -- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 msgr2=0x7fc7ec0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 0x7fc7ec0ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 -- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7ec15c3c0 msgr2=0x7fc7ec15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7ec15c3c0 0x7fc7ec15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7f1200640 1 -- 172.21.15.39:0/1499803374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0cf280 con 0x7fc7ec163440 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.897+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 0x7fc7ec0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7f1200640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc007370 tx=0x7fc7dc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00f9c0 con 0x7fc7ec163440 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc018070 con 0x7fc7ec163440 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00fdc0 con 0x7fc7ec163440 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec0cf560 con 0x7fc7ec163440 2024-04-26T23:26:36.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec0cfb20 con 0x7fc7ec163440 2024-04-26T23:26:36.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec0506d0 con 0x7fc7ec163440 2024-04-26T23:26:36.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7dc01d460 con 0x7fc7ec163440 2024-04-26T23:26:36.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 0x7fc7c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc7dc0869a0 con 0x7fc7ec163440 2024-04-26T23:26:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.901+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 0x7fc7c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.905+0000 7fc7e3e00640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 0x7fc7c806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40af000 tx=0x7fc7d40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:36.905+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc7dc056900 con 0x7fc7ec163440 2024-04-26T23:26:37.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.109+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7ec068f30 con 0x7fc7ec163440 2024-04-26T23:26:37.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.109+0000 7fc7e9600640 1 -- 172.21.15.39:0/1499803374 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc7dc05ac00 con 0x7fc7ec163440 2024-04-26T23:26:37.114 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:26:37.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 msgr2=0x7fc7c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:37.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 0x7fc7c806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40af000 tx=0x7fc7d40046d0 comp rx=0 tx=0).stop 2024-04-26T23:26:37.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 msgr2=0x7fc7ec1f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:37.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc007370 tx=0x7fc7dc007830 comp rx=0 tx=0).stop 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 shutdown_connections 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc7c8068380 0x7fc7c806a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7ec15c3c0 0x7fc7ec15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7ec149440 0x7fc7ec0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 --2- 172.21.15.39:0/1499803374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7ec163440 0x7fc7ec1f7d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 >> 172.21.15.39:0/1499803374 conn(0x7fc7ec0d2d90 msgr2=0x7fc7ec0b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 shutdown_connections 2024-04-26T23:26:37.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:37.113+0000 7fc7f2600640 1 -- 172.21.15.39:0/1499803374 wait complete. 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:26:37.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:26:37.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.139 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-26T23:26:37.148 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 02:42:96:98:d1:ab brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:26:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:26:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.151 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:26:37.216 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:26:37.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.218 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-26T23:26:37.270 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-26T23:26:37.270 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:26:37.270 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:26:37.270 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:26:37.271 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:26:37.271 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:37.271 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:37.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:26:37.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:26:37.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:26:37.272 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:37.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:37.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.408 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:26:37.417 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:26:37.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.417 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-04-26T23:26:37.467 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T23:26:37.467 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:37.468 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:37.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:26:37.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T23:26:37.468 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:37.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:37.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:26:37.617 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ba:7f:85:45:2d:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b87f:85ff:fe45:2dc1/64 scope link 2024-04-26T23:26:37.618 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:37.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ba:7f:85:45:2d:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.687 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b87f:85ff:fe45:2dc1/64 scope link 2024-04-26T23:26:37.688 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:26:37.689 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:37.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:37.873 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:26:37.873 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:26:37.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2024-04-26T23:26:37.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:26:37.874 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:26:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:37.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:37.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:37.956 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T23:26:37.965 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:26:37.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:26:37.966 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:26:38.014 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:26:38.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:38.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-26T23:26:38.106 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-26T23:26:38.106 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-26T23:26:38.106 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:38.121 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-26T23:26:38.121 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-26T23:26:38.121 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:38.121 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:38.121 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:38.130 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-26T23:26:38.130 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:26:38.131 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:26:38.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:26:38.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:38.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:26:38.155 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:38.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:38.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:38.254 INFO:teuthology.orchestra.run.smithi071.stdout:client4565 2024-04-26T23:26:38.255 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:38.255 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:38.264 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:38.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:38.365 INFO:teuthology.orchestra.run.smithi071.stdout:client4565 2024-04-26T23:26:38.366 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:26:38.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:26:38.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:26:38.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:26:38.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:38.466 INFO:teuthology.orchestra.run.smithi071.stdout:client4565 2024-04-26T23:26:38.466 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/65ff9fdb-1208-4558-966c-a36e641138f0.client4565/status') 2024-04-26T23:26:38.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:26:38.595 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4565 (3)192.168.0.2:0/3944433092 2024-04-26T23:26:38.595 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2024-04-26T23:26:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2024-04-26T23:26:38.596 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2024-04-26T23:26:38.596 INFO:teuthology.orchestra.run.smithi071.stderr:69 bytes copied, 8.6066e-05 s, 802 kB/s 2024-04-26T23:26:38.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:26:38.604 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T23:26:38.620 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:38.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.769+0000 7f22e2600640 1 Processor -- start 2024-04-26T23:26:38.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.769+0000 7f22e2600640 1 -- start start 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22e2600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22dc0cf2a0 0x7f22dc06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22e2600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22dc160060 con 0x7f22dc06fab0 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22e2600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22dc160340 con 0x7f22dc145820 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22e2600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f22dc06ff20 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22d3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22dc0cf2a0 0x7f22dc06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22dbe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f22dc06fab0 0x7f22dc0cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60758/0 (socket says 172.21.15.39:60758) 2024-04-26T23:26:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22dbe00640 1 -- 172.21.15.39:0/2246915165 learned_addr learned my addr 172.21.15.39:0/2246915165 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22d3e00640 1 -- 172.21.15.39:0/2246915165 >> v1:172.21.15.71:6789/0 conn(0x7f22dc145820 legacy=0x7f22dc0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22d3e00640 1 -- 172.21.15.39:0/2246915165 >> v1:172.21.15.39:6789/0 conn(0x7f22dc06fab0 legacy=0x7f22dc0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22d3e00640 1 -- 172.21.15.39:0/2246915165 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc160620 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.773+0000 7f22daa00640 1 -- 172.21.15.39:0/2246915165 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132401701 0 0) 0x7f22dc160340 con 0x7f22dc145820 2024-04-26T23:26:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22d3e00640 1 --2- 172.21.15.39:0/2246915165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc0cf2a0 0x7f22dc06f570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097c0 tx=0x7f22c401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daa8605f5e146e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22daa00640 1 -- 172.21.15.39:0/2246915165 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b0070 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22daa00640 1 -- 172.21.15.39:0/2246915165 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c40ab600 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22daa00640 1 -- 172.21.15.39:0/2246915165 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40ab9d0 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- 172.21.15.39:0/2246915165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc0cf2a0 msgr2=0x7f22dc06f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 --2- 172.21.15.39:0/2246915165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc0cf2a0 0x7f22dc06f570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097c0 tx=0x7f22c401c330 comp rx=0 tx=0).stop 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- 172.21.15.39:0/2246915165 shutdown_connections 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 --2- 172.21.15.39:0/2246915165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc0cf2a0 0x7f22dc06f570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- 172.21.15.39:0/2246915165 >> 172.21.15.39:0/2246915165 conn(0x7f22dc0b2af0 msgr2=0x7f22dc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- 172.21.15.39:0/2246915165 shutdown_connections 2024-04-26T23:26:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- 172.21.15.39:0/2246915165 wait complete. 2024-04-26T23:26:38.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 Processor -- start 2024-04-26T23:26:38.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.777+0000 7f22e2600640 1 -- start start 2024-04-26T23:26:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f22dc0cf2a0 0x7f22dc1f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc145820 0x7f22dc1443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0b5060 con 0x7f22dc06fab0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0cd5c0 con 0x7f22dc145820 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc0b51e0 con 0x7f22dc0cf2a0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35752/0 (socket says 172.21.15.39:35752) 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 -- 172.21.15.39:0/1896384192 learned_addr learned my addr 172.21.15.39:0/1896384192 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22dbe00640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc145820 0x7f22dc1443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22d3e00640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f22dc0cf2a0 0x7f22dc1f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 -- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f22dc0cf2a0 msgr2=0x7f22dc1f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f22dc0cf2a0 0x7f22dc1f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 -- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc145820 msgr2=0x7f22dc1443b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc145820 0x7f22dc1443b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 -- 172.21.15.39:0/1896384192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc144090 con 0x7f22dc06fab0 2024-04-26T23:26:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22db400640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001ec0 tx=0x7f22cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:38.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc017070 con 0x7f22dc06fab0 2024-04-26T23:26:38.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc003600 con 0x7f22dc06fab0 2024-04-26T23:26:38.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1f6480 con 0x7f22dc06fab0 2024-04-26T23:26:38.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0039f0 con 0x7f22dc06fab0 2024-04-26T23:26:38.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc143070 con 0x7f22dc06fab0 2024-04-26T23:26:38.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc050740 con 0x7f22dc06fab0 2024-04-26T23:26:38.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.781+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22cc01a070 con 0x7f22dc06fab0 2024-04-26T23:26:38.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.785+0000 7f22d3400640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 0x7f22b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:38.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.785+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f22cc085d70 con 0x7f22dc06fab0 2024-04-26T23:26:38.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.785+0000 7f22d3e00640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 0x7f22b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:38.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.785+0000 7f22d3e00640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 0x7f22b806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22c40ad000 tx=0x7f22c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:38.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.789+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f22cc055c40 con 0x7f22dc06fab0 2024-04-26T23:26:38.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.953+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22dc13bcb0 con 0x7f22dc06fab0 2024-04-26T23:26:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22d3400640 1 -- 172.21.15.39:0/1896384192 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f22cc059f40 con 0x7f22dc06fab0 2024-04-26T23:26:38.960 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:38.960 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 msgr2=0x7f22b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 0x7f22b806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22c40ad000 tx=0x7f22c40a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 msgr2=0x7f22dc143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001ec0 tx=0x7f22cc00c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 shutdown_connections 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f22b8068380 0x7f22b806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc145820 0x7f22dc1443b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f22dc0cf2a0 0x7f22dc1f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 --2- 172.21.15.39:0/1896384192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22dc06fab0 0x7f22dc143b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 >> 172.21.15.39:0/1896384192 conn(0x7f22dc0b2af0 msgr2=0x7f22dc06f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 shutdown_connections 2024-04-26T23:26:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:38.957+0000 7f22e2600640 1 -- 172.21.15.39:0/1896384192 wait complete. 2024-04-26T23:26:38.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:38.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:39.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 Processor -- start 2024-04-26T23:26:39.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 -- start start 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 0x7f49f415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f49f40d1110 0x7f49f40ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f40d06b0 con 0x7f49f40b2050 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f49f40d2490 con 0x7f49f40d1110 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f49f40d15c0 con 0x7f49f40cfd30 2024-04-26T23:26:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f49f40d1110 0x7f49f40ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f49f40d1110 0x7f49f40ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35756/0 (socket says 172.21.15.39:35756) 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 -- 172.21.15.39:0/58802462 learned_addr learned my addr 172.21.15.39:0/58802462 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49e9e00640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 0x7f49f415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 -- 172.21.15.39:0/58802462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 msgr2=0x7f49f415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 0x7f49f415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 -- 172.21.15.39:0/58802462 >> v1:172.21.15.71:6789/0 conn(0x7f49f40b2050 legacy=0x7f49f40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49f3200640 1 -- 172.21.15.39:0/58802462 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f40b2430 con 0x7f49f40d1110 2024-04-26T23:26:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.121+0000 7f49e9e00640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 0x7f49f415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f3200640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40d1110 0x7f49f40ce4e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009870 tx=0x7f49ec01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec2af8fc41f39e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f1e00640 1 -- 172.21.15.39:0/58802462 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0b0070 con 0x7f49f40d1110 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f1e00640 1 -- 172.21.15.39:0/58802462 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ec004230 con 0x7f49f40d1110 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f1e00640 1 -- 172.21.15.39:0/58802462 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec003620 con 0x7f49f40d1110 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 -- 172.21.15.39:0/58802462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40d1110 msgr2=0x7f49f40ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40d1110 0x7f49f40ce4e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009870 tx=0x7f49ec01c350 comp rx=0 tx=0).stop 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 -- 172.21.15.39:0/58802462 shutdown_connections 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40d1110 0x7f49f40ce4e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 --2- 172.21.15.39:0/58802462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40cfd30 0x7f49f415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 -- 172.21.15.39:0/58802462 >> 172.21.15.39:0/58802462 conn(0x7f49f40d2da0 msgr2=0x7f49f40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 -- 172.21.15.39:0/58802462 shutdown_connections 2024-04-26T23:26:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.125+0000 7f49f8a00640 1 -- 172.21.15.39:0/58802462 wait complete. 2024-04-26T23:26:39.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 Processor -- start 2024-04-26T23:26:39.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- start start 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 0x7f49f40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 0x7f49f40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f49f406d700 con 0x7f49f40b2050 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f49f40d2120 con 0x7f49f40cfd30 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f49f406d880 con 0x7f49f40d1110 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35768/0 (socket says 172.21.15.39:35768) 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 -- 172.21.15.39:0/3369268434 learned_addr learned my addr 172.21.15.39:0/3369268434 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49e9e00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 0x7f49f40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f3200640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 0x7f49f40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 -- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 msgr2=0x7f49f40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 0x7f49f40ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 -- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 msgr2=0x7f49f40cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 0x7f49f40cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 -- 172.21.15.39:0/3369268434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f40b2ac0 con 0x7f49f40b2050 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49e9e00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 0x7f49f40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f3200640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 0x7f49f40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:39.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f2800640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c730 tx=0x7f49e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4016020 con 0x7f49f40b2050 2024-04-26T23:26:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4006d60 con 0x7f49f40b2050 2024-04-26T23:26:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f40b2da0 con 0x7f49f40b2050 2024-04-26T23:26:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4003bc0 con 0x7f49f40b2050 2024-04-26T23:26:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.129+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f40b3360 con 0x7f49f40b2050 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f40506d0 con 0x7f49f40b2050 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49e400a850 con 0x7f49f40b2050 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49eb400640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 0x7f49d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49e4086630 con 0x7f49f40b2050 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49e9e00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 0x7f49d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.133+0000 7f49e9e00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 0x7f49d006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49f41fb770 tx=0x7f49dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.137+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49e4020020 con 0x7f49f40b2050 2024-04-26T23:26:39.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.301+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49f40cf8d0 con 0x7f49f40b2050 2024-04-26T23:26:39.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.301+0000 7f49eb400640 1 -- 172.21.15.39:0/3369268434 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f49e40079f0 con 0x7f49f40b2050 2024-04-26T23:26:39.307 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 msgr2=0x7f49d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 0x7f49d006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49f41fb770 tx=0x7f49dc008040 comp rx=0 tx=0).stop 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 msgr2=0x7f49f40b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c730 tx=0x7f49e400cbf0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 shutdown_connections 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f49d00683b0 0x7f49d006a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f49f40d1110 0x7f49f40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f40cfd30 0x7f49f40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 --2- 172.21.15.39:0/3369268434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49f40b2050 0x7f49f40b7050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 >> 172.21.15.39:0/3369268434 conn(0x7f49f40d2da0 msgr2=0x7f49f40cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:39.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 shutdown_connections 2024-04-26T23:26:39.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.305+0000 7f49f8a00640 1 -- 172.21.15.39:0/3369268434 wait complete. 2024-04-26T23:26:39.329 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:39.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.469+0000 7fc5ed400640 1 Processor -- start 2024-04-26T23:26:39.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.469+0000 7fc5ed400640 1 -- start start 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5ed400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5e813ffc0 0x7fc5e806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5ed400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5ed400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5e815e520 con 0x7fc5e81612b0 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5ed400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e8161ae0 con 0x7fc5e813ffc0 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5ed400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e815d760 con 0x7fc5e806c910 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5e6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5e813ffc0 0x7fc5e806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:32982/0 (socket says 172.21.15.39:32982) 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 -- 172.21.15.39:0/1186301269 learned_addr learned my addr 172.21.15.39:0/1186301269 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 -- 172.21.15.39:0/1186301269 >> v2:172.21.15.71:3300/0 conn(0x7fc5e813ffc0 msgr2=0x7fc5e806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 --2- 172.21.15.39:0/1186301269 >> v2:172.21.15.71:3300/0 conn(0x7fc5e813ffc0 0x7fc5e806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 -- 172.21.15.39:0/1186301269 >> v1:172.21.15.71:6789/0 conn(0x7fc5e81612b0 legacy=0x7fc5e80731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.473+0000 7fc5dde00640 1 -- 172.21.15.39:0/1186301269 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e815da40 con 0x7fc5e806c910 2024-04-26T23:26:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5dde00640 1 --2- 172.21.15.39:0/1186301269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee368e58469ff3eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5e5e00640 1 -- 172.21.15.39:0/1186301269 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00b2070 con 0x7fc5e806c910 2024-04-26T23:26:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5e5e00640 1 -- 172.21.15.39:0/1186301269 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d00a9070 con 0x7fc5e806c910 2024-04-26T23:26:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5e5e00640 1 -- 172.21.15.39:0/1186301269 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00ad880 con 0x7fc5e806c910 2024-04-26T23:26:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- 172.21.15.39:0/1186301269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 msgr2=0x7fc5e8160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 --2- 172.21.15.39:0/1186301269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d001c560 comp rx=0 tx=0).stop 2024-04-26T23:26:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- 172.21.15.39:0/1186301269 shutdown_connections 2024-04-26T23:26:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 --2- 172.21.15.39:0/1186301269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e8160d70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 --2- 172.21.15.39:0/1186301269 >> v2:172.21.15.71:3300/0 conn(0x7fc5e813ffc0 0x7fc5e806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- 172.21.15.39:0/1186301269 >> 172.21.15.39:0/1186301269 conn(0x7fc5e806dfd0 msgr2=0x7fc5e80b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- 172.21.15.39:0/1186301269 shutdown_connections 2024-04-26T23:26:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- 172.21.15.39:0/1186301269 wait complete. 2024-04-26T23:26:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 Processor -- start 2024-04-26T23:26:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.477+0000 7fc5ed400640 1 -- start start 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e81569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 0x7fc5e815ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8161840 con 0x7fc5e81612b0 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81616c0 con 0x7fc5e813ffc0 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e80d17f0 con 0x7fc5e806c910 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35784/0 (socket says 172.21.15.39:35784) 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 -- 172.21.15.39:0/154428007 learned_addr learned my addr 172.21.15.39:0/154428007 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5dde00640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 0x7fc5e815ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e6800640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e81569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 -- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 msgr2=0x7fc5e81569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e81569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 -- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 msgr2=0x7fc5e815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 0x7fc5e815ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 -- 172.21.15.39:0/154428007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e81571b0 con 0x7fc5e81612b0 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5dde00640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 0x7fc5e815ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5e7200640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c760 tx=0x7fc5e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003b80 con 0x7fc5e81612b0 2024-04-26T23:26:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e0003d20 con 0x7fc5e81612b0 2024-04-26T23:26:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000aa30 con 0x7fc5e81612b0 2024-04-26T23:26:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e8157490 con 0x7fc5e81612b0 2024-04-26T23:26:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e81604f0 con 0x7fc5e81612b0 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e806a720 con 0x7fc5e81612b0 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.481+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5e000abd0 con 0x7fc5e81612b0 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.485+0000 7fc5df400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 0x7fc5c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.485+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc5e0086840 con 0x7fc5e81612b0 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.485+0000 7fc5e6800640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 0x7fc5c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.485+0000 7fc5e6800640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 0x7fc5c406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009af0 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.489+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc5e0056df0 con 0x7fc5e81612b0 2024-04-26T23:26:39.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc5e8074670 con 0x7fc5e81612b0 2024-04-26T23:26:39.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5df400640 1 -- 172.21.15.39:0/154428007 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc5e00566f0 con 0x7fc5e81612b0 2024-04-26T23:26:39.657 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:39.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 msgr2=0x7fc5c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 0x7fc5c406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009af0 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2024-04-26T23:26:39.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 msgr2=0x7fc5e80b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c760 tx=0x7fc5e000cc20 comp rx=0 tx=0).stop 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 shutdown_connections 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5c4068380 0x7fc5c406a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5e81612b0 0x7fc5e80b6760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e813ffc0 0x7fc5e815ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 --2- 172.21.15.39:0/154428007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc5e806c910 0x7fc5e81569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 >> 172.21.15.39:0/154428007 conn(0x7fc5e806dfd0 msgr2=0x7fc5e813d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 shutdown_connections 2024-04-26T23:26:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.653+0000 7fc5ed400640 1 -- 172.21.15.39:0/154428007 wait complete. 2024-04-26T23:26:39.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 Processor -- start 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 -- start start 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3f40cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3f406d940 0x7ff3f40b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f40d01e0 con 0x7ff3f406d4e0 2024-04-26T23:26:39.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f406dfa0 con 0x7ff3f406d940 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f406e280 con 0x7ff3f40cf8c0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff3f406d4e0 0x7ff3f40d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60774/0 (socket says 172.21.15.39:60774) 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 -- 172.21.15.39:0/334777887 learned_addr learned my addr 172.21.15.39:0/334777887 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980878033 0 0) 0x7ff3f40d01e0 con 0x7ff3f406d4e0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f2800640 1 --2- 172.21.15.39:0/334777887 >> v2:172.21.15.71:3300/0 conn(0x7ff3f406d940 0x7ff3f40b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d8003530 con 0x7ff3f406d4e0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1e00640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3f40cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817289851 0 0) 0x7ff3d8003530 con 0x7ff3f406d4e0 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 msgr2=0x7ff3f40cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3f40cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 >> v2:172.21.15.71:3300/0 conn(0x7ff3f406d940 msgr2=0x7ff3f40b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 --2- 172.21.15.39:0/334777887 >> v2:172.21.15.71:3300/0 conn(0x7ff3f406d940 0x7ff3f40b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f406e560 con 0x7ff3f406d4e0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7ff3dc001680 con 0x7ff3f406d4e0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 >> v1:172.21.15.39:6789/0 conn(0x7ff3f406d4e0 legacy=0x7ff3f40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3d80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3d8003f40 0x7ff3d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004d50 0x7ff3d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f406dfa0 con 0x7ff3d8003f40 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f406e280 con 0x7ff3d8004d50 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d800b9d0 con 0x7ff3f40cf8c0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3d8003f40 0x7ff3d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f2800640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004d50 0x7ff3d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3f1e00640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3d80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 -- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 msgr2=0x7ff3d80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cf8c0 0x7ff3d80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 -- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004d50 msgr2=0x7ff3d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:39.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004d50 0x7ff3d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.821+0000 7ff3e9400640 1 -- 172.21.15.39:0/334777887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d8003530 con 0x7ff3d8003f40 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3e9400640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3d8003f40 0x7ff3d8004810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c240 tx=0x7ff3dc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982d016684bc42c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc007d60 con 0x7ff3d8003f40 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005b00 con 0x7ff3d8003f40 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f1400640 1 -- 172.21.15.39:0/334777887 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc007070 con 0x7ff3d8003f40 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 -- 172.21.15.39:0/334777887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3d8003f40 msgr2=0x7ff3d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/334777887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3d8003f40 0x7ff3d8004810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c240 tx=0x7ff3dc01f3d0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f2800640 1 -- 172.21.15.39:0/334777887 reap_dead start 2024-04-26T23:26:39.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 -- 172.21.15.39:0/334777887 shutdown_connections 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 -- 172.21.15.39:0/334777887 >> 172.21.15.39:0/334777887 conn(0x7ff3f40d3040 msgr2=0x7ff3f40d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 -- 172.21.15.39:0/334777887 shutdown_connections 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.825+0000 7ff3f8a00640 1 -- 172.21.15.39:0/334777887 wait complete. 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 Processor -- start 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- start start 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8003f40 0x7ff3f40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cbd10 0x7ff3f40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40b4730 con 0x7ff3f40b7e90 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40b32d0 con 0x7ff3d8003f40 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f40d17e0 con 0x7ff3f40cbd10 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35806/0 (socket says 172.21.15.39:35806) 2024-04-26T23:26:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 -- 172.21.15.39:0/1367464971 learned_addr learned my addr 172.21.15.39:0/1367464971 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f1e00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8003f40 0x7ff3f40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f2800640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cbd10 0x7ff3f40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 -- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cbd10 msgr2=0x7ff3f40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cbd10 0x7ff3f40cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 -- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8003f40 msgr2=0x7ff3f40b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8003f40 0x7ff3f40b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:39.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 -- 172.21.15.39:0/1367464971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f40b67a0 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3e9400640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c240 tx=0x7ff3d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc005cb0 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005e50 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0049f0 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f40b6a80 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.829+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f40b7040 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f406a720 con 0x7ff3f40b7e90 2024-04-26T23:26:39.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3dc0ba030 con 0x7ff3f40b7e90 2024-04-26T23:26:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3eaa00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 0x7ff3d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3dc123540 con 0x7ff3f40b7e90 2024-04-26T23:26:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3f1e00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 0x7ff3d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:39.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.833+0000 7ff3f1e00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 0x7ff3d006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009a40 tx=0x7ff3e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:39.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:39.837+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff3dc0c1030 con 0x7ff3f40b7e90 2024-04-26T23:26:40.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.001+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3f40cf5b0 con 0x7ff3f40b7e90 2024-04-26T23:26:40.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.001+0000 7ff3eaa00640 1 -- 172.21.15.39:0/1367464971 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff3dc019140 con 0x7ff3f40b7e90 2024-04-26T23:26:40.006 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 msgr2=0x7ff3d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 0x7ff3d006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009a40 tx=0x7ff3e4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 msgr2=0x7ff3f40b8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c240 tx=0x7ff3d8005840 comp rx=0 tx=0).stop 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 shutdown_connections 2024-04-26T23:26:40.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff3d00683b0 0x7ff3d006a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3f40cbd10 0x7ff3f40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3f40b7e90 0x7ff3f40b8310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 --2- 172.21.15.39:0/1367464971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8003f40 0x7ff3f40b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 >> 172.21.15.39:0/1367464971 conn(0x7ff3f40d3040 msgr2=0x7ff3f40d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 shutdown_connections 2024-04-26T23:26:40.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.005+0000 7ff3f8a00640 1 -- 172.21.15.39:0/1367464971 wait complete. 2024-04-26T23:26:40.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 Processor -- start 2024-04-26T23:26:40.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 -- start start 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c815f340 0x7f61c80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f61c80b5710 0x7f61c809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f61c815f720 0x7f61c809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f61c80d26a0 con 0x7f61c80b5710 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f61c80ce140 con 0x7f61c815f720 2024-04-26T23:26:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.169+0000 7f61cd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80cd810 con 0x7f61c815f340 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f61c80b5710 0x7f61c809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f61c80b5710 0x7f61c809b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46804/0 (socket says 172.21.15.39:46804) 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 -- 172.21.15.39:0/307583558 learned_addr learned my addr 172.21.15.39:0/307583558 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61c6a00640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c815f340 0x7f61c80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61c7400640 1 --2- 172.21.15.39:0/307583558 >> v2:172.21.15.71:3300/0 conn(0x7f61c815f720 0x7f61c809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 -- 172.21.15.39:0/307583558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c815f340 msgr2=0x7f61c80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c815f340 0x7f61c80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 -- 172.21.15.39:0/307583558 >> v2:172.21.15.71:3300/0 conn(0x7f61c815f720 msgr2=0x7f61c809bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 --2- 172.21.15.39:0/307583558 >> v2:172.21.15.71:3300/0 conn(0x7f61c815f720 0x7f61c809bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 -- 172.21.15.39:0/307583558 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80cdaf0 con 0x7f61c80b5710 2024-04-26T23:26:40.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61be000640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c80b5710 0x7f61c809b9e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61c80737d0 tx=0x7f61b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cd99b54f175977 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61c6000640 1 -- 172.21.15.39:0/307583558 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b00ab640 con 0x7f61c80b5710 2024-04-26T23:26:40.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61c6000640 1 -- 172.21.15.39:0/307583558 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b00b0070 con 0x7f61c80b5710 2024-04-26T23:26:40.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.173+0000 7f61c6000640 1 -- 172.21.15.39:0/307583558 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b00aba00 con 0x7f61c80b5710 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- 172.21.15.39:0/307583558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c80b5710 msgr2=0x7f61c809b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c80b5710 0x7f61c809b9e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61c80737d0 tx=0x7f61b001c460 comp rx=0 tx=0).stop 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- 172.21.15.39:0/307583558 shutdown_connections 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- 172.21.15.39:0/307583558 >> v2:172.21.15.71:3300/0 conn(0x7f61c815f720 0x7f61c809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c80b5710 0x7f61c809b9e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- 172.21.15.39:0/307583558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c815f340 0x7f61c80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- 172.21.15.39:0/307583558 >> 172.21.15.39:0/307583558 conn(0x7f61c80b4b80 msgr2=0x7f61c80b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- 172.21.15.39:0/307583558 shutdown_connections 2024-04-26T23:26:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- 172.21.15.39:0/307583558 wait complete. 2024-04-26T23:26:40.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 Processor -- start 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- start start 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c80b5710 0x7f61c81568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 0x7f61c81fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80b8ab0 con 0x7f61c815f340 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80b8c30 con 0x7f61c815f720 2024-04-26T23:26:40.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61cd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80b8db0 con 0x7f61c80b5710 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46818/0 (socket says 172.21.15.39:46818) 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 -- 172.21.15.39:0/4007226361 learned_addr learned my addr 172.21.15.39:0/4007226361 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61c7400640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 0x7f61c81fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61c6a00640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c80b5710 0x7f61c81568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 -- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c80b5710 msgr2=0x7f61c81568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c80b5710 0x7f61c81568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 -- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 msgr2=0x7f61c81fbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.177+0000 7f61be000640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 0x7f61c81fbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61be000640 1 -- 172.21.15.39:0/4007226361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c81585b0 con 0x7f61c815f340 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61c7400640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 0x7f61c81fbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61be000640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61b001ab10 tx=0x7f61b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b00abdb0 con 0x7f61c815f340 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b00be3f0 con 0x7f61c815f340 2024-04-26T23:26:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c8156e20 con 0x7f61c815f340 2024-04-26T23:26:40.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b00be7e0 con 0x7f61c815f340 2024-04-26T23:26:40.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c8158b00 con 0x7f61c815f340 2024-04-26T23:26:40.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c8050740 con 0x7f61c815f340 2024-04-26T23:26:40.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61b00c7440 con 0x7f61c815f340 2024-04-26T23:26:40.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 0x7f61a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61b0120e00 con 0x7f61c815f340 2024-04-26T23:26:40.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.181+0000 7f61c6a00640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 0x7f61a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.185+0000 7f61c6a00640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 0x7f61a406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b80113e0 tx=0x7f61b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.185+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f61b0016110 con 0x7f61c815f340 2024-04-26T23:26:40.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.353+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61c806edf0 con 0x7f61c815f340 2024-04-26T23:26:40.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.353+0000 7f61bf400640 1 -- 172.21.15.39:0/4007226361 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f61b00f0e00 con 0x7f61c815f340 2024-04-26T23:26:40.358 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:40.358 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:40.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 msgr2=0x7f61a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 0x7f61a406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b80113e0 tx=0x7f61b800b040 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 msgr2=0x7f61c81fb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61b001ab10 tx=0x7f61b001aca0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 shutdown_connections 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61a4068380 0x7f61a406a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c815f720 0x7f61c81fbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61c815f340 0x7f61c81fb670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 --2- 172.21.15.39:0/4007226361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f61c80b5710 0x7f61c81568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 >> 172.21.15.39:0/4007226361 conn(0x7f61c80b4b80 msgr2=0x7f61c80719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 shutdown_connections 2024-04-26T23:26:40.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.357+0000 7f61cd800640 1 -- 172.21.15.39:0/4007226361 wait complete. 2024-04-26T23:26:40.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:40.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:40.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 Processor -- start 2024-04-26T23:26:40.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 -- start start 2024-04-26T23:26:40.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff34415b7e0 0x7ff3440cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 0x7ff3440b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3440b5ab0 con 0x7ff3440d1670 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff3440b5d90 con 0x7ff34415b7e0 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff349600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff34406e500 con 0x7ff3440d11e0 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff34415b7e0 0x7ff3440cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff34415b7e0 0x7ff3440cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46832/0 (socket says 172.21.15.39:46832) 2024-04-26T23:26:40.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 -- 172.21.15.39:0/774976506 learned_addr learned my addr 172.21.15.39:0/774976506 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 -- 172.21.15.39:0/774976506 >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 msgr2=0x7ff3440b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342000640 1 --2- 172.21.15.39:0/774976506 >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 0x7ff3440b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 --2- 172.21.15.39:0/774976506 >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 0x7ff3440b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 -- 172.21.15.39:0/774976506 >> v1:172.21.15.71:6789/0 conn(0x7ff3440d1670 legacy=0x7ff344072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342a00640 1 -- 172.21.15.39:0/774976506 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34406e7e0 con 0x7ff34415b7e0 2024-04-26T23:26:40.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.521+0000 7ff342000640 1 --2- 172.21.15.39:0/774976506 >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 0x7ff3440b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:40.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff342a00640 1 --2- 172.21.15.39:0/774976506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cdd40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff344070020 tx=0x7ff33401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d696af6f237bd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff341600640 1 -- 172.21.15.39:0/774976506 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340b0070 con 0x7ff34415b7e0 2024-04-26T23:26:40.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff341600640 1 -- 172.21.15.39:0/774976506 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3340ab600 con 0x7ff34415b7e0 2024-04-26T23:26:40.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff341600640 1 -- 172.21.15.39:0/774976506 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340ab9d0 con 0x7ff34415b7e0 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 -- 172.21.15.39:0/774976506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 msgr2=0x7ff3440cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 --2- 172.21.15.39:0/774976506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cdd40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff344070020 tx=0x7ff33401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 -- 172.21.15.39:0/774976506 shutdown_connections 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 --2- 172.21.15.39:0/774976506 >> v2:172.21.15.71:3300/0 conn(0x7ff3440d11e0 0x7ff3440b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 --2- 172.21.15.39:0/774976506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cdd40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 -- 172.21.15.39:0/774976506 >> 172.21.15.39:0/774976506 conn(0x7ff34406c7d0 msgr2=0x7ff34406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 -- 172.21.15.39:0/774976506 shutdown_connections 2024-04-26T23:26:40.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 -- 172.21.15.39:0/774976506 wait complete. 2024-04-26T23:26:40.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.525+0000 7ff349600640 1 Processor -- start 2024-04-26T23:26:40.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- start start 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3440d11e0 0x7ff34414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3440d1670 0x7ff344147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff3440b55c0 con 0x7ff34415b7e0 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3440734c0 con 0x7ff3440d1670 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff3440b5740 con 0x7ff3440d11e0 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46846/0 (socket says 172.21.15.39:46846) 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 -- 172.21.15.39:0/473463988 learned_addr learned my addr 172.21.15.39:0/473463988 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff342000640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3440d1670 0x7ff344147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff342a00640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3440d11e0 0x7ff34414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 -- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3440d11e0 msgr2=0x7ff34414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3440d11e0 0x7ff34414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 -- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3440d1670 msgr2=0x7ff344147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3440d1670 0x7ff344147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 -- 172.21.15.39:0/473463988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff344148530 con 0x7ff34415b7e0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff343400640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c780 tx=0x7ff33c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c004b70 con 0x7ff34415b7e0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c004d10 con 0x7ff34415b7e0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00aa90 con 0x7ff34415b7e0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3441487d0 con 0x7ff34415b7e0 2024-04-26T23:26:40.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff344148d90 con 0x7ff34415b7e0 2024-04-26T23:26:40.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.529+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34406a720 con 0x7ff34415b7e0 2024-04-26T23:26:40.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.533+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff33c00ac30 con 0x7ff34415b7e0 2024-04-26T23:26:40.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.533+0000 7ff33aa00640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 0x7ff32406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.533+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff33c086ff0 con 0x7ff34415b7e0 2024-04-26T23:26:40.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.533+0000 7ff342a00640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 0x7ff32406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.533+0000 7ff342a00640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 0x7ff32406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3340ad000 tx=0x7ff334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.537+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff33c057510 con 0x7ff34415b7e0 2024-04-26T23:26:40.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3440d0500 con 0x7ff34415b7e0 2024-04-26T23:26:40.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff33aa00640 1 -- 172.21.15.39:0/473463988 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff33c056e10 con 0x7ff34415b7e0 2024-04-26T23:26:40.705 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:40.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 msgr2=0x7ff32406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 0x7ff32406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3340ad000 tx=0x7ff334008040 comp rx=0 tx=0).stop 2024-04-26T23:26:40.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 msgr2=0x7ff3440cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c780 tx=0x7ff33c00cc40 comp rx=0 tx=0).stop 2024-04-26T23:26:40.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 shutdown_connections 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff324068380 0x7ff32406a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff34415b7e0 0x7ff3440cf150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3440d1670 0x7ff344147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 --2- 172.21.15.39:0/473463988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff3440d11e0 0x7ff34414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 >> 172.21.15.39:0/473463988 conn(0x7ff34406c7d0 msgr2=0x7ff3440cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 shutdown_connections 2024-04-26T23:26:40.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.701+0000 7ff349600640 1 -- 172.21.15.39:0/473463988 wait complete. 2024-04-26T23:26:40.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:40.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 Processor -- start 2024-04-26T23:26:40.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 -- start start 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c140170 0x7f647c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f647c15e340 0x7f647c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f647c161850 0x7f647c0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f647c06f110 con 0x7f647c161850 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f647c06e500 con 0x7f647c15e340 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.865+0000 7f6483c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f647c06e7e0 con 0x7f647c140170 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f647c161850 0x7f647c0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f647c161850 0x7f647c0d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46856/0 (socket says 172.21.15.39:46856) 2024-04-26T23:26:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 -- 172.21.15.39:0/539198806 learned_addr learned my addr 172.21.15.39:0/539198806 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f647be00640 1 --2- 172.21.15.39:0/539198806 >> v2:172.21.15.71:3300/0 conn(0x7f647c15e340 0x7f647c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481200640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c140170 0x7f647c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 -- 172.21.15.39:0/539198806 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c140170 msgr2=0x7f647c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c140170 0x7f647c15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 -- 172.21.15.39:0/539198806 >> v2:172.21.15.71:3300/0 conn(0x7f647c15e340 msgr2=0x7f647c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 --2- 172.21.15.39:0/539198806 >> v2:172.21.15.71:3300/0 conn(0x7f647c15e340 0x7f647c0d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 -- 172.21.15.39:0/539198806 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c06eac0 con 0x7f647c161850 2024-04-26T23:26:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.869+0000 7f6481c00640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c161850 0x7f647c0d1720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f647c0d1dc0 tx=0x7f647401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3724279d740ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f647b400640 1 -- 172.21.15.39:0/539198806 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64740a56c0 con 0x7f647c161850 2024-04-26T23:26:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f647b400640 1 -- 172.21.15.39:0/539198806 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64740a5860 con 0x7f647c161850 2024-04-26T23:26:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f647b400640 1 -- 172.21.15.39:0/539198806 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64740a5c30 con 0x7f647c161850 2024-04-26T23:26:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- 172.21.15.39:0/539198806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c161850 msgr2=0x7f647c0d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c161850 0x7f647c0d1720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f647c0d1dc0 tx=0x7f647401c930 comp rx=0 tx=0).stop 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- 172.21.15.39:0/539198806 shutdown_connections 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c161850 0x7f647c0d1720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- 172.21.15.39:0/539198806 >> v2:172.21.15.71:3300/0 conn(0x7f647c15e340 0x7f647c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- 172.21.15.39:0/539198806 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c140170 0x7f647c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- 172.21.15.39:0/539198806 >> 172.21.15.39:0/539198806 conn(0x7f647c06c7d0 msgr2=0x7f647c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- 172.21.15.39:0/539198806 shutdown_connections 2024-04-26T23:26:40.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- 172.21.15.39:0/539198806 wait complete. 2024-04-26T23:26:40.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 Processor -- start 2024-04-26T23:26:40.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- start start 2024-04-26T23:26:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c15e340 0x7f647c0aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c161850 0x7f647c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1432a0 con 0x7f647c140170 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c143120 con 0x7f647c161850 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6483c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f647c143420 con 0x7f647c15e340 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6481200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6481200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46862/0 (socket says 172.21.15.39:46862) 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6481200640 1 -- 172.21.15.39:0/3724508283 learned_addr learned my addr 172.21.15.39:0/3724508283 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f647be00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c15e340 0x7f647c0aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.873+0000 7f6481c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c161850 0x7f647c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 -- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c15e340 msgr2=0x7f647c0aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c15e340 0x7f647c0aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 -- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c161850 msgr2=0x7f647c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c161850 0x7f647c0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 -- 172.21.15.39:0/3724508283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c072920 con 0x7f647c140170 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6481200640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6470012fc0 tx=0x7f6470010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470010da0 con 0x7f647c140170 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647001d070 con 0x7f647c140170 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470018680 con 0x7f647c140170 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c072c00 con 0x7f647c140170 2024-04-26T23:26:40.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c0731c0 con 0x7f647c140170 2024-04-26T23:26:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c06a720 con 0x7f647c140170 2024-04-26T23:26:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6470016050 con 0x7f647c140170 2024-04-26T23:26:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 0x7f645c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f647008a780 con 0x7f647c140170 2024-04-26T23:26:40.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.877+0000 7f647be00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 0x7f645c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:40.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.881+0000 7f647be00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 0x7f645c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f647c1426d0 tx=0x7f6468009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:40.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:40.881+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6470026020 con 0x7f647c140170 2024-04-26T23:26:41.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.045+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f647c06fdc0 con 0x7f647c140170 2024-04-26T23:26:41.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.045+0000 7f6478c00640 1 -- 172.21.15.39:0/3724508283 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6470014040 con 0x7f647c140170 2024-04-26T23:26:41.056 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 msgr2=0x7f645c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 0x7f645c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f647c1426d0 tx=0x7f6468009190 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 msgr2=0x7f647c13f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6470012fc0 tx=0x7f6470010490 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 shutdown_connections 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f645c068380 0x7f645c06a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c161850 0x7f647c0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f647c15e340 0x7f647c0aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 --2- 172.21.15.39:0/3724508283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f647c140170 0x7f647c13f750 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 >> 172.21.15.39:0/3724508283 conn(0x7f647c06c7d0 msgr2=0x7f647c1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 shutdown_connections 2024-04-26T23:26:41.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.049+0000 7f6483c00640 1 -- 172.21.15.39:0/3724508283 wait complete. 2024-04-26T23:26:41.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:41.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 Processor -- start 2024-04-26T23:26:41.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 -- start start 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd62c160150 0x7fd62c073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd62c06c3d0 0x7fd62c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c070200 con 0x7fd62c160530 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c073970 con 0x7fd62c160150 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd632200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c073320 con 0x7fd62c06c3d0 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd62c160150 0x7fd62c073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd622a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd62c160530 0x7fd62c06f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47614/0 (socket says 172.21.15.39:47614) 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd622a00640 1 -- 172.21.15.39:0/1971989593 learned_addr learned my addr 172.21.15.39:0/1971989593 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62be00640 1 --2- 172.21.15.39:0/1971989593 >> v2:172.21.15.71:3300/0 conn(0x7fd62c06c3d0 0x7fd62c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62b400640 1 -- 172.21.15.39:0/1971989593 >> v2:172.21.15.71:3300/0 conn(0x7fd62c06c3d0 msgr2=0x7fd62c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:41.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62b400640 1 --2- 172.21.15.39:0/1971989593 >> v2:172.21.15.71:3300/0 conn(0x7fd62c06c3d0 0x7fd62c06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62b400640 1 -- 172.21.15.39:0/1971989593 >> v1:172.21.15.39:6789/0 conn(0x7fd62c160530 legacy=0x7fd62c06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62b400640 1 -- 172.21.15.39:0/1971989593 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c073600 con 0x7fd62c160150 2024-04-26T23:26:41.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.213+0000 7fd62aa00640 1 -- 172.21.15.39:0/1971989593 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596044356 0 0) 0x7fd62c070200 con 0x7fd62c160530 2024-04-26T23:26:41.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd62b400640 1 --2- 172.21.15.39:0/1971989593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c073e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd62c071cf0 tx=0x7fd61c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c068952d22b862b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd62aa00640 1 -- 172.21.15.39:0/1971989593 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0b0070 con 0x7fd62c160150 2024-04-26T23:26:41.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd62aa00640 1 -- 172.21.15.39:0/1971989593 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61c0ab600 con 0x7fd62c160150 2024-04-26T23:26:41.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd62aa00640 1 -- 172.21.15.39:0/1971989593 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0ab9d0 con 0x7fd62c160150 2024-04-26T23:26:41.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 -- 172.21.15.39:0/1971989593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 msgr2=0x7fd62c073e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 --2- 172.21.15.39:0/1971989593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c073e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd62c071cf0 tx=0x7fd61c01c3f0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 -- 172.21.15.39:0/1971989593 shutdown_connections 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 --2- 172.21.15.39:0/1971989593 >> v2:172.21.15.71:3300/0 conn(0x7fd62c06c3d0 0x7fd62c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 --2- 172.21.15.39:0/1971989593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c073e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 -- 172.21.15.39:0/1971989593 >> 172.21.15.39:0/1971989593 conn(0x7fd62c06dfd0 msgr2=0x7fd62c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 -- 172.21.15.39:0/1971989593 shutdown_connections 2024-04-26T23:26:41.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.217+0000 7fd632200640 1 -- 172.21.15.39:0/1971989593 wait complete. 2024-04-26T23:26:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 Processor -- start 2024-04-26T23:26:41.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- start start 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd62c06c3d0 0x7fd62c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd62c160530 0x7fd62c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0b5f80 con 0x7fd62c160150 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0b5e00 con 0x7fd62c160530 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0b6100 con 0x7fd62c06c3d0 2024-04-26T23:26:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46876/0 (socket says 172.21.15.39:46876) 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 -- 172.21.15.39:0/2685182445 learned_addr learned my addr 172.21.15.39:0/2685182445 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd62b400640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd62c06c3d0 0x7fd62c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd62be00640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd62c160530 0x7fd62c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 -- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd62c06c3d0 msgr2=0x7fd62c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd62c06c3d0 0x7fd62c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 -- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd62c160530 msgr2=0x7fd62c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd62c160530 0x7fd62c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 -- 172.21.15.39:0/2685182445 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c154600 con 0x7fd62c160150 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd622a00640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c450 tx=0x7fd61400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614018070 con 0x7fd62c160150 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6140074e0 con 0x7fd62c160150 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140049f0 con 0x7fd62c160150 2024-04-26T23:26:41.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c1548e0 con 0x7fd62c160150 2024-04-26T23:26:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c154ea0 con 0x7fd62c160150 2024-04-26T23:26:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.221+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c06a720 con 0x7fd62c160150 2024-04-26T23:26:41.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.225+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd61401b070 con 0x7fd62c160150 2024-04-26T23:26:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.225+0000 7fd623e00640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.225+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd614085dd0 con 0x7fd62c160150 2024-04-26T23:26:41.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.225+0000 7fd62b400640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.225+0000 7fd62b400640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 0x7fd60806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0ad000 tx=0x7fd61c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.229+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6140562f0 con 0x7fd62c160150 2024-04-26T23:26:41.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd62c0b51c0 con 0x7fd62c160150 2024-04-26T23:26:41.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd623e00640 1 -- 172.21.15.39:0/2685182445 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd614055bf0 con 0x7fd62c160150 2024-04-26T23:26:41.397 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:41.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 msgr2=0x7fd60806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 0x7fd60806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0ad000 tx=0x7fd61c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 msgr2=0x7fd62c153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c450 tx=0x7fd61400c910 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 shutdown_connections 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd62c160530 0x7fd62c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd62c160150 0x7fd62c153db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 --2- 172.21.15.39:0/2685182445 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd62c06c3d0 0x7fd62c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 >> 172.21.15.39:0/2685182445 conn(0x7fd62c06dfd0 msgr2=0x7fd62c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 shutdown_connections 2024-04-26T23:26:41.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.393+0000 7fd632200640 1 -- 172.21.15.39:0/2685182445 wait complete. 2024-04-26T23:26:41.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:41.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.553+0000 7f7ad5e00640 1 Processor -- start 2024-04-26T23:26:41.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.553+0000 7f7ad5e00640 1 -- start start 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ad5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ad00cd810 0x7f7ad00742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ad5e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad00d0550 con 0x7f7ad00cfe00 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ad5e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad00d0830 con 0x7f7ad00cdbf0 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ad5e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad00d0b10 con 0x7f7ad00cd810 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7acea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ad00cd810 0x7f7ad00742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ac6000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7ad00cfe00 0x7f7ad0144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47618/0 (socket says 172.21.15.39:47618) 2024-04-26T23:26:41.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ac6000640 1 -- 172.21.15.39:0/3927817974 learned_addr learned my addr 172.21.15.39:0/3927817974 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:41.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7acea00640 1 -- 172.21.15.39:0/3927817974 >> v1:172.21.15.71:6789/0 conn(0x7f7ad00cdbf0 legacy=0x7f7ad006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7acea00640 1 -- 172.21.15.39:0/3927817974 >> v1:172.21.15.39:6789/0 conn(0x7f7ad00cfe00 legacy=0x7f7ad0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7acea00640 1 -- 172.21.15.39:0/3927817974 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad006e600 con 0x7f7ad00cd810 2024-04-26T23:26:41.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.557+0000 7f7ace000640 1 -- 172.21.15.39:0/3927817974 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282901267 0 0) 0x7f7ad00d0550 con 0x7f7ad00cfe00 2024-04-26T23:26:41.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7acea00640 1 --2- 172.21.15.39:0/3927817974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cd810 0x7f7ad00742f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009d90 tx=0x7f7ac001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f093945b0f973c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ace000640 1 -- 172.21.15.39:0/3927817974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00b2070 con 0x7f7ad00cd810 2024-04-26T23:26:41.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ace000640 1 -- 172.21.15.39:0/3927817974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac00a58b0 con 0x7f7ad00cd810 2024-04-26T23:26:41.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ace000640 1 -- 172.21.15.39:0/3927817974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00a5c80 con 0x7f7ad00cd810 2024-04-26T23:26:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- 172.21.15.39:0/3927817974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cd810 msgr2=0x7f7ad00742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/3927817974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cd810 0x7f7ad00742f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009d90 tx=0x7f7ac001c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- 172.21.15.39:0/3927817974 shutdown_connections 2024-04-26T23:26:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/3927817974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cd810 0x7f7ad00742f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- 172.21.15.39:0/3927817974 >> 172.21.15.39:0/3927817974 conn(0x7f7ad00b2af0 msgr2=0x7f7ad00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- 172.21.15.39:0/3927817974 shutdown_connections 2024-04-26T23:26:41.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- 172.21.15.39:0/3927817974 wait complete. 2024-04-26T23:26:41.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 Processor -- start 2024-04-26T23:26:41.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 -- start start 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.561+0000 7f7ad5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ad00cd810 0x7f7ad0141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ad00cdbf0 0x7f7ad013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0143d30 con 0x7f7ad00cfe00 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0143bb0 con 0x7f7ad00cd810 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad016b710 con 0x7f7ad00cdbf0 2024-04-26T23:26:41.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46898/0 (socket says 172.21.15.39:46898) 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 -- 172.21.15.39:0/1027518086 learned_addr learned my addr 172.21.15.39:0/1027518086 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acea00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ad00cd810 0x7f7ad0141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ac6000640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ad00cdbf0 0x7f7ad013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 -- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ad00cdbf0 msgr2=0x7f7ad013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ad00cdbf0 0x7f7ad013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 -- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ad00cd810 msgr2=0x7f7ad0141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ad00cd810 0x7f7ad0141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 -- 172.21.15.39:0/1027518086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad0069cd0 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7acf400640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c460 tx=0x7f7ac800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8016020 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac8005220 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad015fb70 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8007030 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad013eda0 con 0x7f7ad00cfe00 2024-04-26T23:26:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad0050740 con 0x7f7ad00cfe00 2024-04-26T23:26:41.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.565+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ac80071d0 con 0x7f7ad00cfe00 2024-04-26T23:26:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.569+0000 7f7ac7e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 0x7f7aac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.569+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ac8086310 con 0x7f7ad00cfe00 2024-04-26T23:26:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.569+0000 7f7acea00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 0x7f7aac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.569+0000 7f7acea00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 0x7f7aac06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00af000 tx=0x7f7ac00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.573+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ac8020020 con 0x7f7ad00cfe00 2024-04-26T23:26:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.737+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ad0142e80 con 0x7f7ad00cfe00 2024-04-26T23:26:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ac7e00640 1 -- 172.21.15.39:0/1027518086 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f7ac80074c0 con 0x7f7ad00cfe00 2024-04-26T23:26:41.745 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:41.745 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 msgr2=0x7f7aac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 0x7f7aac06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00af000 tx=0x7f7ac00a7070 comp rx=0 tx=0).stop 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 msgr2=0x7f7ad00aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c460 tx=0x7f7ac800c920 comp rx=0 tx=0).stop 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 shutdown_connections 2024-04-26T23:26:41.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7aac068380 0x7f7aac06a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad00cfe00 0x7f7ad00aa440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ad00cdbf0 0x7f7ad013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 --2- 172.21.15.39:0/1027518086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ad00cd810 0x7f7ad0141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 >> 172.21.15.39:0/1027518086 conn(0x7f7ad00b2af0 msgr2=0x7f7ad01422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 shutdown_connections 2024-04-26T23:26:41.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.741+0000 7f7ad5e00640 1 -- 172.21.15.39:0/1027518086 wait complete. 2024-04-26T23:26:41.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:41.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:41.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.905+0000 7f869d400640 1 Processor -- start 2024-04-26T23:26:41.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f869d400640 1 -- start start 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f869d400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f86981458d0 0x7f86980b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f869d400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8698072180 con 0x7f86980ce5e0 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f869d400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86980739a0 con 0x7f8698073400 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f869d400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8698073c80 con 0x7f86981458d0 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8697200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f86980ce5e0 0x7f869806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47632/0 (socket says 172.21.15.39:47632) 2024-04-26T23:26:41.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8697200640 1 -- 172.21.15.39:0/1704352903 learned_addr learned my addr 172.21.15.39:0/1704352903 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:41.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8696800640 1 --2- 172.21.15.39:0/1704352903 >> v2:172.21.15.71:3300/0 conn(0x7f86981458d0 0x7f86980b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934083538 0 0) 0x7f8698072180 con 0x7f86980ce5e0 2024-04-26T23:26:41.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f867c003530 con 0x7f86980ce5e0 2024-04-26T23:26:41.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8696800640 1 -- 172.21.15.39:0/1704352903 >> v1:172.21.15.71:6789/0 conn(0x7f8698073400 legacy=0x7f8698072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8696800640 1 -- 172.21.15.39:0/1704352903 >> v1:172.21.15.39:6789/0 conn(0x7f86980ce5e0 legacy=0x7f869806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146297814 0 0) 0x7f867c003530 con 0x7f86980ce5e0 2024-04-26T23:26:41.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.909+0000 7f8696800640 1 -- 172.21.15.39:0/1704352903 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8698145cb0 con 0x7f86981458d0 2024-04-26T23:26:41.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f8696800640 1 --2- 172.21.15.39:0/1704352903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86981458d0 0x7f86980b4890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86880097f0 tx=0x7f868801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73eb1a38d09d382 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86880b0070 con 0x7f86981458d0 2024-04-26T23:26:41.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86880ab400 con 0x7f86981458d0 2024-04-26T23:26:41.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f8695e00640 1 -- 172.21.15.39:0/1704352903 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690001a00 con 0x7f86981458d0 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 -- 172.21.15.39:0/1704352903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86981458d0 msgr2=0x7f86980b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 --2- 172.21.15.39:0/1704352903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86981458d0 0x7f86980b4890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86880097f0 tx=0x7f868801c330 comp rx=0 tx=0).stop 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 -- 172.21.15.39:0/1704352903 shutdown_connections 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 --2- 172.21.15.39:0/1704352903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86981458d0 0x7f86980b4890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 -- 172.21.15.39:0/1704352903 >> 172.21.15.39:0/1704352903 conn(0x7f869806c7d0 msgr2=0x7f869806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 -- 172.21.15.39:0/1704352903 shutdown_connections 2024-04-26T23:26:41.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.913+0000 7f869d400640 1 -- 172.21.15.39:0/1704352903 wait complete. 2024-04-26T23:26:41.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 Processor -- start 2024-04-26T23:26:41.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- start start 2024-04-26T23:26:41.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8698073400 0x7f869814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 0x7f8698144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f869806fe00 con 0x7f86980ce5e0 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f869806fc80 con 0x7f8698073400 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f86980cea70 con 0x7f86981458d0 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46904/0 (socket says 172.21.15.39:46904) 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 -- 172.21.15.39:0/249361417 learned_addr learned my addr 172.21.15.39:0/249361417 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f8696800640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8698073400 0x7f869814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f8697200640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 0x7f8698144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 -- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 msgr2=0x7f8698144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 0x7f8698144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 -- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8698073400 msgr2=0x7f869814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8698073400 0x7f869814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:41.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 -- 172.21.15.39:0/249361417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869814a600 con 0x7f86980ce5e0 2024-04-26T23:26:41.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f8697200640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 0x7f8698144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:41.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868de00640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f868000c500 tx=0x7f868000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680016020 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8680005220 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869814a8e0 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680007030 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869813ea40 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.917+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869814af60 con 0x7f86980ce5e0 2024-04-26T23:26:41.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.921+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86800071f0 con 0x7f86980ce5e0 2024-04-26T23:26:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.921+0000 7f868f400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 0x7f867406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.921+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f86800863b0 con 0x7f86980ce5e0 2024-04-26T23:26:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.921+0000 7f8696800640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 0x7f867406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.921+0000 7f8696800640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 0x7f867406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86880ad000 tx=0x7f86880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:41.925+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8680020020 con 0x7f86980ce5e0 2024-04-26T23:26:42.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f869806a720 con 0x7f86980ce5e0 2024-04-26T23:26:42.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f868f400640 1 -- 172.21.15.39:0/249361417 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f86800568e0 con 0x7f86980ce5e0 2024-04-26T23:26:42.096 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:42.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 msgr2=0x7f867406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 0x7f867406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86880ad000 tx=0x7f86880a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 msgr2=0x7f869813e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f868000c500 tx=0x7f868000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 shutdown_connections 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8674068380 0x7f867406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86981458d0 0x7f8698144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86980ce5e0 0x7f869813e500 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 --2- 172.21.15.39:0/249361417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8698073400 0x7f869814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 >> 172.21.15.39:0/249361417 conn(0x7f869806c7d0 msgr2=0x7f86980d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 shutdown_connections 2024-04-26T23:26:42.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.093+0000 7f869d400640 1 -- 172.21.15.39:0/249361417 wait complete. 2024-04-26T23:26:42.117 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 Processor -- start 2024-04-26T23:26:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 -- start start 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f41e00b0680 0x7f41e00cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41e0072ca0 0x7f41e0073130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f41e00703d0 con 0x7f41e0072ca0 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f41e006e7b0 con 0x7f41e00b0680 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dfe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f41e0073f50 con 0x7f41e0160720 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41e0072ca0 0x7f41e0073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41e0072ca0 0x7f41e0073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46920/0 (socket says 172.21.15.39:46920) 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 -- 172.21.15.39:0/1310633661 learned_addr learned my addr 172.21.15.39:0/1310633661 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41d6000640 1 --2- 172.21.15.39:0/1310633661 >> v2:172.21.15.71:3300/0 conn(0x7f41e00b0680 0x7f41e00cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41dea00640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 -- 172.21.15.39:0/1310633661 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 msgr2=0x7f41e00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 -- 172.21.15.39:0/1310633661 >> v2:172.21.15.71:3300/0 conn(0x7f41e00b0680 msgr2=0x7f41e00cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 --2- 172.21.15.39:0/1310633661 >> v2:172.21.15.71:3300/0 conn(0x7f41e00b0680 0x7f41e00cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.257+0000 7f41df400640 1 -- 172.21.15.39:0/1310633661 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e0074230 con 0x7f41e0072ca0 2024-04-26T23:26:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41df400640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e0073130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009ed0 tx=0x7f41d801ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3badc1112a31576 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41de000640 1 -- 172.21.15.39:0/1310633661 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a7bd0 con 0x7f41e0072ca0 2024-04-26T23:26:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41de000640 1 -- 172.21.15.39:0/1310633661 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d80a7d70 con 0x7f41e0072ca0 2024-04-26T23:26:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41de000640 1 -- 172.21.15.39:0/1310633661 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80af610 con 0x7f41e0072ca0 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 -- 172.21.15.39:0/1310633661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 msgr2=0x7f41e0073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e0073130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009ed0 tx=0x7f41d801ee20 comp rx=0 tx=0).stop 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 -- 172.21.15.39:0/1310633661 shutdown_connections 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e0073130 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 --2- 172.21.15.39:0/1310633661 >> v2:172.21.15.71:3300/0 conn(0x7f41e00b0680 0x7f41e00cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 --2- 172.21.15.39:0/1310633661 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 -- 172.21.15.39:0/1310633661 >> 172.21.15.39:0/1310633661 conn(0x7f41e00d1010 msgr2=0x7f41e00d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 -- 172.21.15.39:0/1310633661 shutdown_connections 2024-04-26T23:26:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.261+0000 7f41dfe00640 1 -- 172.21.15.39:0/1310633661 wait complete. 2024-04-26T23:26:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 Processor -- start 2024-04-26T23:26:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- start start 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41e00b0680 0x7f41e0156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00cbf50 con 0x7f41e0072ca0 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00cbdd0 con 0x7f41e00b0680 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f41e006ec30 con 0x7f41e0160720 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46926/0 (socket says 172.21.15.39:46926) 2024-04-26T23:26:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 -- 172.21.15.39:0/2551962861 learned_addr learned my addr 172.21.15.39:0/2551962861 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41d6000640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41e00b0680 0x7f41e0156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41df400640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 -- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 msgr2=0x7f41e00c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 -- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41e00b0680 msgr2=0x7f41e0156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41e00b0680 0x7f41e0156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 -- 172.21.15.39:0/2551962861 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e0157110 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dea00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41d000d620 tx=0x7f41d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000b620 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0019070 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000b9e0 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e00c9a70 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.265+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e00ca110 con 0x7f41e0072ca0 2024-04-26T23:26:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e01575c0 con 0x7f41e0072ca0 2024-04-26T23:26:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41d000bb80 con 0x7f41e0072ca0 2024-04-26T23:26:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41d7400640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 0x7f41bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41d0086ca0 con 0x7f41e0072ca0 2024-04-26T23:26:42.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41d6000640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 0x7f41bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.269+0000 7f41d6000640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 0x7f41bc06a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41e00c7ae0 tx=0x7f41c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.273+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f41d0056b70 con 0x7f41e0072ca0 2024-04-26T23:26:42.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.437+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f41e00506d0 con 0x7f41e0072ca0 2024-04-26T23:26:42.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.437+0000 7f41d7400640 1 -- 172.21.15.39:0/2551962861 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f41d005ae70 con 0x7f41e0072ca0 2024-04-26T23:26:42.442 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 msgr2=0x7f41bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 0x7f41bc06a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41e00c7ae0 tx=0x7f41c8008040 comp rx=0 tx=0).stop 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 msgr2=0x7f41e00cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41d000d620 tx=0x7f41d000dae0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 shutdown_connections 2024-04-26T23:26:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f41bc068380 0x7f41bc06a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e0160720 0x7f41e00c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41e00b0680 0x7f41e0156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 --2- 172.21.15.39:0/2551962861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e0072ca0 0x7f41e00cabf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 >> 172.21.15.39:0/2551962861 conn(0x7f41e00d1010 msgr2=0x7f41e015adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 shutdown_connections 2024-04-26T23:26:42.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.441+0000 7f41dfe00640 1 -- 172.21.15.39:0/2551962861 wait complete. 2024-04-26T23:26:42.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:42.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.601+0000 7f113b200640 1 Processor -- start 2024-04-26T23:26:42.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.601+0000 7f113b200640 1 -- start start 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113b200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f113c15ac30 0x7f113c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113b200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113c0cdbc0 con 0x7f113c0cfd60 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113b200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113c0cdea0 con 0x7f113c0d38c0 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113b200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f113c15b010 con 0x7f113c15ac30 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f113c15ac30 0x7f113c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113a800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f113c0cfd60 0x7f113c0d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47642/0 (socket says 172.21.15.39:47642) 2024-04-26T23:26:42.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f113a800640 1 -- 172.21.15.39:0/934475155 learned_addr learned my addr 172.21.15.39:0/934475155 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:42.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139e00640 1 -- 172.21.15.39:0/934475155 >> v1:172.21.15.71:6789/0 conn(0x7f113c0d38c0 legacy=0x7f113c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:42.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139e00640 1 -- 172.21.15.39:0/934475155 >> v1:172.21.15.39:6789/0 conn(0x7f113c0cfd60 legacy=0x7f113c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139e00640 1 -- 172.21.15.39:0/934475155 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c0ce180 con 0x7f113c15ac30 2024-04-26T23:26:42.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139400640 1 -- 172.21.15.39:0/934475155 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065115060 0 0) 0x7f113c0cdbc0 con 0x7f113c0cfd60 2024-04-26T23:26:42.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.605+0000 7f1139e00640 1 --2- 172.21.15.39:0/934475155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c15ac30 0x7f113c15e0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097c0 tx=0x7f112c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d067839337e731 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1139400640 1 -- 172.21.15.39:0/934475155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0b0070 con 0x7f113c15ac30 2024-04-26T23:26:42.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1139400640 1 -- 172.21.15.39:0/934475155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c0ab600 con 0x7f113c15ac30 2024-04-26T23:26:42.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1139400640 1 -- 172.21.15.39:0/934475155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ab9d0 con 0x7f113c15ac30 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- 172.21.15.39:0/934475155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c15ac30 msgr2=0x7f113c15e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 --2- 172.21.15.39:0/934475155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c15ac30 0x7f113c15e0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097c0 tx=0x7f112c01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- 172.21.15.39:0/934475155 shutdown_connections 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 --2- 172.21.15.39:0/934475155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c15ac30 0x7f113c15e0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- 172.21.15.39:0/934475155 >> 172.21.15.39:0/934475155 conn(0x7f113c0d2da0 msgr2=0x7f113c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- 172.21.15.39:0/934475155 shutdown_connections 2024-04-26T23:26:42.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- 172.21.15.39:0/934475155 wait complete. 2024-04-26T23:26:42.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 Processor -- start 2024-04-26T23:26:42.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- start start 2024-04-26T23:26:42.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 0x7f113c150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f113c15ac30 0x7f113c071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f113c16af10 con 0x7f113c0d38c0 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f113c16ad90 con 0x7f113c15ac30 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f113b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f113c16b090 con 0x7f113c0cfd60 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1131400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1131400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46936/0 (socket says 172.21.15.39:46936) 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1131400640 1 -- 172.21.15.39:0/1209151851 learned_addr learned my addr 172.21.15.39:0/1209151851 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.609+0000 7f1139e00640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 0x7f113c150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f113a800640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f113c15ac30 0x7f113c071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 -- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 msgr2=0x7f113c150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 0x7f113c150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 -- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f113c15ac30 msgr2=0x7f113c071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f113c15ac30 0x7f113c071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 -- 172.21.15.39:0/1209151851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c1552b0 con 0x7f113c0d38c0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1139e00640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 0x7f113c150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1131400640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f112400b410 tx=0x7f112400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124015030 con 0x7f113c0d38c0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1124004020 con 0x7f113c0d38c0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124004450 con 0x7f113c0d38c0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113c155590 con 0x7f113c0d38c0 2024-04-26T23:26:42.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113c155b50 con 0x7f113c0d38c0 2024-04-26T23:26:42.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113c0506d0 con 0x7f113c0d38c0 2024-04-26T23:26:42.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1124018070 con 0x7f113c0d38c0 2024-04-26T23:26:42.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 0x7f111806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1124086610 con 0x7f113c0d38c0 2024-04-26T23:26:42.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.613+0000 7f1139e00640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 0x7f111806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.617+0000 7f1139e00640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 0x7f111806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ad000 tx=0x7f112c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.617+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1124056b30 con 0x7f113c0d38c0 2024-04-26T23:26:42.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.781+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f113c1619b0 con 0x7f113c0d38c0 2024-04-26T23:26:42.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f1132a00640 1 -- 172.21.15.39:0/1209151851 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1124056430 con 0x7f113c0d38c0 2024-04-26T23:26:42.788 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 msgr2=0x7f111806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 0x7f111806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ad000 tx=0x7f112c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 msgr2=0x7f113c070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f112400b410 tx=0x7f112400b8d0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 shutdown_connections 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1118068380 0x7f111806a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f113c15ac30 0x7f113c071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113c0d38c0 0x7f113c070cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 --2- 172.21.15.39:0/1209151851 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f113c0cfd60 0x7f113c150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 >> 172.21.15.39:0/1209151851 conn(0x7f113c0d2da0 msgr2=0x7f113c168670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 shutdown_connections 2024-04-26T23:26:42.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.785+0000 7f113b200640 1 -- 172.21.15.39:0/1209151851 wait complete. 2024-04-26T23:26:42.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.945+0000 7fa774800640 1 Processor -- start 2024-04-26T23:26:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.945+0000 7fa774800640 1 -- start start 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa774800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa76c13f000 0x7fa76c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa774800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 0x7fa76c06f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa774800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c15fe20 con 0x7fa76c0b3df0 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa774800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c06eba0 con 0x7fa76c13f000 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa774800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c160380 con 0x7fa76c0b5e00 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa771e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa76c0b3df0 0x7fa76c0b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47656/0 (socket says 172.21.15.39:47656) 2024-04-26T23:26:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa771e00640 1 -- 172.21.15.39:0/4258624558 learned_addr learned my addr 172.21.15.39:0/4258624558 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa772800640 1 --2- 172.21.15.39:0/4258624558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 0x7fa76c06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa771400640 1 --2- 172.21.15.39:0/4258624558 >> v2:172.21.15.71:3300/0 conn(0x7fa76c13f000 0x7fa76c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa770a00640 1 -- 172.21.15.39:0/4258624558 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661571680 0 0) 0x7fa760001120 con 0x7fa76c0b3df0 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa770a00640 1 -- 172.21.15.39:0/4258624558 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa754003530 con 0x7fa76c0b3df0 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa772800640 1 -- 172.21.15.39:0/4258624558 >> v2:172.21.15.71:3300/0 conn(0x7fa76c13f000 msgr2=0x7fa76c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa772800640 1 --2- 172.21.15.39:0/4258624558 >> v2:172.21.15.71:3300/0 conn(0x7fa76c13f000 0x7fa76c0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa772800640 1 -- 172.21.15.39:0/4258624558 >> v1:172.21.15.39:6789/0 conn(0x7fa76c0b3df0 legacy=0x7fa76c0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.949+0000 7fa772800640 1 -- 172.21.15.39:0/4258624558 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c15f1d0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa772800640 1 --2- 172.21.15.39:0/4258624558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 0x7fa76c06f030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa768009d90 tx=0x7fa76801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6dff6e3786e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa770a00640 1 -- 172.21.15.39:0/4258624558 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b2070 con 0x7fa76c0b5e00 2024-04-26T23:26:42.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa770a00640 1 -- 172.21.15.39:0/4258624558 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7680a5810 con 0x7fa76c0b5e00 2024-04-26T23:26:42.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa770a00640 1 -- 172.21.15.39:0/4258624558 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680a5be0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 -- 172.21.15.39:0/4258624558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 msgr2=0x7fa76c06f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 --2- 172.21.15.39:0/4258624558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 0x7fa76c06f030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa768009d90 tx=0x7fa76801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 -- 172.21.15.39:0/4258624558 shutdown_connections 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 --2- 172.21.15.39:0/4258624558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b5e00 0x7fa76c06f030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 --2- 172.21.15.39:0/4258624558 >> v2:172.21.15.71:3300/0 conn(0x7fa76c13f000 0x7fa76c0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 -- 172.21.15.39:0/4258624558 >> 172.21.15.39:0/4258624558 conn(0x7fa76c0b2af0 msgr2=0x7fa76c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 -- 172.21.15.39:0/4258624558 shutdown_connections 2024-04-26T23:26:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.953+0000 7fa774800640 1 -- 172.21.15.39:0/4258624558 wait complete. 2024-04-26T23:26:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 Processor -- start 2024-04-26T23:26:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- start start 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 0x7fa76c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 0x7fa76c142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c06f6f0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c06f570 con 0x7fa76c13f000 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c06f870 con 0x7fa76c0b3df0 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46944/0 (socket says 172.21.15.39:46944) 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 -- 172.21.15.39:0/451891535 learned_addr learned my addr 172.21.15.39:0/451891535 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa772800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 0x7fa76c142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771e00640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 0x7fa76c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 -- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 msgr2=0x7fa76c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 0x7fa76c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 -- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 msgr2=0x7fa76c142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 0x7fa76c142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 -- 172.21.15.39:0/451891535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c1fc1e0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa772800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 0x7fa76c142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771e00640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 0x7fa76c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa771400640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e6e0 tx=0x7fa75c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c016070 con 0x7fa76c0b5e00 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c00ca30 con 0x7fa76c0b5e00 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c1fc4c0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00b040 con 0x7fa76c0b5e00 2024-04-26T23:26:42.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.957+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c1595d0 con 0x7fa76c0b5e00 2024-04-26T23:26:42.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c050740 con 0x7fa76c0b5e00 2024-04-26T23:26:42.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa75c019070 con 0x7fa76c0b5e00 2024-04-26T23:26:42.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa766000640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 0x7fa75006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:42.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa75c086820 con 0x7fa76c0b5e00 2024-04-26T23:26:42.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa771e00640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 0x7fa75006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:42.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.961+0000 7fa771e00640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 0x7fa75006a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7600012c0 tx=0x7fa760009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:42.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:42.965+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa75c056dd0 con 0x7fa76c0b5e00 2024-04-26T23:26:43.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.133+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa76c0ce1e0 con 0x7fa76c0b5e00 2024-04-26T23:26:43.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.133+0000 7fa766000640 1 -- 172.21.15.39:0/451891535 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7fa75c0566d0 con 0x7fa76c0b5e00 2024-04-26T23:26:43.139 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:43.139 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 msgr2=0x7fa75006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 0x7fa75006a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7600012c0 tx=0x7fa760009040 comp rx=0 tx=0).stop 2024-04-26T23:26:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 msgr2=0x7fa76c1fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e6e0 tx=0x7fa75c00eba0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 shutdown_connections 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa750068380 0x7fa75006a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa76c13f000 0x7fa76c142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa76c0b5e00 0x7fa76c1fb890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 --2- 172.21.15.39:0/451891535 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa76c0b3df0 0x7fa76c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 >> 172.21.15.39:0/451891535 conn(0x7fa76c0b2af0 msgr2=0x7fa76c15f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 shutdown_connections 2024-04-26T23:26:43.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.137+0000 7fa774800640 1 -- 172.21.15.39:0/451891535 wait complete. 2024-04-26T23:26:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:43.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:43.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.301+0000 7f336f400640 1 Processor -- start 2024-04-26T23:26:43.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.301+0000 7f336f400640 1 -- start start 2024-04-26T23:26:43.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.301+0000 7f336f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f336815ce60 0x7f33680b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f336815d240 0x7f33680b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f33680b1b90 0x7f33680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336f400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f33680b2000 con 0x7f33680b1b90 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336f400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f33680ae040 con 0x7f336815d240 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336f400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3368163f40 con 0x7f336815ce60 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f33680b1b90 0x7f33680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f33680b1b90 0x7f33680cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46948/0 (socket says 172.21.15.39:46948) 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 -- 172.21.15.39:0/1950627663 learned_addr learned my addr 172.21.15.39:0/1950627663 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336ca00640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f336815ce60 0x7f33680b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f335fe00640 1 --2- 172.21.15.39:0/1950627663 >> v2:172.21.15.71:3300/0 conn(0x7f336815d240 0x7f33680b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 -- 172.21.15.39:0/1950627663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f336815ce60 msgr2=0x7f33680b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f336815ce60 0x7f33680b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 -- 172.21.15.39:0/1950627663 >> v2:172.21.15.71:3300/0 conn(0x7f336815d240 msgr2=0x7f33680b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 --2- 172.21.15.39:0/1950627663 >> v2:172.21.15.71:3300/0 conn(0x7f336815d240 0x7f33680b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 -- 172.21.15.39:0/1950627663 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336815fc00 con 0x7f33680b1b90 2024-04-26T23:26:43.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.305+0000 7f336d400640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33680b1b90 0x7f33680cdc00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3368070f60 tx=0x7f336001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1af2c3b6048b3af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f3367e00640 1 -- 172.21.15.39:0/1950627663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600a64b0 con 0x7f33680b1b90 2024-04-26T23:26:43.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f3367e00640 1 -- 172.21.15.39:0/1950627663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33600a6650 con 0x7f33680b1b90 2024-04-26T23:26:43.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f3367e00640 1 -- 172.21.15.39:0/1950627663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600a6a20 con 0x7f33680b1b90 2024-04-26T23:26:43.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- 172.21.15.39:0/1950627663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33680b1b90 msgr2=0x7f33680cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33680b1b90 0x7f33680cdc00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3368070f60 tx=0x7f336001c730 comp rx=0 tx=0).stop 2024-04-26T23:26:43.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- 172.21.15.39:0/1950627663 shutdown_connections 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33680b1b90 0x7f33680cdc00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- 172.21.15.39:0/1950627663 >> v2:172.21.15.71:3300/0 conn(0x7f336815d240 0x7f33680b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- 172.21.15.39:0/1950627663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f336815ce60 0x7f33680b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- 172.21.15.39:0/1950627663 >> 172.21.15.39:0/1950627663 conn(0x7f33680b65c0 msgr2=0x7f33680b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- 172.21.15.39:0/1950627663 shutdown_connections 2024-04-26T23:26:43.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- 172.21.15.39:0/1950627663 wait complete. 2024-04-26T23:26:43.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 Processor -- start 2024-04-26T23:26:43.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- start start 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33680b1b90 0x7f33680b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 0x7f336815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33680b0d60 con 0x7f336815ce60 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33681609c0 con 0x7f336815d240 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336f400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3368163af0 con 0x7f33680b1b90 2024-04-26T23:26:43.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f335fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f335fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46960/0 (socket says 172.21.15.39:46960) 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f335fe00640 1 -- 172.21.15.39:0/4098673213 learned_addr learned my addr 172.21.15.39:0/4098673213 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f335fe00640 1 -- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33680b1b90 msgr2=0x7f33680b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f336ca00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33680b1b90 0x7f33680b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.309+0000 7f335fe00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33680b1b90 0x7f33680b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f335fe00640 1 -- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 msgr2=0x7f336815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336d400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 0x7f336815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f335fe00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 0x7f336815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f335fe00640 1 -- 172.21.15.39:0/4098673213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336815f920 con 0x7f336815ce60 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336d400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 0x7f336815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f335fe00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f335000e930 tx=0x7f335000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350017070 con 0x7f336815ce60 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335000ca00 con 0x7f336815ce60 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335000cdb0 con 0x7f336815ce60 2024-04-26T23:26:43.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3368162440 con 0x7f336815ce60 2024-04-26T23:26:43.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33680cfcf0 con 0x7f336815ce60 2024-04-26T23:26:43.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336806a720 con 0x7f336815ce60 2024-04-26T23:26:43.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f335001a070 con 0x7f336815ce60 2024-04-26T23:26:43.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 0x7f334406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3350086a30 con 0x7f336815ce60 2024-04-26T23:26:43.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.313+0000 7f336ca00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 0x7f334406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.317+0000 7f336ca00640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 0x7f334406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33680b05d0 tx=0x7f3358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.317+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f33500570a0 con 0x7f336815ce60 2024-04-26T23:26:43.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33680cd4e0 con 0x7f336815ce60 2024-04-26T23:26:43.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f3365600640 1 -- 172.21.15.39:0/4098673213 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f33500569a0 con 0x7f336815ce60 2024-04-26T23:26:43.489 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 msgr2=0x7f334406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 0x7f334406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33680b05d0 tx=0x7f3358008040 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 msgr2=0x7f33680d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f335000e930 tx=0x7f335000edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 shutdown_connections 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3344068380 0x7f334406a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f336815d240 0x7f336815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f336815ce60 0x7f33680d1830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 --2- 172.21.15.39:0/4098673213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33680b1b90 0x7f33680b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 >> 172.21.15.39:0/4098673213 conn(0x7f33680b65c0 msgr2=0x7f33680aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 shutdown_connections 2024-04-26T23:26:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.485+0000 7f336f400640 1 -- 172.21.15.39:0/4098673213 wait complete. 2024-04-26T23:26:43.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:43.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.649+0000 7fd463e00640 1 Processor -- start 2024-04-26T23:26:43.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.649+0000 7fd463e00640 1 -- start start 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4640b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd46406cae0 0x7fd46415f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640b5700 con 0x7fd4640742f0 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd46415d180 con 0x7fd46406cae0 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd464162e80 con 0x7fd46415cda0 2024-04-26T23:26:43.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd45be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd4640742f0 0x7fd46406c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47658/0 (socket says 172.21.15.39:47658) 2024-04-26T23:26:43.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd45be00640 1 -- 172.21.15.39:0/1381598597 learned_addr learned my addr 172.21.15.39:0/1381598597 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:43.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463400640 1 --2- 172.21.15.39:0/1381598597 >> v2:172.21.15.71:3300/0 conn(0x7fd46406cae0 0x7fd46415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4640b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87766814 0 0) 0x7fd4640b5700 con 0x7fd4640742f0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd448003530 con 0x7fd4640742f0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699456190 0 0) 0x7fd448003530 con 0x7fd4640742f0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 msgr2=0x7fd4640b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4640b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 >> v2:172.21.15.71:3300/0 conn(0x7fd46406cae0 msgr2=0x7fd46415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 --2- 172.21.15.39:0/1381598597 >> v2:172.21.15.71:3300/0 conn(0x7fd46406cae0 0x7fd46415f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd464163160 con 0x7fd4640742f0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fd44c001680 con 0x7fd4640742f0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 >> v1:172.21.15.39:6789/0 conn(0x7fd4640742f0 legacy=0x7fd46406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4480039c0 0x7fd448003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd448004810 0x7fd448004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd46415d180 con 0x7fd4480039c0 2024-04-26T23:26:43.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd464162e80 con 0x7fd448004810 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd44800ba50 con 0x7fd46415cda0 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4480039c0 0x7fd448003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd45be00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd448004810 0x7fd448004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd463400640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 -- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 msgr2=0x7fd4480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd46415cda0 0x7fd4480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 -- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd448004810 msgr2=0x7fd448004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd448004810 0x7fd448004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.653+0000 7fd462a00640 1 -- 172.21.15.39:0/1381598597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd448003530 con 0x7fd4480039c0 2024-04-26T23:26:43.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd462a00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4480039c0 0x7fd448003de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd454009ae0 tx=0x7fd45401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f466dedd4cf568 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4540096b0 con 0x7fd4480039c0 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4540a64a0 con 0x7fd4480039c0 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd462000640 1 -- 172.21.15.39:0/1381598597 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4540a6890 con 0x7fd4480039c0 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- 172.21.15.39:0/1381598597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4480039c0 msgr2=0x7fd448003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 --2- 172.21.15.39:0/1381598597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4480039c0 0x7fd448003de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd454009ae0 tx=0x7fd45401ca70 comp rx=0 tx=0).stop 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463400640 1 -- 172.21.15.39:0/1381598597 reap_dead start 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- 172.21.15.39:0/1381598597 shutdown_connections 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- 172.21.15.39:0/1381598597 >> 172.21.15.39:0/1381598597 conn(0x7fd46406d4e0 msgr2=0x7fd46406d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- 172.21.15.39:0/1381598597 shutdown_connections 2024-04-26T23:26:43.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- 172.21.15.39:0/1381598597 wait complete. 2024-04-26T23:26:43.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 Processor -- start 2024-04-26T23:26:43.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.657+0000 7fd463e00640 1 -- start start 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4480039c0 0x7fd4640b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd4640d0800 0x7fd4640d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd464160000 con 0x7fd4640b45f0 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd46415fe80 con 0x7fd4480039c0 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd464160180 con 0x7fd4640d0800 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46976/0 (socket says 172.21.15.39:46976) 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 -- 172.21.15.39:0/3214265350 learned_addr learned my addr 172.21.15.39:0/3214265350 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463400640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd4640d0800 0x7fd4640d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd462a00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4480039c0 0x7fd4640b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 -- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd4640d0800 msgr2=0x7fd4640d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd4640d0800 0x7fd4640d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 -- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4480039c0 msgr2=0x7fd4640b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4480039c0 0x7fd4640b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 -- 172.21.15.39:0/3214265350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46415ae50 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45be00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00e7b0 tx=0x7fd44c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00c6c0 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c018070 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00caa0 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46415b0f0 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46415b6b0 con 0x7fd4640b45f0 2024-04-26T23:26:43.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.661+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4640506d0 con 0x7fd4640b45f0 2024-04-26T23:26:43.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.665+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd44c00cc40 con 0x7fd4640b45f0 2024-04-26T23:26:43.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.665+0000 7fd45b400640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 0x7fd44006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:43.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.665+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd44c086320 con 0x7fd4640b45f0 2024-04-26T23:26:43.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.665+0000 7fd462a00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 0x7fd44006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:43.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.665+0000 7fd462a00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 0x7fd44006a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ad000 tx=0x7fd4540b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:43.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.669+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd44c056280 con 0x7fd4640b45f0 2024-04-26T23:26:43.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.833+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd4640739f0 con 0x7fd4640b45f0 2024-04-26T23:26:43.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd45b400640 1 -- 172.21.15.39:0/3214265350 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd44c05a580 con 0x7fd4640b45f0 2024-04-26T23:26:43.840 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:43.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 msgr2=0x7fd44006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 0x7fd44006a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ad000 tx=0x7fd4540b3040 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 msgr2=0x7fd4640d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00e7b0 tx=0x7fd44c00ec70 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 shutdown_connections 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd4400683b0 0x7fd44006a870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd4640d0800 0x7fd4640d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4640b45f0 0x7fd4640d02c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 --2- 172.21.15.39:0/3214265350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4480039c0 0x7fd4640b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 >> 172.21.15.39:0/3214265350 conn(0x7fd46406d4e0 msgr2=0x7fd464159040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 shutdown_connections 2024-04-26T23:26:43.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:43.837+0000 7fd463e00640 1 -- 172.21.15.39:0/3214265350 wait complete. 2024-04-26T23:26:43.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:44.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 Processor -- start 2024-04-26T23:26:44.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 -- start start 2024-04-26T23:26:44.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2300d18f0 0x7fc2300d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23006e500 con 0x7fc230161850 2024-04-26T23:26:44.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23006e7e0 con 0x7fc230140170 2024-04-26T23:26:44.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc237a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc23006f110 con 0x7fc2300d18f0 2024-04-26T23:26:44.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc227e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc230161850 0x7fc2300d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47668/0 (socket says 172.21.15.39:47668) 2024-04-26T23:26:44.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc235a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2300d18f0 0x7fc2300d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.001+0000 7fc227e00640 1 -- 172.21.15.39:0/1823399616 learned_addr learned my addr 172.21.15.39:0/1823399616 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:44.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc235a00640 1 -- 172.21.15.39:0/1823399616 >> v1:172.21.15.71:6789/0 conn(0x7fc230140170 legacy=0x7fc23015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc235a00640 1 -- 172.21.15.39:0/1823399616 >> v1:172.21.15.39:6789/0 conn(0x7fc230161850 legacy=0x7fc2300d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc235a00640 1 -- 172.21.15.39:0/1823399616 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23006eac0 con 0x7fc2300d18f0 2024-04-26T23:26:44.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc235a00640 1 --2- 172.21.15.39:0/1823399616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc2300d0700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc228009d90 tx=0x7fc22801d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca8a1c8938b0b57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc22fe00640 1 -- 172.21.15.39:0/1823399616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2280b2070 con 0x7fc2300d18f0 2024-04-26T23:26:44.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc22fe00640 1 -- 172.21.15.39:0/1823399616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2280a5990 con 0x7fc2300d18f0 2024-04-26T23:26:44.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc22fe00640 1 -- 172.21.15.39:0/1823399616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2280a5d60 con 0x7fc2300d18f0 2024-04-26T23:26:44.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc237a00640 1 -- 172.21.15.39:0/1823399616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 msgr2=0x7fc2300d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.005+0000 7fc237a00640 1 --2- 172.21.15.39:0/1823399616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc2300d0700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc228009d90 tx=0x7fc22801d310 comp rx=0 tx=0).stop 2024-04-26T23:26:44.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- 172.21.15.39:0/1823399616 shutdown_connections 2024-04-26T23:26:44.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 --2- 172.21.15.39:0/1823399616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc2300d0700 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- 172.21.15.39:0/1823399616 >> 172.21.15.39:0/1823399616 conn(0x7fc23006c7d0 msgr2=0x7fc23006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:44.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- 172.21.15.39:0/1823399616 shutdown_connections 2024-04-26T23:26:44.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- 172.21.15.39:0/1823399616 wait complete. 2024-04-26T23:26:44.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 Processor -- start 2024-04-26T23:26:44.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- start start 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc230140170 0x7fc23013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 0x7fc230162f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc23016ab50 con 0x7fc2300d18f0 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc23016a9d0 con 0x7fc230161850 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc237a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc23016acd0 con 0x7fc230140170 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47000/0 (socket says 172.21.15.39:47000) 2024-04-26T23:26:44.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 -- 172.21.15.39:0/56524616 learned_addr learned my addr 172.21.15.39:0/56524616 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc227e00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc230140170 0x7fc23013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 0x7fc230162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 -- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc230140170 msgr2=0x7fc23013f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc230140170 0x7fc23013f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 -- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 msgr2=0x7fc230162f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 0x7fc230162f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 -- 172.21.15.39:0/56524616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc230161e70 con 0x7fc2300d18f0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 0x7fc230162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.009+0000 7fc235000640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c500 tx=0x7fc22000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220016020 con 0x7fc2300d18f0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc220005220 con 0x7fc2300d18f0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220007030 con 0x7fc2300d18f0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc230162150 con 0x7fc2300d18f0 2024-04-26T23:26:44.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc230162710 con 0x7fc2300d18f0 2024-04-26T23:26:44.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23006a720 con 0x7fc2300d18f0 2024-04-26T23:26:44.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2200071f0 con 0x7fc2300d18f0 2024-04-26T23:26:44.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 0x7fc20c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc220086370 con 0x7fc2300d18f0 2024-04-26T23:26:44.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.013+0000 7fc227e00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 0x7fc20c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.017+0000 7fc227e00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 0x7fc20c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc230164e60 tx=0x7fc218009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.017+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc220020020 con 0x7fc2300d18f0 2024-04-26T23:26:44.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.185+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc23006fdc0 con 0x7fc2300d18f0 2024-04-26T23:26:44.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.185+0000 7fc22d600640 1 -- 172.21.15.39:0/56524616 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc2200568a0 con 0x7fc2300d18f0 2024-04-26T23:26:44.190 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 msgr2=0x7fc20c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 0x7fc20c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc230164e60 tx=0x7fc218009040 comp rx=0 tx=0).stop 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 msgr2=0x7fc230165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c500 tx=0x7fc22000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 shutdown_connections 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc20c0683b0 0x7fc20c06a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc230161850 0x7fc230162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc230140170 0x7fc23013f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 --2- 172.21.15.39:0/56524616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2300d18f0 0x7fc230165070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 >> 172.21.15.39:0/56524616 conn(0x7fc23006c7d0 msgr2=0x7fc23015de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 shutdown_connections 2024-04-26T23:26:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.189+0000 7fc237a00640 1 -- 172.21.15.39:0/56524616 wait complete. 2024-04-26T23:26:44.356 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-04-26T23:26:44.356 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:26:44.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.493+0000 7f85da000640 1 Processor -- start 2024-04-26T23:26:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.493+0000 7f85da000640 1 -- start start 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85da000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85da000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f85d40cfe00 0x7f85d4144050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85da000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d4144590 con 0x7f85d40cdbf0 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85da000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f85d40d0b10 con 0x7f85d40cfe00 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85da000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85d406e970 con 0x7f85d40cd810 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f85d40cfe00 0x7f85d4144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d3e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f85d40cdbf0 0x7f85d406ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47676/0 (socket says 172.21.15.39:47676) 2024-04-26T23:26:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d3e00640 1 -- 172.21.15.39:0/3214299597 learned_addr learned my addr 172.21.15.39:0/3214299597 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 -- 172.21.15.39:0/3214299597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 msgr2=0x7f85d40742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d3400640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d2a00640 1 -- 172.21.15.39:0/3214299597 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537549372 0 0) 0x7f85d4144590 con 0x7f85d40cdbf0 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 -- 172.21.15.39:0/3214299597 >> v1:172.21.15.39:6789/0 conn(0x7f85d40cdbf0 legacy=0x7f85d406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 -- 172.21.15.39:0/3214299597 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40d0550 con 0x7f85d40cfe00 2024-04-26T23:26:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d3400640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85caa00640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cfe00 0x7f85d4144050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0097c0 tx=0x7f85bc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abe6b380be9f974 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.497+0000 7f85d2a00640 1 -- 172.21.15.39:0/3214299597 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ab610 con 0x7f85d40cfe00 2024-04-26T23:26:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85d2a00640 1 -- 172.21.15.39:0/3214299597 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0b0070 con 0x7f85d40cfe00 2024-04-26T23:26:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85d2a00640 1 -- 172.21.15.39:0/3214299597 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ab9d0 con 0x7f85d40cfe00 2024-04-26T23:26:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- 172.21.15.39:0/3214299597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cfe00 msgr2=0x7f85d4144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cfe00 0x7f85d4144050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0097c0 tx=0x7f85bc01c410 comp rx=0 tx=0).stop 2024-04-26T23:26:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- 172.21.15.39:0/3214299597 shutdown_connections 2024-04-26T23:26:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cfe00 0x7f85d4144050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- 172.21.15.39:0/3214299597 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- 172.21.15.39:0/3214299597 >> 172.21.15.39:0/3214299597 conn(0x7f85d40b2af0 msgr2=0x7f85d40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- 172.21.15.39:0/3214299597 shutdown_connections 2024-04-26T23:26:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- 172.21.15.39:0/3214299597 wait complete. 2024-04-26T23:26:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 Processor -- start 2024-04-26T23:26:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- start start 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d40cfe00 0x7f85d4160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40ce040 con 0x7f85d40cdbf0 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85d406f920 con 0x7f85d40cfe00 2024-04-26T23:26:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85da000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40ce1c0 con 0x7f85d40cd810 2024-04-26T23:26:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85caa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85caa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47008/0 (socket says 172.21.15.39:47008) 2024-04-26T23:26:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85caa00640 1 -- 172.21.15.39:0/3821164093 learned_addr learned my addr 172.21.15.39:0/3821164093 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85d3e00640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d40cfe00 0x7f85d4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85d3400640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85caa00640 1 -- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 msgr2=0x7f85d40af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.501+0000 7f85caa00640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85caa00640 1 -- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d40cfe00 msgr2=0x7f85d4160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85caa00640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d40cfe00 0x7f85d4160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85caa00640 1 -- 172.21.15.39:0/3821164093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d415dd00 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85caa00640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01a040 tx=0x7f85bc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0bf610 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0bf7d0 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0bfbc0 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d40b0100 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d415aba0 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d4050740 con 0x7f85d40cdbf0 2024-04-26T23:26:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85bc0bd020 con 0x7f85d40cdbf0 2024-04-26T23:26:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 0x7f85b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85bc121480 con 0x7f85d40cdbf0 2024-04-26T23:26:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.505+0000 7f85d3400640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 0x7f85b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.509+0000 7f85d3400640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 0x7f85b006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f85c400a9a0 tx=0x7f85c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.509+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f85d40b0100 con 0x7f85d40cdbf0 2024-04-26T23:26:44.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.677+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85d4143060 con 0x7f85d40cdbf0 2024-04-26T23:26:44.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.677+0000 7f85cbe00640 1 -- 172.21.15.39:0/3821164093 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f85bc0a8050 con 0x7f85d40cdbf0 2024-04-26T23:26:44.682 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:44.683 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 msgr2=0x7f85b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 0x7f85b006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f85c400a9a0 tx=0x7f85c4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 msgr2=0x7f85d415ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01a040 tx=0x7f85bc01ac50 comp rx=0 tx=0).stop 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 shutdown_connections 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85b0068380 0x7f85b006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d40cfe00 0x7f85d4160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d40cdbf0 0x7f85d415ff40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 --2- 172.21.15.39:0/3821164093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85d40cd810 0x7f85d40af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 >> 172.21.15.39:0/3821164093 conn(0x7f85d40b2af0 msgr2=0x7f85d41422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 shutdown_connections 2024-04-26T23:26:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.681+0000 7f85da000640 1 -- 172.21.15.39:0/3821164093 wait complete. 2024-04-26T23:26:44.704 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:44.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:44.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 Processor -- start 2024-04-26T23:26:44.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 -- start start 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1e81458d0 0x7fa1e80b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e8072180 con 0x7fa1e8073400 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80739a0 con 0x7fa1e81458d0 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1ee200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e8073c80 con 0x7fa1e80ce5e0 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1e81458d0 0x7fa1e80b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1e81458d0 0x7fa1e80b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47012/0 (socket says 172.21.15.39:47012) 2024-04-26T23:26:44.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 -- 172.21.15.39:0/666706831 learned_addr learned my addr 172.21.15.39:0/666706831 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7e00640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 -- 172.21.15.39:0/666706831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 msgr2=0x7fa1e80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 -- 172.21.15.39:0/666706831 >> v1:172.21.15.71:6789/0 conn(0x7fa1e8073400 legacy=0x7fa1e8072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7400640 1 -- 172.21.15.39:0/666706831 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e8145cb0 con 0x7fa1e81458d0 2024-04-26T23:26:44.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.845+0000 7fa1e7e00640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:44.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1e7400640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b4890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009870 tx=0x7fa1d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbe309c0bdb99e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1e6a00640 1 -- 172.21.15.39:0/666706831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80b2070 con 0x7fa1e81458d0 2024-04-26T23:26:44.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1e6a00640 1 -- 172.21.15.39:0/666706831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d80a9070 con 0x7fa1e81458d0 2024-04-26T23:26:44.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1e6a00640 1 -- 172.21.15.39:0/666706831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80ad880 con 0x7fa1e81458d0 2024-04-26T23:26:44.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 -- 172.21.15.39:0/666706831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 msgr2=0x7fa1e80b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b4890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009870 tx=0x7fa1d801c490 comp rx=0 tx=0).stop 2024-04-26T23:26:44.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 -- 172.21.15.39:0/666706831 shutdown_connections 2024-04-26T23:26:44.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 --2- 172.21.15.39:0/666706831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b4890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 -- 172.21.15.39:0/666706831 >> 172.21.15.39:0/666706831 conn(0x7fa1e806c7d0 msgr2=0x7fa1e806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:44.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 -- 172.21.15.39:0/666706831 shutdown_connections 2024-04-26T23:26:44.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.849+0000 7fa1ee200640 1 -- 172.21.15.39:0/666706831 wait complete. 2024-04-26T23:26:44.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 Processor -- start 2024-04-26T23:26:44.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- start start 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e8073400 0x7fa1e81f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e813e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81690c0 con 0x7fa1e81458d0 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e8168f40 con 0x7fa1e8073400 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e8169240 con 0x7fa1e80ce5e0 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47020/0 (socket says 172.21.15.39:47020) 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 -- 172.21.15.39:0/148945077 learned_addr learned my addr 172.21.15.39:0/148945077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7400640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e8073400 0x7fa1e81f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1dea00640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e813e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 -- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 msgr2=0x7fa1e813e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e813e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 -- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e8073400 msgr2=0x7fa1e81f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:44.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e8073400 0x7fa1e81f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:44.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 -- 172.21.15.39:0/148945077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80d18e0 con 0x7fa1e81458d0 2024-04-26T23:26:44.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1e7e00640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000cef0 tx=0x7fa1e000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e001a070 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e000d860 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000dc50 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e813ef30 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e815c730 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.853+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e806a720 con 0x7fa1e81458d0 2024-04-26T23:26:44.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.857+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1e001d070 con 0x7fa1e81458d0 2024-04-26T23:26:44.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.857+0000 7fa1dfe00640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:44.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.857+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1e00871e0 con 0x7fa1e81458d0 2024-04-26T23:26:44.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.857+0000 7fa1e7400640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:44.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.857+0000 7fa1e7400640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80af000 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:44.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:44.861+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa1e0057200 con 0x7fa1e81458d0 2024-04-26T23:26:45.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.025+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1e80b50b0 con 0x7fa1e81458d0 2024-04-26T23:26:45.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.025+0000 7fa1dfe00640 1 -- 172.21.15.39:0/148945077 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa1e005b500 con 0x7fa1e81458d0 2024-04-26T23:26:45.031 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 msgr2=0x7fa1c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80af000 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 msgr2=0x7fa1e80b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000cef0 tx=0x7fa1e000a710 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 shutdown_connections 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1e81458d0 0x7fa1e80b27b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa1e80ce5e0 0x7fa1e813e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 --2- 172.21.15.39:0/148945077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1e8073400 0x7fa1e81f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 >> 172.21.15.39:0/148945077 conn(0x7fa1e806c7d0 msgr2=0x7fa1e80b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 shutdown_connections 2024-04-26T23:26:45.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.029+0000 7fa1ee200640 1 -- 172.21.15.39:0/148945077 wait complete. 2024-04-26T23:26:45.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:45.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 Processor -- start 2024-04-26T23:26:45.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 -- start start 2024-04-26T23:26:45.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8888073dd0 0x7f8888161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88880cc910 0x7f88880741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88880746f0 con 0x7f88880cb660 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8888161a40 con 0x7f88880cc910 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f88880ccdd0 con 0x7f8888073dd0 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88880cc910 0x7f88880741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88880cc910 0x7f88880741b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47022/0 (socket says 172.21.15.39:47022) 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 -- 172.21.15.39:0/4019743873 learned_addr learned my addr 172.21.15.39:0/4019743873 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f888d200640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8888073dd0 0x7f8888161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 -- 172.21.15.39:0/4019743873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8888073dd0 msgr2=0x7f8888161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8888073dd0 0x7f8888161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 -- 172.21.15.39:0/4019743873 >> v1:172.21.15.71:6789/0 conn(0x7f88880cb660 legacy=0x7f88880cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.193+0000 7f887fe00640 1 -- 172.21.15.39:0/4019743873 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88880cd0b0 con 0x7f88880cc910 2024-04-26T23:26:45.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f887fe00640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880741b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8870009870 tx=0x7f887001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489b496c7377d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f8887e00640 1 -- 172.21.15.39:0/4019743873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b1070 con 0x7f88880cc910 2024-04-26T23:26:45.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f8887e00640 1 -- 172.21.15.39:0/4019743873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700ac620 con 0x7f88880cc910 2024-04-26T23:26:45.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f8887e00640 1 -- 172.21.15.39:0/4019743873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700ac9f0 con 0x7f88880cc910 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 -- 172.21.15.39:0/4019743873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 msgr2=0x7f88880741b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880741b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8870009870 tx=0x7f887001c4d0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 -- 172.21.15.39:0/4019743873 shutdown_connections 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880741b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 --2- 172.21.15.39:0/4019743873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8888073dd0 0x7f8888161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 -- 172.21.15.39:0/4019743873 >> 172.21.15.39:0/4019743873 conn(0x7f88880d1010 msgr2=0x7f88880d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 -- 172.21.15.39:0/4019743873 shutdown_connections 2024-04-26T23:26:45.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.197+0000 7f888e600640 1 -- 172.21.15.39:0/4019743873 wait complete. 2024-04-26T23:26:45.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 Processor -- start 2024-04-26T23:26:45.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- start start 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888073dd0 0x7f888815ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88880cb660 0x7f888815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f88880728b0 con 0x7f88880cc910 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8888072730 con 0x7f8888073dd0 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f888816a6a0 con 0x7f88880cb660 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47024/0 (socket says 172.21.15.39:47024) 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 -- 172.21.15.39:0/70565809 learned_addr learned my addr 172.21.15.39:0/70565809 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888d200640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888073dd0 0x7f888815ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f887fe00640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88880cb660 0x7f888815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 -- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88880cb660 msgr2=0x7f888815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88880cb660 0x7f888815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 -- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888073dd0 msgr2=0x7f888815ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888073dd0 0x7f888815ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 -- 172.21.15.39:0/70565809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88880b3da0 con 0x7f88880cc910 2024-04-26T23:26:45.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888dc00640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f888000c730 tx=0x7f888000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880003b80 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880003d20 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000aa30 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88880b4080 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88880b4640 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.201+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88880506d0 con 0x7f88880cc910 2024-04-26T23:26:45.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.205+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f888000abd0 con 0x7f88880cc910 2024-04-26T23:26:45.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.205+0000 7f8885600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 0x7f886406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.205+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8880086710 con 0x7f88880cc910 2024-04-26T23:26:45.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.205+0000 7f888d200640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 0x7f886406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.205+0000 7f888d200640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 0x7f886406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88780079c0 tx=0x7f8878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.209+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8880056670 con 0x7f88880cc910 2024-04-26T23:26:45.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.373+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f88880cbe40 con 0x7f88880cc910 2024-04-26T23:26:45.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.373+0000 7f8885600640 1 -- 172.21.15.39:0/70565809 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f888005a970 con 0x7f88880cc910 2024-04-26T23:26:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:45.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 msgr2=0x7f886406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 0x7f886406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88780079c0 tx=0x7f8878008040 comp rx=0 tx=0).stop 2024-04-26T23:26:45.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 msgr2=0x7f88880cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f888000c730 tx=0x7f888000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 shutdown_connections 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8864068380 0x7f886406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88880cc910 0x7f88880cebc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88880cb660 0x7f888815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 --2- 172.21.15.39:0/70565809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888073dd0 0x7f888815ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 >> 172.21.15.39:0/70565809 conn(0x7f88880d1010 msgr2=0x7f88880b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 shutdown_connections 2024-04-26T23:26:45.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.377+0000 7f888e600640 1 -- 172.21.15.39:0/70565809 wait complete. 2024-04-26T23:26:45.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:45.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.537+0000 7f9f7d400640 1 Processor -- start 2024-04-26T23:26:45.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.537+0000 7f9f7d400640 1 -- start start 2024-04-26T23:26:45.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f7d400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f7806d4e0 0x7f9f7806d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f7d400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f7d400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7806dfa0 con 0x7f9f780cf8c0 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f7d400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7806e280 con 0x7f9f7806d4e0 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f7d400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7806e560 con 0x7f9f780d10d0 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f7806d4e0 0x7f9f7806d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f7806d4e0 0x7f9f7806d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47038/0 (socket says 172.21.15.39:47038) 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 -- 172.21.15.39:0/3121480015 learned_addr learned my addr 172.21.15.39:0/3121480015 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f77200640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 -- 172.21.15.39:0/3121480015 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 msgr2=0x7f9f780d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 -- 172.21.15.39:0/3121480015 >> v1:172.21.15.71:6789/0 conn(0x7f9f780cf8c0 legacy=0x7f9f780cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.541+0000 7f9f6de00640 1 -- 172.21.15.39:0/3121480015 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f780b2ff0 con 0x7f9f7806d4e0 2024-04-26T23:26:45.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f6de00640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f7806d4e0 0x7f9f7806d970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009870 tx=0x7f9f6001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20859211c0859ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f75e00640 1 -- 172.21.15.39:0/3121480015 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600a9610 con 0x7f9f7806d4e0 2024-04-26T23:26:45.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f75e00640 1 -- 172.21.15.39:0/3121480015 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f600a97b0 con 0x7f9f7806d4e0 2024-04-26T23:26:45.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f75e00640 1 -- 172.21.15.39:0/3121480015 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600a9b80 con 0x7f9f7806d4e0 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- 172.21.15.39:0/3121480015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f7806d4e0 msgr2=0x7f9f7806d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f7806d4e0 0x7f9f7806d970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009870 tx=0x7f9f6001c530 comp rx=0 tx=0).stop 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- 172.21.15.39:0/3121480015 shutdown_connections 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 --2- 172.21.15.39:0/3121480015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f7806d4e0 0x7f9f7806d970 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- 172.21.15.39:0/3121480015 >> 172.21.15.39:0/3121480015 conn(0x7f9f780d3040 msgr2=0x7f9f780d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- 172.21.15.39:0/3121480015 shutdown_connections 2024-04-26T23:26:45.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- 172.21.15.39:0/3121480015 wait complete. 2024-04-26T23:26:45.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 Processor -- start 2024-04-26T23:26:45.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 -- start start 2024-04-26T23:26:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.545+0000 7f9f7d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 0x7f9f780b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7816bf10 con 0x7f9f780cf8c0 2024-04-26T23:26:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7815f780 con 0x7f9f7806d4e0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7816c090 con 0x7f9f780d10d0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47052/0 (socket says 172.21.15.39:47052) 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 -- 172.21.15.39:0/2512974417 learned_addr learned my addr 172.21.15.39:0/2512974417 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f76800640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 0x7f9f780b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 -- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 msgr2=0x7f9f780c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f77200640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 -- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 msgr2=0x7f9f780b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 0x7f9f780b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 -- 172.21.15.39:0/2512974417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f780c7cb0 con 0x7f9f780cf8c0 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f77200640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f76800640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 0x7f9f780b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:45.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6de00640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001abe0 tx=0x7f9f600192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600a9610 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f600b9630 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600b9a00 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f780c7f90 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f780c8550 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7806a720 con 0x7f9f780cf8c0 2024-04-26T23:26:45.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.549+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f600b9ba0 con 0x7f9f780cf8c0 2024-04-26T23:26:45.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.553+0000 7f9f6f400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 0x7f9f5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.553+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9f601209d0 con 0x7f9f780cf8c0 2024-04-26T23:26:45.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.553+0000 7f9f76800640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 0x7f9f5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.553+0000 7f9f76800640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 0x7f9f5406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f68007fd0 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.557+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9f600c0030 con 0x7f9f780cf8c0 2024-04-26T23:26:45.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.721+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f780cf680 con 0x7f9f780cf8c0 2024-04-26T23:26:45.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.721+0000 7f9f6f400640 1 -- 172.21.15.39:0/2512974417 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9f600ad020 con 0x7f9f780cf8c0 2024-04-26T23:26:45.726 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:45.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 msgr2=0x7f9f5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 0x7f9f5406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f68007fd0 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 msgr2=0x7f9f7814fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001abe0 tx=0x7f9f600192d0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 shutdown_connections 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9f54068380 0x7f9f5406a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9f780d10d0 0x7f9f780c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f780cf8c0 0x7f9f7814fde0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 --2- 172.21.15.39:0/2512974417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f7806d4e0 0x7f9f780b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 >> 172.21.15.39:0/2512974417 conn(0x7f9f780d3040 msgr2=0x7f9f78150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 shutdown_connections 2024-04-26T23:26:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.725+0000 7f9f7d400640 1 -- 172.21.15.39:0/2512974417 wait complete. 2024-04-26T23:26:45.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-04-26T23:26:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 Processor -- start 2024-04-26T23:26:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 -- start start 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c145820 0x7f954c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f954c06fc80 0x7f954c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954c160060 con 0x7f954c0b4950 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f954c0cd5c0 con 0x7f954c06fc80 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f9551a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f954c160340 con 0x7f954c145820 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f954c06fc80 0x7f954c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f954c06fc80 0x7f954c0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47064/0 (socket says 172.21.15.39:47064) 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 -- 172.21.15.39:0/3048651755 learned_addr learned my addr 172.21.15.39:0/3048651755 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954aa00640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c145820 0x7f954c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 -- 172.21.15.39:0/3048651755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c145820 msgr2=0x7f954c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c145820 0x7f954c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 -- 172.21.15.39:0/3048651755 >> v1:172.21.15.71:6789/0 conn(0x7f954c0b4950 legacy=0x7f954c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.885+0000 7f954b400640 1 -- 172.21.15.39:0/3048651755 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c160620 con 0x7f954c06fc80 2024-04-26T23:26:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f954b400640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c06fc80 0x7f954c0b4d70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e50 tx=0x7f954401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e8e666eb3a0d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f954a000640 1 -- 172.21.15.39:0/3048651755 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440a58f0 con 0x7f954c06fc80 2024-04-26T23:26:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f954a000640 1 -- 172.21.15.39:0/3048651755 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95440a5a90 con 0x7f954c06fc80 2024-04-26T23:26:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f954a000640 1 -- 172.21.15.39:0/3048651755 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440a5e60 con 0x7f954c06fc80 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 -- 172.21.15.39:0/3048651755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c06fc80 msgr2=0x7f954c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c06fc80 0x7f954c0b4d70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e50 tx=0x7f954401ca00 comp rx=0 tx=0).stop 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 -- 172.21.15.39:0/3048651755 shutdown_connections 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c06fc80 0x7f954c0b4d70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 --2- 172.21.15.39:0/3048651755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c145820 0x7f954c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 -- 172.21.15.39:0/3048651755 >> 172.21.15.39:0/3048651755 conn(0x7f954c0b2af0 msgr2=0x7f954c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 -- 172.21.15.39:0/3048651755 shutdown_connections 2024-04-26T23:26:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.889+0000 7f9551a00640 1 -- 172.21.15.39:0/3048651755 wait complete. 2024-04-26T23:26:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 Processor -- start 2024-04-26T23:26:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 -- start start 2024-04-26T23:26:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f954c06fc80 0x7f954c13b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c0b4950 0x7f954c155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0ce260 con 0x7f954c145820 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f954c15fe40 con 0x7f954c06fc80 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f954c0ce3e0 con 0x7f954c0b4950 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f954c06fc80 0x7f954c13b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47070/0 (socket says 172.21.15.39:47070) 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 -- 172.21.15.39:0/136572589 learned_addr learned my addr 172.21.15.39:0/136572589 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9543e00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c0b4950 0x7f954c155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 -- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c0b4950 msgr2=0x7f954c155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c0b4950 0x7f954c155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 -- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f954c06fc80 msgr2=0x7f954c13b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f954c06fc80 0x7f954c13b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 -- 172.21.15.39:0/136572589 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c0b5c70 con 0x7f954c145820 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f954b400640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95440af040 tx=0x7f95440197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440a58f0 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544007c20 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c13a240 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.893+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544009510 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c13a800 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c050740 con 0x7f954c145820 2024-04-26T23:26:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95440c0020 con 0x7f954c145820 2024-04-26T23:26:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f9542a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 0x7f952806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95441219a0 con 0x7f954c145820 2024-04-26T23:26:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.897+0000 7f954aa00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 0x7f952806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.901+0000 7f954aa00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 0x7f952806a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f953c0079c0 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:45.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:45.901+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9544016620 con 0x7f954c145820 2024-04-26T23:26:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.125+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) -- 0x7f954c0cd290 con 0x7f954c145820 2024-04-26T23:26:46.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9542a00640 1 -- 172.21.15.39:0/136572589 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v56) ==== 138+0+0 (secure 0 0 0) 0x7f95440f18a0 con 0x7f954c145820 2024-04-26T23:26:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 msgr2=0x7f952806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 0x7f952806a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f953c0079c0 tx=0x7f953c008040 comp rx=0 tx=0).stop 2024-04-26T23:26:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 msgr2=0x7f954c0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95440af040 tx=0x7f95440197a0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 shutdown_connections 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f95280683b0 0x7f952806a870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f954c145820 0x7f954c0b0990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f954c0b4950 0x7f954c155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 --2- 172.21.15.39:0/136572589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f954c06fc80 0x7f954c13b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 >> 172.21.15.39:0/136572589 conn(0x7f954c0b2af0 msgr2=0x7f954c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 shutdown_connections 2024-04-26T23:26:46.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.189+0000 7f9551a00640 1 -- 172.21.15.39:0/136572589 wait complete. 2024-04-26T23:26:46.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:26:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 Processor -- start 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 -- start start 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 0x7f72800b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7280073400 0x7f7280072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7280072180 con 0x7f7280072e50 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f72800739a0 con 0x7f7280073400 2024-04-26T23:26:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7287e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7280073c80 con 0x7f72801458d0 2024-04-26T23:26:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7285400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 0x7f72800b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7284a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7280073400 0x7f7280072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7285400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 0x7f72800b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:41836/0 (socket says 172.21.15.39:41836) 2024-04-26T23:26:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.357+0000 7f7285400640 1 -- 172.21.15.39:0/2674933281 learned_addr learned my addr 172.21.15.39:0/2674933281 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f7284a00640 1 -- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 msgr2=0x7f72800b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f7284a00640 1 --2- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 0x7f72800b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f7284a00640 1 -- 172.21.15.39:0/2674933281 >> v1:172.21.15.71:6789/0 conn(0x7f7280072e50 legacy=0x7f72800ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f7284a00640 1 -- 172.21.15.39:0/2674933281 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7280145cb0 con 0x7f7280073400 2024-04-26T23:26:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f7284a00640 1 --2- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f7280072910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097f0 tx=0x7f726c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=648b3729cd79dddf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f727fe00640 1 -- 172.21.15.39:0/2674933281 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0b0070 con 0x7f7280073400 2024-04-26T23:26:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f727fe00640 1 -- 172.21.15.39:0/2674933281 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c0ab600 con 0x7f7280073400 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.361+0000 7f727fe00640 1 -- 172.21.15.39:0/2674933281 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0ab9d0 con 0x7f7280073400 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 msgr2=0x7f7280072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f7280072910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097f0 tx=0x7f726c01c410 comp rx=0 tx=0).stop 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- 172.21.15.39:0/2674933281 shutdown_connections 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f7280072910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- 172.21.15.39:0/2674933281 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72801458d0 0x7f72800b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- 172.21.15.39:0/2674933281 >> 172.21.15.39:0/2674933281 conn(0x7f728006c7d0 msgr2=0x7f728006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- 172.21.15.39:0/2674933281 shutdown_connections 2024-04-26T23:26:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- 172.21.15.39:0/2674933281 wait complete. 2024-04-26T23:26:46.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 Processor -- start 2024-04-26T23:26:46.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- start start 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f72800cef00 con 0x7f72801458d0 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7280073260 con 0x7f7280073400 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7287e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7280168f40 con 0x7f7280072e50 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:41844/0 (socket says 172.21.15.39:41844) 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47084/0 (socket says 172.21.15.39:47084) 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285400640 1 -- 172.21.15.39:0/2328235489 learned_addr learned my addr 172.21.15.39:0/2328235489 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:46.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:51810/0 (socket says 172.21.15.39:51810) 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 -- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 msgr2=0x7f72801f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 -- 172.21.15.39:0/2328235489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 msgr2=0x7f728013dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7284a00640 1 -- 172.21.15.39:0/2328235489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728014fd00 con 0x7f7280073400 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.365+0000 7f7285400640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f7284a00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f726c0ab000 tx=0x7f726c0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0b8020 con 0x7f7280073400 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c0b4410 con 0x7f7280073400 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728013e5b0 con 0x7f7280073400 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0b0040 con 0x7f7280073400 2024-04-26T23:26:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72800ae8f0 con 0x7f7280073400 2024-04-26T23:26:46.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728006a720 con 0x7f7280073400 2024-04-26T23:26:46.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f726c0bb020 con 0x7f7280073400 2024-04-26T23:26:46.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 0x7f726006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:46.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.369+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f726c120670 con 0x7f7280073400 2024-04-26T23:26:46.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.373+0000 7f7285400640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 0x7f726006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:46.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.373+0000 7f7285400640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 0x7f726006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7274006f50 tx=0x7f7274009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:46.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.373+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f726c0c2030 con 0x7f7280073400 2024-04-26T23:26:46.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.537+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f728013f0a0 con 0x7f7280073400 2024-04-26T23:26:46.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.545+0000 7f727d600640 1 -- 172.21.15.39:0/2328235489 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f726c016090 con 0x7f7280073400 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 msgr2=0x7f726006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 0x7f726006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7274006f50 tx=0x7f7274009240 comp rx=0 tx=0).stop 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 msgr2=0x7f728014f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f726c0ab000 tx=0x7f726c0191b0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 shutdown_connections 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7260068380 0x7f726006a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72801458d0 0x7f728013dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7280073400 0x7f728014f7c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 --2- 172.21.15.39:0/2328235489 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7280072e50 0x7f72801f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 >> 172.21.15.39:0/2328235489 conn(0x7f728006c7d0 msgr2=0x7f72800753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 shutdown_connections 2024-04-26T23:26:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:46.549+0000 7f7287e00640 1 -- 172.21.15.39:0/2328235489 wait complete. 2024-04-26T23:26:46.573 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:26:46.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:26:46.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:26:46.750 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:26:46.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:46.750 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:46.762 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:46.762 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:46.813 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:46.813 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:46.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:47.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 Processor -- start 2024-04-26T23:26:47.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 -- start start 2024-04-26T23:26:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdfbc1575f0 0x7fdfbc15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc070a70 0x7fdfbc0733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc15d5b0 con 0x7fdfbc073930 2024-04-26T23:26:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fdfbc15dbc0 con 0x7fdfbc1575f0 2024-04-26T23:26:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc1800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc070f00 con 0x7fdfbc070a70 2024-04-26T23:26:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfbbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdfbc1575f0 0x7fdfbc15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc0e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fdfbc073930 0x7fdfbc06d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47690/0 (socket says 172.21.15.39:47690) 2024-04-26T23:26:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfc0e00640 1 -- 172.21.15.39:0/2249403531 learned_addr learned my addr 172.21.15.39:0/2249403531 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfb3400640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc070a70 0x7fdfbc0733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2249403531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc070a70 msgr2=0x7fdfbc0733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:47.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfbbe00640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc070a70 0x7fdfbc0733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2249403531 >> v1:172.21.15.39:6789/0 conn(0x7fdfbc073930 legacy=0x7fdfbc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.045+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2249403531 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc15d850 con 0x7fdfbc1575f0 2024-04-26T23:26:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfbbe00640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15e050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0097c0 tx=0x7fdfac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd32bca247616ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfbb400640 1 -- 172.21.15.39:0/2249403531 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0ab680 con 0x7fdfbc1575f0 2024-04-26T23:26:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfbb400640 1 -- 172.21.15.39:0/2249403531 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac0b0070 con 0x7fdfbc1575f0 2024-04-26T23:26:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfbb400640 1 -- 172.21.15.39:0/2249403531 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0aba40 con 0x7fdfbc1575f0 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 -- 172.21.15.39:0/2249403531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc1575f0 msgr2=0x7fdfbc15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15e050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0097c0 tx=0x7fdfac01c460 comp rx=0 tx=0).stop 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 -- 172.21.15.39:0/2249403531 shutdown_connections 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc070a70 0x7fdfbc0733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2249403531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15e050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 -- 172.21.15.39:0/2249403531 >> 172.21.15.39:0/2249403531 conn(0x7fdfbc072860 msgr2=0x7fdfbc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 -- 172.21.15.39:0/2249403531 shutdown_connections 2024-04-26T23:26:47.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.049+0000 7fdfc1800640 1 -- 172.21.15.39:0/2249403531 wait complete. 2024-04-26T23:26:47.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 Processor -- start 2024-04-26T23:26:47.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- start start 2024-04-26T23:26:47.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc15b6c0 0x7fdfbc159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0d0780 con 0x7fdfbc073930 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0d0600 con 0x7fdfbc1575f0 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc0d0900 con 0x7fdfbc15b6c0 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47098/0 (socket says 172.21.15.39:47098) 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2693521050 learned_addr learned my addr 172.21.15.39:0/2693521050 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc0e00640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc15b6c0 0x7fdfbc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfb3400640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc15b6c0 msgr2=0x7fdfbc159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc15b6c0 0x7fdfbc159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfbc1575f0 msgr2=0x7fdfbc15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 -- 172.21.15.39:0/2693521050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0b4050 con 0x7fdfbc073930 2024-04-26T23:26:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfbbe00640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdfac01ab10 tx=0x7fdfac01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0bf410 con 0x7fdfbc073930 2024-04-26T23:26:47.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac0a7070 con 0x7fdfbc073930 2024-04-26T23:26:47.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0bf810 con 0x7fdfbc073930 2024-04-26T23:26:47.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc15a510 con 0x7fdfbc073930 2024-04-26T23:26:47.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.053+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc0b45d0 con 0x7fdfbc073930 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc0506d0 con 0x7fdfbc073930 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdfac0bd020 con 0x7fdfbc073930 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfb8c00640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 0x7fdf9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdfac120b40 con 0x7fdfbc073930 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfb3400640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 0x7fdf9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.057+0000 7fdfb3400640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 0x7fdf9806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc160610 tx=0x7fdfa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.061+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdfac0c6070 con 0x7fdfbc073930 2024-04-26T23:26:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.229+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfbc0686c0 con 0x7fdfbc073930 2024-04-26T23:26:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.229+0000 7fdfb8c00640 1 -- 172.21.15.39:0/2693521050 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7fdfac016050 con 0x7fdfbc073930 2024-04-26T23:26:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:47.234 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 msgr2=0x7fdf9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 0x7fdf9806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc160610 tx=0x7fdfa4008040 comp rx=0 tx=0).stop 2024-04-26T23:26:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 msgr2=0x7fdfbc149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdfac01ab10 tx=0x7fdfac01aca0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 shutdown_connections 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf98068380 0x7fdf9806a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdfbc15b6c0 0x7fdfbc159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfbc1575f0 0x7fdfbc15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 --2- 172.21.15.39:0/2693521050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfbc073930 0x7fdfbc149f40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 >> 172.21.15.39:0/2693521050 conn(0x7fdfbc072860 msgr2=0x7fdfbc14cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 shutdown_connections 2024-04-26T23:26:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.233+0000 7fdfc1800640 1 -- 172.21.15.39:0/2693521050 wait complete. 2024-04-26T23:26:47.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:47.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:47.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 Processor -- start 2024-04-26T23:26:47.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 -- start start 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5e88160820 0x7f5e880ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 0x7f5e880d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e880cf020 con 0x7f5e880d1e30 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5e88161d00 con 0x7f5e88160820 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e8e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5e880b5b40 con 0x7f5e880b5740 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e87e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5e880d1e30 0x7f5e88160ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47698/0 (socket says 172.21.15.39:47698) 2024-04-26T23:26:47.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e87e00640 1 -- 172.21.15.39:0/4116799022 learned_addr learned my addr 172.21.15.39:0/4116799022 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86a00640 1 --2- 172.21.15.39:0/4116799022 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 0x7f5e880d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e87400640 1 --2- 172.21.15.39:0/4116799022 >> v2:172.21.15.71:3300/0 conn(0x7f5e88160820 0x7f5e880ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86000640 1 -- 172.21.15.39:0/4116799022 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444532250 0 0) 0x7f5e880cf020 con 0x7f5e880d1e30 2024-04-26T23:26:47.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86000640 1 -- 172.21.15.39:0/4116799022 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6c003530 con 0x7f5e880d1e30 2024-04-26T23:26:47.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86a00640 1 -- 172.21.15.39:0/4116799022 >> v2:172.21.15.71:3300/0 conn(0x7f5e88160820 msgr2=0x7f5e880ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:47.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86a00640 1 --2- 172.21.15.39:0/4116799022 >> v2:172.21.15.71:3300/0 conn(0x7f5e88160820 0x7f5e880ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86a00640 1 -- 172.21.15.39:0/4116799022 >> v1:172.21.15.39:6789/0 conn(0x7f5e880d1e30 legacy=0x7f5e88160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.397+0000 7f5e86a00640 1 -- 172.21.15.39:0/4116799022 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e88160c00 con 0x7f5e880b5740 2024-04-26T23:26:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e86a00640 1 --2- 172.21.15.39:0/4116799022 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 0x7f5e880d18f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097c0 tx=0x7f5e7401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736874c64ff51381 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e86000640 1 -- 172.21.15.39:0/4116799022 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740b0070 con 0x7f5e880b5740 2024-04-26T23:26:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e86000640 1 -- 172.21.15.39:0/4116799022 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e740ab600 con 0x7f5e880b5740 2024-04-26T23:26:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e86000640 1 -- 172.21.15.39:0/4116799022 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740ab9d0 con 0x7f5e880b5740 2024-04-26T23:26:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 -- 172.21.15.39:0/4116799022 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 msgr2=0x7f5e880d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 --2- 172.21.15.39:0/4116799022 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 0x7f5e880d18f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097c0 tx=0x7f5e7401c410 comp rx=0 tx=0).stop 2024-04-26T23:26:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 -- 172.21.15.39:0/4116799022 shutdown_connections 2024-04-26T23:26:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 --2- 172.21.15.39:0/4116799022 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e880b5740 0x7f5e880d18f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 --2- 172.21.15.39:0/4116799022 >> v2:172.21.15.71:3300/0 conn(0x7f5e88160820 0x7f5e880ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 -- 172.21.15.39:0/4116799022 >> 172.21.15.39:0/4116799022 conn(0x7f5e880b4c20 msgr2=0x7f5e880b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 -- 172.21.15.39:0/4116799022 shutdown_connections 2024-04-26T23:26:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 -- 172.21.15.39:0/4116799022 wait complete. 2024-04-26T23:26:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.401+0000 7f5e8e600640 1 Processor -- start 2024-04-26T23:26:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- start start 2024-04-26T23:26:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 0x7f5e880b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 0x7f5e880b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e880c7490 con 0x7f5e880b5740 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e880d13d0 con 0x7f5e880d1e30 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5e880c7610 con 0x7f5e88160820 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47110/0 (socket says 172.21.15.39:47110) 2024-04-26T23:26:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 -- 172.21.15.39:0/2354560889 learned_addr learned my addr 172.21.15.39:0/2354560889 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87e00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 0x7f5e880b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e86a00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 0x7f5e880b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 -- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 msgr2=0x7f5e880b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 0x7f5e880b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 -- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 msgr2=0x7f5e880b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 0x7f5e880b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 -- 172.21.15.39:0/2354560889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e880b6d80 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e86a00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 0x7f5e880b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87e00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 0x7f5e880b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e87400640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e930 tx=0x7f5e7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78017070 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7800ca00 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800cdb0 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e880b74e0 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e880b5d60 con 0x7f5e880b5740 2024-04-26T23:26:47.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.405+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8806a720 con 0x7f5e880b5740 2024-04-26T23:26:47.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.409+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e7801a070 con 0x7f5e880b5740 2024-04-26T23:26:47.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.409+0000 7f5e7f400640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 0x7f5e6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.409+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5e78086a20 con 0x7f5e880b5740 2024-04-26T23:26:47.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.409+0000 7f5e86a00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 0x7f5e6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.409+0000 7f5e86a00640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 0x7f5e6806a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097c0 tx=0x7f5e74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.413+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e780570a0 con 0x7f5e880b5740 2024-04-26T23:26:47.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.577+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5e880696c0 con 0x7f5e880b5740 2024-04-26T23:26:47.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.577+0000 7f5e7f400640 1 -- 172.21.15.39:0/2354560889 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5e780569a0 con 0x7f5e880b5740 2024-04-26T23:26:47.583 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 msgr2=0x7f5e6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 0x7f5e6806a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097c0 tx=0x7f5e74008040 comp rx=0 tx=0).stop 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 msgr2=0x7f5e880cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e930 tx=0x7f5e7800edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 shutdown_connections 2024-04-26T23:26:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5e68068380 0x7f5e6806a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e88160820 0x7f5e880b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880d1e30 0x7f5e880b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 --2- 172.21.15.39:0/2354560889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880b5740 0x7f5e880cbf50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 >> 172.21.15.39:0/2354560889 conn(0x7f5e880b4c20 msgr2=0x7f5e880b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 shutdown_connections 2024-04-26T23:26:47.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.581+0000 7f5e8e600640 1 -- 172.21.15.39:0/2354560889 wait complete. 2024-04-26T23:26:47.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:47.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.741+0000 7effc7800640 1 Processor -- start 2024-04-26T23:26:47.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.741+0000 7effc7800640 1 -- start start 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc7800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7effc015f810 0x7effc009c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc7800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc7800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc00d14f0 con 0x7effc006def0 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc7800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7effc00d1e20 con 0x7effc015f810 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc7800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7effc00d17d0 con 0x7effc006d760 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7effc015f810 0x7effc009c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7effc015f810 0x7effc009c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47126/0 (socket says 172.21.15.39:47126) 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 -- 172.21.15.39:0/1739326435 learned_addr learned my addr 172.21.15.39:0/1739326435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effc5800640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 -- 172.21.15.39:0/1739326435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 msgr2=0x7effc006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 -- 172.21.15.39:0/1739326435 >> v1:172.21.15.71:6789/0 conn(0x7effc006def0 legacy=0x7effc00d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.745+0000 7effbfe00640 1 -- 172.21.15.39:0/1739326435 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc00d1ab0 con 0x7effc015f810 2024-04-26T23:26:47.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effbfe00640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc015f810 0x7effc009c3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7effac009870 tx=0x7effac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a9df3a985883c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effbf400640 1 -- 172.21.15.39:0/1739326435 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0aa650 con 0x7effc015f810 2024-04-26T23:26:47.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effbf400640 1 -- 172.21.15.39:0/1739326435 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac0af070 con 0x7effc015f810 2024-04-26T23:26:47.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effbf400640 1 -- 172.21.15.39:0/1739326435 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0aaa10 con 0x7effc015f810 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- 172.21.15.39:0/1739326435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc015f810 msgr2=0x7effc009c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc015f810 0x7effc009c3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7effac009870 tx=0x7effac01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- 172.21.15.39:0/1739326435 shutdown_connections 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- 172.21.15.39:0/1739326435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc015f810 0x7effc009c3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- 172.21.15.39:0/1739326435 >> 172.21.15.39:0/1739326435 conn(0x7effc00b4c20 msgr2=0x7effc00b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- 172.21.15.39:0/1739326435 shutdown_connections 2024-04-26T23:26:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- 172.21.15.39:0/1739326435 wait complete. 2024-04-26T23:26:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 Processor -- start 2024-04-26T23:26:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 -- start start 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.749+0000 7effc7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc015f810 0x7effc015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7effc00ce110 con 0x7effc006def0 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effc00cdf90 con 0x7effc015f810 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7effc00ce290 con 0x7effc006d760 2024-04-26T23:26:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47140/0 (socket says 172.21.15.39:47140) 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 -- 172.21.15.39:0/1593516647 learned_addr learned my addr 172.21.15.39:0/1593516647 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc5800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc015f810 0x7effc015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc4e00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 -- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 msgr2=0x7effc01552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc01552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 -- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc015f810 msgr2=0x7effc015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc015f810 0x7effc015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 -- 172.21.15.39:0/1593516647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc0157db0 con 0x7effc006def0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbfe00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7effac01a100 tx=0x7effac019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0be610 con 0x7effc006def0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac0a6040 con 0x7effc006def0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0be9f0 con 0x7effc006def0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc015ee20 con 0x7effc006def0 2024-04-26T23:26:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc015da60 con 0x7effc006def0 2024-04-26T23:26:47.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc006a720 con 0x7effc006def0 2024-04-26T23:26:47.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.753+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effac0bc020 con 0x7effc006def0 2024-04-26T23:26:47.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.757+0000 7effbcc00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 0x7effa006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:47.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.757+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effac1204d0 con 0x7effc006def0 2024-04-26T23:26:47.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.757+0000 7effc4e00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 0x7effa006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:47.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.757+0000 7effc4e00640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 0x7effa006a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7effc015b2b0 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:47.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.761+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7effac0c5020 con 0x7effc006def0 2024-04-26T23:26:47.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.921+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7effc006dcd0 con 0x7effc006def0 2024-04-26T23:26:47.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.921+0000 7effbcc00640 1 -- 172.21.15.39:0/1593516647 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7effac016150 con 0x7effc006def0 2024-04-26T23:26:47.927 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:47.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 msgr2=0x7effa006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 0x7effa006a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7effc015b2b0 tx=0x7effb4009040 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 msgr2=0x7effc0157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7effac01a100 tx=0x7effac019270 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 shutdown_connections 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7effa00683b0 0x7effa006a870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc015f810 0x7effc015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7effc006def0 0x7effc0157870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 --2- 172.21.15.39:0/1593516647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effc006d760 0x7effc01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 >> 172.21.15.39:0/1593516647 conn(0x7effc00b4c20 msgr2=0x7effc01589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 shutdown_connections 2024-04-26T23:26:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:47.925+0000 7effc7800640 1 -- 172.21.15.39:0/1593516647 wait complete. 2024-04-26T23:26:47.948 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:48.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.085+0000 7f4adb200640 1 Processor -- start 2024-04-26T23:26:48.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.085+0000 7f4adb200640 1 -- start start 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4adb200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4adb200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40d06b0 con 0x7f4ad40d1110 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4adb200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40b2430 con 0x7f4ad40cfd30 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4adb200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40d2490 con 0x7f4ad40b2050 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4ad40d1110 0x7f4ad40cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47710/0 (socket says 172.21.15.39:47710) 2024-04-26T23:26:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9400640 1 -- 172.21.15.39:0/3258608156 learned_addr learned my addr 172.21.15.39:0/3258608156 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9e00640 1 --2- 172.21.15.39:0/3258608156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3258608156 >> v1:172.21.15.71:6789/0 conn(0x7f4ad40cfd30 legacy=0x7f4ad40ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad8a00640 1 -- 172.21.15.39:0/3258608156 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124818871 0 0) 0x7f4ad40d06b0 con 0x7f4ad40d1110 2024-04-26T23:26:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3258608156 >> v1:172.21.15.39:6789/0 conn(0x7f4ad40d1110 legacy=0x7f4ad40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.089+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3258608156 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad40d1880 con 0x7f4ad40b2050 2024-04-26T23:26:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad9e00640 1 --2- 172.21.15.39:0/3258608156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad415f770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009770 tx=0x7f4ac801c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339803fcb3fc565b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad8a00640 1 -- 172.21.15.39:0/3258608156 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80b0070 con 0x7f4ad40b2050 2024-04-26T23:26:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad8a00640 1 -- 172.21.15.39:0/3258608156 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac80ab600 con 0x7f4ad40b2050 2024-04-26T23:26:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad8a00640 1 -- 172.21.15.39:0/3258608156 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80ab9d0 con 0x7f4ad40b2050 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- 172.21.15.39:0/3258608156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 msgr2=0x7f4ad415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 --2- 172.21.15.39:0/3258608156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad415f770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009770 tx=0x7f4ac801c310 comp rx=0 tx=0).stop 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- 172.21.15.39:0/3258608156 shutdown_connections 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 --2- 172.21.15.39:0/3258608156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad415f770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- 172.21.15.39:0/3258608156 >> 172.21.15.39:0/3258608156 conn(0x7f4ad40d2da0 msgr2=0x7f4ad40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- 172.21.15.39:0/3258608156 shutdown_connections 2024-04-26T23:26:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- 172.21.15.39:0/3258608156 wait complete. 2024-04-26T23:26:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 Processor -- start 2024-04-26T23:26:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- start start 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad40cfd30 0x7f4ad40b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ad40d1110 0x7f4ad40ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40d2120 con 0x7f4ad40cfd30 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40d1e40 con 0x7f4ad40d1110 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4adb200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40d1550 con 0x7f4ad40b2050 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad40cfd30 0x7f4ad40b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.093+0000 7f4ad9e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:41924/0 (socket says 172.21.15.39:41924) 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3290069379 learned_addr learned my addr 172.21.15.39:0/3290069379 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ada800640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ad40d1110 0x7f4ad40ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ad40d1110 msgr2=0x7f4ad40ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ad40d1110 0x7f4ad40ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3290069379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad40cfd30 msgr2=0x7f4ad40b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad40cfd30 0x7f4ad40b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 -- 172.21.15.39:0/3290069379 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad4155340 con 0x7f4ad40b2050 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ad9e00640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ae040 tx=0x7f4ac801ab50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80b0050 con 0x7f4ad40b2050 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac80bc070 con 0x7f4ad40b2050 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad40b59c0 con 0x7f4ad40b2050 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80aab80 con 0x7f4ad40b2050 2024-04-26T23:26:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad40b5f80 con 0x7f4ad40b2050 2024-04-26T23:26:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad40506d0 con 0x7f4ad40b2050 2024-04-26T23:26:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.097+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ac80c1460 con 0x7f4ad40b2050 2024-04-26T23:26:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.101+0000 7f4ace000640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 0x7f4ab806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.101+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ac8121fd0 con 0x7f4ad40b2050 2024-04-26T23:26:48.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.101+0000 7f4ad9400640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 0x7f4ab806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.101+0000 7f4ad9400640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 0x7f4ab806a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ad41635e0 tx=0x7f4ac4007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.101+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ac8015f90 con 0x7f4ad40b2050 2024-04-26T23:26:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.269+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4ad40b0fa0 con 0x7f4ad40b2050 2024-04-26T23:26:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.269+0000 7f4ace000640 1 -- 172.21.15.39:0/3290069379 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4ac80f1f20 con 0x7f4ad40b2050 2024-04-26T23:26:48.275 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 msgr2=0x7f4ab806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 0x7f4ab806a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ad41635e0 tx=0x7f4ac4007240 comp rx=0 tx=0).stop 2024-04-26T23:26:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 msgr2=0x7f4ad4154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ae040 tx=0x7f4ac801ab50 comp rx=0 tx=0).stop 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 shutdown_connections 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ab8068380 0x7f4ab806a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ad40d1110 0x7f4ad40ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad40cfd30 0x7f4ad40b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 --2- 172.21.15.39:0/3290069379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ad40b2050 0x7f4ad4154e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 >> 172.21.15.39:0/3290069379 conn(0x7f4ad40d2da0 msgr2=0x7f4ad40af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 shutdown_connections 2024-04-26T23:26:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.273+0000 7f4adb200640 1 -- 172.21.15.39:0/3290069379 wait complete. 2024-04-26T23:26:48.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:26:48.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.433+0000 7fb45d000640 1 Processor -- start 2024-04-26T23:26:48.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.433+0000 7fb45d000640 1 -- start start 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb45d000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 0x7fb45806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb45d000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb4580d15c0 0x7fb4580723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb45d000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb458072cf0 con 0x7fb458162e20 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb45d000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb458072fd0 con 0x7fb4580d15c0 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb45d000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb4580732b0 con 0x7fb4580d11e0 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb44fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb4580d15c0 0x7fb4580723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb456800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb458162e20 0x7fb458163290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47714/0 (socket says 172.21.15.39:47714) 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb456800640 1 -- 172.21.15.39:0/2874119214 learned_addr learned my addr 172.21.15.39:0/2874119214 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb455e00640 1 --2- 172.21.15.39:0/2874119214 >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 0x7fb45806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb44fe00640 1 -- 172.21.15.39:0/2874119214 >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 msgr2=0x7fb45806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb44fe00640 1 --2- 172.21.15.39:0/2874119214 >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 0x7fb45806f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb44fe00640 1 -- 172.21.15.39:0/2874119214 >> v1:172.21.15.39:6789/0 conn(0x7fb458162e20 legacy=0x7fb458163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb44fe00640 1 -- 172.21.15.39:0/2874119214 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb458073590 con 0x7fb4580d15c0 2024-04-26T23:26:48.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.437+0000 7fb455e00640 1 --2- 172.21.15.39:0/2874119214 >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 0x7fb45806f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb44fe00640 1 --2- 172.21.15.39:0/2874119214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb4580723c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4580b64c0 tx=0x7fb44001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3680a9d59ba28a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb455400640 1 -- 172.21.15.39:0/2874119214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400b2070 con 0x7fb4580d15c0 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb455400640 1 -- 172.21.15.39:0/2874119214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4400ad680 con 0x7fb4580d15c0 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb455400640 1 -- 172.21.15.39:0/2874119214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400ada50 con 0x7fb4580d15c0 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- 172.21.15.39:0/2874119214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 msgr2=0x7fb4580723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- 172.21.15.39:0/2874119214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb4580723c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4580b64c0 tx=0x7fb44001c360 comp rx=0 tx=0).stop 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- 172.21.15.39:0/2874119214 shutdown_connections 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- 172.21.15.39:0/2874119214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb4580723c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- 172.21.15.39:0/2874119214 >> v2:172.21.15.71:3300/0 conn(0x7fb4580d11e0 0x7fb45806f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- 172.21.15.39:0/2874119214 >> 172.21.15.39:0/2874119214 conn(0x7fb45806c7d0 msgr2=0x7fb45806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:48.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- 172.21.15.39:0/2874119214 shutdown_connections 2024-04-26T23:26:48.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- 172.21.15.39:0/2874119214 wait complete. 2024-04-26T23:26:48.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 Processor -- start 2024-04-26T23:26:48.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- start start 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 0x7fb4581519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb458162e20 0x7fb45814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb458072a80 con 0x7fb4580d15c0 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb458072900 con 0x7fb4580d11e0 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb45d000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb4581629f0 con 0x7fb458162e20 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb44fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb44fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47148/0 (socket says 172.21.15.39:47148) 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.441+0000 7fb44fe00640 1 -- 172.21.15.39:0/3123707573 learned_addr learned my addr 172.21.15.39:0/3123707573 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 -- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb458162e20 msgr2=0x7fb45814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb455e00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 0x7fb4581519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb458162e20 0x7fb45814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 -- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 msgr2=0x7fb4581519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 0x7fb4581519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 -- 172.21.15.39:0/3123707573 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb458069dc0 con 0x7fb4580d15c0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb455e00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 0x7fb4581519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44fe00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb440019f90 tx=0x7fb44001aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400bd070 con 0x7fb4580d15c0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4400adc30 con 0x7fb4580d15c0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400b2040 con 0x7fb4580d15c0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb458155a70 con 0x7fb4580d15c0 2024-04-26T23:26:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb458156030 con 0x7fb4580d15c0 2024-04-26T23:26:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45806a720 con 0x7fb4580d15c0 2024-04-26T23:26:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4400c0070 con 0x7fb4580d15c0 2024-04-26T23:26:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 0x7fb43406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.445+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb440120160 con 0x7fb4580d15c0 2024-04-26T23:26:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.449+0000 7fb455e00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 0x7fb43406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.449+0000 7fb455e00640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 0x7fb43406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb458150cf0 tx=0x7fb448008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.453+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb440016070 con 0x7fb4580d15c0 2024-04-26T23:26:48.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.625+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb45806ccc0 con 0x7fb4580d15c0 2024-04-26T23:26:48.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.625+0000 7fb44e000640 1 -- 172.21.15.39:0/3123707573 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb4400f0720 con 0x7fb4580d15c0 2024-04-26T23:26:48.631 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:26:48.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 msgr2=0x7fb43406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 0x7fb43406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb458150cf0 tx=0x7fb448008040 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 msgr2=0x7fb458156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb440019f90 tx=0x7fb44001aba0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 shutdown_connections 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb434068380 0x7fb43406a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb458162e20 0x7fb45814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4580d15c0 0x7fb458156b10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 --2- 172.21.15.39:0/3123707573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4580d11e0 0x7fb4581519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 >> 172.21.15.39:0/3123707573 conn(0x7fb45806c7d0 msgr2=0x7fb4580aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 shutdown_connections 2024-04-26T23:26:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:48.629+0000 7fb45d000640 1 -- 172.21.15.39:0/3123707573 wait complete. 2024-04-26T23:26:48.653 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:26:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:48.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-26T23:26:48.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:26:48.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:48.686 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:26:48.746 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:48.746 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:48.755 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:48.755 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:48.811 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:48.811 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:48.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:49.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 Processor -- start 2024-04-26T23:26:49.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 -- start start 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c6c0b2200 0x7f8c6c0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6c0b3260 con 0x7f8c6c0b0790 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6c0b3540 con 0x7f8c6c15f5f0 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6c0b3010 con 0x7f8c6c0b2200 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6b400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8c6c0b0790 0x7f8c6c0d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47726/0 (socket says 172.21.15.39:47726) 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6b400640 1 -- 172.21.15.39:0/133845944 learned_addr learned my addr 172.21.15.39:0/133845944 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c63e00640 1 --2- 172.21.15.39:0/133845944 >> v2:172.21.15.71:3300/0 conn(0x7f8c6c0b2200 0x7f8c6c0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86708708 0 0) 0x7f8c6c0b3260 con 0x7f8c6c0b0790 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c50003530 con 0x7f8c6c0b0790 2024-04-26T23:26:49.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2865308626 0 0) 0x7f8c50003530 con 0x7f8c6c0b0790 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 >> v2:172.21.15.71:3300/0 conn(0x7f8c6c0b2200 msgr2=0x7f8c6c0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 --2- 172.21.15.39:0/133845944 >> v2:172.21.15.71:3300/0 conn(0x7f8c6c0b2200 0x7f8c6c0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 >> v1:172.21.15.71:6789/0 conn(0x7f8c6c15f5f0 legacy=0x7f8c6c0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c0b3820 con 0x7f8c6c0b0790 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f8c64001a00 con 0x7f8c6c0b0790 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 >> v1:172.21.15.39:6789/0 conn(0x7f8c6c0b0790 legacy=0x7f8c6c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c500039c0 0x7f8c50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 0x7f8c50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c500051d0 0x7f8c5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c0b3010 con 0x7f8c50004810 2024-04-26T23:26:49.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5000c070 con 0x7f8c500051d0 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.005+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5000c270 con 0x7f8c500039c0 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 0x7f8c50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6aa00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c500039c0 0x7f8c50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6b400640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c500051d0 0x7f8c5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 -- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c500039c0 msgr2=0x7f8c50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c500039c0 0x7f8c50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 -- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c500051d0 msgr2=0x7f8c5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c500051d0 0x7f8c5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 -- 172.21.15.39:0/133845944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c50003530 con 0x7f8c50004810 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6aa00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c500039c0 0x7f8c50003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:49.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6b400640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c500051d0 0x7f8c5000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:49.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6b400640 1 -- 172.21.15.39:0/133845944 reap_dead start 2024-04-26T23:26:49.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c63e00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 0x7f8c50004c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009ae0 tx=0x7f8c5401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00c449b2aa9e793 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540b2070 con 0x7f8c50004810 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c540a5660 con 0x7f8c50004810 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.009+0000 7f8c6a000640 1 -- 172.21.15.39:0/133845944 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540096b0 con 0x7f8c50004810 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 msgr2=0x7f8c50004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 0x7f8c50004c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009ae0 tx=0x7f8c5401ca70 comp rx=0 tx=0).stop 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- 172.21.15.39:0/133845944 shutdown_connections 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 --2- 172.21.15.39:0/133845944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c50004810 0x7f8c50004c90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- 172.21.15.39:0/133845944 >> 172.21.15.39:0/133845944 conn(0x7f8c6c0d2df0 msgr2=0x7f8c6c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- 172.21.15.39:0/133845944 shutdown_connections 2024-04-26T23:26:49.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- 172.21.15.39:0/133845944 wait complete. 2024-04-26T23:26:49.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 Processor -- start 2024-04-26T23:26:49.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- start start 2024-04-26T23:26:49.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c50004810 0x7f8c6c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c160c80 0x7f8c6c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c15f9d0 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c0b3de0 con 0x7f8c6c160c80 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6be00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6c15fb50 con 0x7f8c50004810 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6aa00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c50004810 0x7f8c6c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47158/0 (socket says 172.21.15.39:47158) 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 -- 172.21.15.39:0/277900985 learned_addr learned my addr 172.21.15.39:0/277900985 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c6b400640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c160c80 0x7f8c6c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 -- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c50004810 msgr2=0x7f8c6c0cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c50004810 0x7f8c6c0cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 -- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c160c80 msgr2=0x7f8c6c0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c160c80 0x7f8c6c0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 -- 172.21.15.39:0/277900985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c0cca10 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.013+0000 7f8c63e00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c540b0040 tx=0x7f8c54019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540b2040 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54004020 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540096b0 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c0c9ff0 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c0ca5b0 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c0506d0 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c540bf060 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 0x7f8c4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c54120350 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.017+0000 7f8c6aa00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 0x7f8c4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.021+0000 7f8c6aa00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 0x7f8c4806a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.021+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8c6c0cca10 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.189+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c6c0d3a60 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c62a00640 1 -- 172.21.15.39:0/277900985 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f8c54016780 con 0x7f8c6c0cb5d0 2024-04-26T23:26:49.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:49.196 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 msgr2=0x7f8c4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 0x7f8c4806a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009040 comp rx=0 tx=0).stop 2024-04-26T23:26:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 msgr2=0x7f8c6c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c540b0040 tx=0x7f8c54019810 comp rx=0 tx=0).stop 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 shutdown_connections 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8c480683b0 0x7f8c4806a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c160c80 0x7f8c6c0c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c6c0cb5d0 0x7f8c6c160740 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 --2- 172.21.15.39:0/277900985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c50004810 0x7f8c6c0cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 >> 172.21.15.39:0/277900985 conn(0x7f8c6c0d2df0 msgr2=0x7f8c6c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 shutdown_connections 2024-04-26T23:26:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.193+0000 7f8c6be00640 1 -- 172.21.15.39:0/277900985 wait complete. 2024-04-26T23:26:49.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:49.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:49.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 Processor -- start 2024-04-26T23:26:49.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 -- start start 2024-04-26T23:26:49.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa2740d1b10 0x7fa2740b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2740b4770 con 0x7fa27415d240 2024-04-26T23:26:49.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2740aff80 con 0x7fa2740b3f10 2024-04-26T23:26:49.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.357+0000 7fa27b400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa27415d620 con 0x7fa2740d1b10 2024-04-26T23:26:49.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa278a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa27415d240 0x7fa2740d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47730/0 (socket says 172.21.15.39:47730) 2024-04-26T23:26:49.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa278a00640 1 -- 172.21.15.39:0/468624871 learned_addr learned my addr 172.21.15.39:0/468624871 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:49.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa26be00640 1 --2- 172.21.15.39:0/468624871 >> v2:172.21.15.71:3300/0 conn(0x7fa2740d1b10 0x7fa2740b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994596135 0 0) 0x7fa2740b4770 con 0x7fa27415d240 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa258003530 con 0x7fa27415d240 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871933892 0 0) 0x7fa2740aff80 con 0x7fa2740b3f10 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2740b4770 con 0x7fa2740b3f10 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa26be00640 1 -- 172.21.15.39:0/468624871 >> v1:172.21.15.71:6789/0 conn(0x7fa2740b3f10 legacy=0x7fa2740b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3932689591 0 0) 0x7fa258003530 con 0x7fa27415d240 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa26be00640 1 -- 172.21.15.39:0/468624871 >> v1:172.21.15.39:6789/0 conn(0x7fa27415d240 legacy=0x7fa2740d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa26be00640 1 -- 172.21.15.39:0/468624871 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2740b0260 con 0x7fa2740d1b10 2024-04-26T23:26:49.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.361+0000 7fa26be00640 1 --2- 172.21.15.39:0/468624871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2740d1b10 0x7fa2740b39d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097c0 tx=0x7fa25c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d76628918da0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b0070 con 0x7fa2740d1b10 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c0a4e50 con 0x7fa2740d1b10 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa273e00640 1 -- 172.21.15.39:0/468624871 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740b4530 con 0x7fa2740d1b10 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- 172.21.15.39:0/468624871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2740d1b10 msgr2=0x7fa2740b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 --2- 172.21.15.39:0/468624871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2740d1b10 0x7fa2740b39d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097c0 tx=0x7fa25c01c330 comp rx=0 tx=0).stop 2024-04-26T23:26:49.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- 172.21.15.39:0/468624871 shutdown_connections 2024-04-26T23:26:49.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 --2- 172.21.15.39:0/468624871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2740d1b10 0x7fa2740b39d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- 172.21.15.39:0/468624871 >> 172.21.15.39:0/468624871 conn(0x7fa2740d3040 msgr2=0x7fa2740d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- 172.21.15.39:0/468624871 shutdown_connections 2024-04-26T23:26:49.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- 172.21.15.39:0/468624871 wait complete. 2024-04-26T23:26:49.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 Processor -- start 2024-04-26T23:26:49.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- start start 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 0x7fa2740b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 0x7fa274142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa2740b1d90 con 0x7fa2740d1b10 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2740b1c10 con 0x7fa27415d240 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa27b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa27416ad00 con 0x7fa2740b3f10 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa26be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa26be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47160/0 (socket says 172.21.15.39:47160) 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa26be00640 1 -- 172.21.15.39:0/1803391700 learned_addr learned my addr 172.21.15.39:0/1803391700 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa278a00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 0x7fa2740b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.365+0000 7fa279400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 0x7fa274142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 -- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 msgr2=0x7fa2740b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 0x7fa2740b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 -- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 msgr2=0x7fa274142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 0x7fa274142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 -- 172.21.15.39:0/1803391700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2740b7620 con 0x7fa2740d1b10 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa278a00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 0x7fa2740b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa279400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 0x7fa274142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:49.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa26be00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097c0 tx=0x7fa25c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b0040 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c0036e0 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264001680 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27415d7a0 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2740b78f0 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27406a720 con 0x7fa2740d1b10 2024-04-26T23:26:49.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa25c0bb030 con 0x7fa2740d1b10 2024-04-26T23:26:49.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 0x7fa25006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa25c11fac0 con 0x7fa2740d1b10 2024-04-26T23:26:49.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.369+0000 7fa278a00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 0x7fa25006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.373+0000 7fa278a00640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 0x7fa25006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa264000fe0 tx=0x7fa264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.373+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa25c0c2020 con 0x7fa2740d1b10 2024-04-26T23:26:49.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.537+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2740ce8e0 con 0x7fa2740d1b10 2024-04-26T23:26:49.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.537+0000 7fa271600640 1 -- 172.21.15.39:0/1803391700 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa25c015fb0 con 0x7fa2740d1b10 2024-04-26T23:26:49.542 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:49.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 msgr2=0x7fa25006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 0x7fa25006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa264000fe0 tx=0x7fa264009040 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 msgr2=0x7fa274142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097c0 tx=0x7fa25c0190d0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 shutdown_connections 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa250068380 0x7fa25006a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa27415d240 0x7fa274142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2740d1b10 0x7fa274142310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 --2- 172.21.15.39:0/1803391700 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2740b3f10 0x7fa2740b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 >> 172.21.15.39:0/1803391700 conn(0x7fa2740d3040 msgr2=0x7fa274071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 shutdown_connections 2024-04-26T23:26:49.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.541+0000 7fa27b400640 1 -- 172.21.15.39:0/1803391700 wait complete. 2024-04-26T23:26:49.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:49.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 Processor -- start 2024-04-26T23:26:49.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 -- start start 2024-04-26T23:26:49.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72740ce710 0x7f72740b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7274160ea0 0x7f72741612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72740cf020 con 0x7f7274160820 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f7274161d00 con 0x7f72740ce710 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f727ae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7274161830 con 0x7f7274160ea0 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72740ce710 0x7f72740b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72740ce710 0x7f72740b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47168/0 (socket says 172.21.15.39:47168) 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 -- 172.21.15.39:0/2086227512 learned_addr learned my addr 172.21.15.39:0/2086227512 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f7278e00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7274160ea0 0x7f72741612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 -- 172.21.15.39:0/2086227512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7274160ea0 msgr2=0x7f72741612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7274160ea0 0x7f72741612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 -- 172.21.15.39:0/2086227512 >> v1:172.21.15.71:6789/0 conn(0x7f7274160820 legacy=0x7f72740d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.705+0000 7f726be00640 1 -- 172.21.15.39:0/2086227512 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7274160c00 con 0x7f72740ce710 2024-04-26T23:26:49.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f726be00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72740ce710 0x7f72740b5740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098a0 tx=0x7f725c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d676ac36b8ef85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f7273400640 1 -- 172.21.15.39:0/2086227512 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0b0070 con 0x7f72740ce710 2024-04-26T23:26:49.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f7273400640 1 -- 172.21.15.39:0/2086227512 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0ab600 con 0x7f72740ce710 2024-04-26T23:26:49.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f7273400640 1 -- 172.21.15.39:0/2086227512 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0ab9d0 con 0x7f72740ce710 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- 172.21.15.39:0/2086227512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72740ce710 msgr2=0x7f72740b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72740ce710 0x7f72740b5740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098a0 tx=0x7f725c01c4b0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- 172.21.15.39:0/2086227512 shutdown_connections 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7274160ea0 0x7f72741612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 --2- 172.21.15.39:0/2086227512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72740ce710 0x7f72740b5740 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- 172.21.15.39:0/2086227512 >> 172.21.15.39:0/2086227512 conn(0x7f72740b4c20 msgr2=0x7f72740b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- 172.21.15.39:0/2086227512 shutdown_connections 2024-04-26T23:26:49.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- 172.21.15.39:0/2086227512 wait complete. 2024-04-26T23:26:49.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 Processor -- start 2024-04-26T23:26:49.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.709+0000 7f727ae00640 1 -- start start 2024-04-26T23:26:49.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72740ce710 0x7f727415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7274160ea0 0x7f72740c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f72740d2000 con 0x7f7274160820 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f72740d13d0 con 0x7f7274160ea0 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7274169ff0 con 0x7f72740ce710 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47180/0 (socket says 172.21.15.39:47180) 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f7273e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72740ce710 0x7f727415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 -- 172.21.15.39:0/4006542862 learned_addr learned my addr 172.21.15.39:0/4006542862 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:49.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f7278e00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7274160ea0 0x7f72740c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 -- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72740ce710 msgr2=0x7f727415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72740ce710 0x7f727415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 -- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7274160ea0 msgr2=0x7f72740c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7274160ea0 0x7f72740c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 -- 172.21.15.39:0/4006542862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727415d810 con 0x7f7274160820 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f726be00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f725c01a0e0 tx=0x7f725c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0b0040 con 0x7f7274160820 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0b4420 con 0x7f7274160820 2024-04-26T23:26:49.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727415daf0 con 0x7f7274160820 2024-04-26T23:26:49.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0b4810 con 0x7f7274160820 2024-04-26T23:26:49.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727415bc90 con 0x7f7274160820 2024-04-26T23:26:49.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.713+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727406a720 con 0x7f7274160820 2024-04-26T23:26:49.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.717+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f725c0b49b0 con 0x7f7274160820 2024-04-26T23:26:49.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.717+0000 7f7270c00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:49.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.717+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f725c1202c0 con 0x7f7274160820 2024-04-26T23:26:49.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.717+0000 7f7273e00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:49.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.717+0000 7f7273e00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 0x7f725006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7264001770 tx=0x7f7264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:49.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.721+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f725c016130 con 0x7f7274160820 2024-04-26T23:26:49.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.881+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f72740cd820 con 0x7f7274160820 2024-04-26T23:26:49.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f7270c00640 1 -- 172.21.15.39:0/4006542862 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f725c1200c0 con 0x7f7274160820 2024-04-26T23:26:49.888 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:49.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 msgr2=0x7f725006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 0x7f725006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7264001770 tx=0x7f7264009040 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 msgr2=0x7f727415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f725c01a0e0 tx=0x7f725c019250 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 shutdown_connections 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7274160ea0 0x7f72740c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7274160820 0x7f727415c490 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 --2- 172.21.15.39:0/4006542862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72740ce710 0x7f727415ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 >> 172.21.15.39:0/4006542862 conn(0x7f72740b4c20 msgr2=0x7f727415efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 shutdown_connections 2024-04-26T23:26:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:49.885+0000 7f727ae00640 1 -- 172.21.15.39:0/4006542862 wait complete. 2024-04-26T23:26:49.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:50.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 Processor -- start 2024-04-26T23:26:50.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 -- start start 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed14140170 0x7fed1415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fed1415e340 0x7fed140d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1406e500 con 0x7fed14161850 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fed1406f110 con 0x7fed1415e340 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1c600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fed1406e7e0 con 0x7fed14140170 2024-04-26T23:26:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1a600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fed14161850 0x7fed14142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47740/0 (socket says 172.21.15.39:47740) 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed19200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fed1415e340 0x7fed140d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed1a600640 1 -- 172.21.15.39:0/3721625659 learned_addr learned my addr 172.21.15.39:0/3721625659 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.057+0000 7fed19c00640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed14140170 0x7fed1415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed19200640 1 -- 172.21.15.39:0/3721625659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed14140170 msgr2=0x7fed1415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed19200640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed14140170 0x7fed1415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed19200640 1 -- 172.21.15.39:0/3721625659 >> v1:172.21.15.39:6789/0 conn(0x7fed14161850 legacy=0x7fed14142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed19200640 1 -- 172.21.15.39:0/3721625659 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1406eac0 con 0x7fed1415e340 2024-04-26T23:26:50.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed13e00640 1 -- 172.21.15.39:0/3721625659 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191535199 0 0) 0x7fed1406e500 con 0x7fed14161850 2024-04-26T23:26:50.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed19200640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1415e340 0x7fed140d11e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed000097c0 tx=0x7fed0001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dd41d2bea677b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed13e00640 1 -- 172.21.15.39:0/3721625659 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed000b0070 con 0x7fed1415e340 2024-04-26T23:26:50.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed13e00640 1 -- 172.21.15.39:0/3721625659 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed000ab600 con 0x7fed1415e340 2024-04-26T23:26:50.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed13e00640 1 -- 172.21.15.39:0/3721625659 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed000ab9d0 con 0x7fed1415e340 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed1c600640 1 -- 172.21.15.39:0/3721625659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1415e340 msgr2=0x7fed140d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.061+0000 7fed1c600640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1415e340 0x7fed140d11e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed000097c0 tx=0x7fed0001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- 172.21.15.39:0/3721625659 shutdown_connections 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed1415e340 0x7fed140d11e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 --2- 172.21.15.39:0/3721625659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed14140170 0x7fed1415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- 172.21.15.39:0/3721625659 >> 172.21.15.39:0/3721625659 conn(0x7fed1406c7d0 msgr2=0x7fed1406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- 172.21.15.39:0/3721625659 shutdown_connections 2024-04-26T23:26:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- 172.21.15.39:0/3721625659 wait complete. 2024-04-26T23:26:50.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 Processor -- start 2024-04-26T23:26:50.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- start start 2024-04-26T23:26:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed1415e340 0x7fed14156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 0x7fed141571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fed1416a340 con 0x7fed14140170 2024-04-26T23:26:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed1416a1c0 con 0x7fed14161850 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1c600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fed1416a4c0 con 0x7fed1415e340 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47194/0 (socket says 172.21.15.39:47194) 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 -- 172.21.15.39:0/146700423 learned_addr learned my addr 172.21.15.39:0/146700423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19200640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed1415e340 0x7fed14156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1a600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 0x7fed141571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 -- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed1415e340 msgr2=0x7fed14156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed1415e340 0x7fed14156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 -- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 msgr2=0x7fed141571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 0x7fed141571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 -- 172.21.15.39:0/146700423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed141408e0 con 0x7fed14140170 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed1a600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 0x7fed141571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.065+0000 7fed19c00640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed0800e960 tx=0x7fed0800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08017070 con 0x7fed14140170 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0800ca00 con 0x7fed14140170 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0800cdb0 con 0x7fed14140170 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed14141020 con 0x7fed14140170 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed14140570 con 0x7fed14140170 2024-04-26T23:26:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1406a720 con 0x7fed14140170 2024-04-26T23:26:50.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed0801a070 con 0x7fed14140170 2024-04-26T23:26:50.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 0x7fecf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fed08086e50 con 0x7fed14140170 2024-04-26T23:26:50.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.069+0000 7fed19200640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 0x7fecf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.073+0000 7fed19200640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 0x7fecf406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad000 tx=0x7fed000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.073+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed08057370 con 0x7fed14140170 2024-04-26T23:26:50.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.237+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fed14072d10 con 0x7fed14140170 2024-04-26T23:26:50.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed11600640 1 -- 172.21.15.39:0/146700423 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fed0805d030 con 0x7fed14140170 2024-04-26T23:26:50.244 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 msgr2=0x7fecf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 0x7fecf406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad000 tx=0x7fed000a6000 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 msgr2=0x7fed141565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed0800e960 tx=0x7fed0800ee20 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 shutdown_connections 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fecf4068380 0x7fecf406a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed14161850 0x7fed141571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fed1415e340 0x7fed14156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 --2- 172.21.15.39:0/146700423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed14140170 0x7fed141565c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 >> 172.21.15.39:0/146700423 conn(0x7fed1406c7d0 msgr2=0x7fed1415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:50.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 shutdown_connections 2024-04-26T23:26:50.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.241+0000 7fed1c600640 1 -- 172.21.15.39:0/146700423 wait complete. 2024-04-26T23:26:50.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:26:50.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.401+0000 7f0ae0800640 1 Processor -- start 2024-04-26T23:26:50.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.401+0000 7f0ae0800640 1 -- start start 2024-04-26T23:26:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ae0800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ae0800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80ceb20 con 0x7f0ad80b1460 2024-04-26T23:26:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ae0800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80cee00 con 0x7f0ad80cfb70 2024-04-26T23:26:50.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ae0800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad80affc0 con 0x7f0ad815d5e0 2024-04-26T23:26:50.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ade800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0ad80b1460 0x7f0ad80d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53382/0 (socket says 172.21.15.39:53382) 2024-04-26T23:26:50.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0ade800640 1 -- 172.21.15.39:0/2977432571 learned_addr learned my addr 172.21.15.39:0/2977432571 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:50.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adde00640 1 --2- 172.21.15.39:0/2977432571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205051041 0 0) 0x7f0ad80ceb20 con 0x7f0ad80b1460 2024-04-26T23:26:50.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac0003530 con 0x7f0ad80b1460 2024-04-26T23:26:50.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358133099 0 0) 0x7f0ad80cee00 con 0x7f0ad80cfb70 2024-04-26T23:26:50.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adde00640 1 -- 172.21.15.39:0/2977432571 >> v1:172.21.15.71:6789/0 conn(0x7f0ad80cfb70 legacy=0x7f0ad80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adde00640 1 -- 172.21.15.39:0/2977432571 >> v1:172.21.15.39:6789/0 conn(0x7f0ad80b1460 legacy=0x7f0ad80d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.405+0000 7f0adde00640 1 -- 172.21.15.39:0/2977432571 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80cf0e0 con 0x7f0ad815d5e0 2024-04-26T23:26:50.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0adde00640 1 --2- 172.21.15.39:0/2977432571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad80cf630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097f0 tx=0x7f0acc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c67ed6b44a1d1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0ab5f0 con 0x7f0ad815d5e0 2024-04-26T23:26:50.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0b0070 con 0x7f0ad815d5e0 2024-04-26T23:26:50.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0adca00640 1 -- 172.21.15.39:0/2977432571 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0ab9b0 con 0x7f0ad815d5e0 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- 172.21.15.39:0/2977432571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 msgr2=0x7f0ad80cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2977432571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad80cf630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097f0 tx=0x7f0acc01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- 172.21.15.39:0/2977432571 shutdown_connections 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2977432571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad80cf630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- 172.21.15.39:0/2977432571 >> 172.21.15.39:0/2977432571 conn(0x7f0ad80d3020 msgr2=0x7f0ad80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- 172.21.15.39:0/2977432571 shutdown_connections 2024-04-26T23:26:50.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- 172.21.15.39:0/2977432571 wait complete. 2024-04-26T23:26:50.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 Processor -- start 2024-04-26T23:26:50.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.409+0000 7f0ae0800640 1 -- start start 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad80cfb70 0x7f0ad815c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80ce8c0 con 0x7f0ad80b1460 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80ce740 con 0x7f0ad80cfb70 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad816ba60 con 0x7f0ad815d5e0 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35288/0 (socket says 172.21.15.39:35288) 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 -- 172.21.15.39:0/2366569623 learned_addr learned my addr 172.21.15.39:0/2366569623 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0add400640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad80cfb70 0x7f0ad815c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ade800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 -- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 msgr2=0x7f0ad8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 -- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad80cfb70 msgr2=0x7f0ad815c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad80cfb70 0x7f0ad815c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 -- 172.21.15.39:0/2366569623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8157e30 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0adde00640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0acc097ec0 tx=0x7f0acc019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0c3070 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0b4830 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0b4c00 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad8158130 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad80b7340 con 0x7f0ad80b1460 2024-04-26T23:26:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.413+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad806a720 con 0x7f0ad80b1460 2024-04-26T23:26:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.417+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0acc0ab3f0 con 0x7f0ad80b1460 2024-04-26T23:26:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.417+0000 7f0ad2000640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 0x7f0abc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.417+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0acc1205c0 con 0x7f0ad80b1460 2024-04-26T23:26:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.417+0000 7f0add400640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 0x7f0abc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.417+0000 7f0add400640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 0x7f0abc06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80c8f90 tx=0x7f0ac8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:50.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.421+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ad8158130 con 0x7f0ad80b1460 2024-04-26T23:26:50.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ad8158860 con 0x7f0ad80b1460 2024-04-26T23:26:50.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ad2000640 1 -- 172.21.15.39:0/2366569623 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0acc0b9070 con 0x7f0ad80b1460 2024-04-26T23:26:50.603 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 msgr2=0x7f0abc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 0x7f0abc06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80c8f90 tx=0x7f0ac8009040 comp rx=0 tx=0).stop 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 msgr2=0x7f0ad80c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.597+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0acc097ec0 tx=0x7f0acc019280 comp rx=0 tx=0).stop 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 shutdown_connections 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0abc068380 0x7f0abc06a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad815d5e0 0x7f0ad8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad80cfb70 0x7f0ad815c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 --2- 172.21.15.39:0/2366569623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad80b1460 0x7f0ad80c84e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:50.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 >> 172.21.15.39:0/2366569623 conn(0x7f0ad80d3020 msgr2=0x7f0ad814d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:50.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 shutdown_connections 2024-04-26T23:26:50.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:50.601+0000 7f0ae0800640 1 -- 172.21.15.39:0/2366569623 wait complete. 2024-04-26T23:26:50.624 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T23:26:50.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:50.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-26T23:26:50.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:26:50.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:50.909 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:26:50.928 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:50.928 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:50.937 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:50.937 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:50.987 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:26:50.987 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:51.039 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:51.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.217+0000 7f55cc000640 1 Processor -- start 2024-04-26T23:26:51.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.217+0000 7f55cc000640 1 -- start start 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55cc000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f55c40742f0 0x7f55c40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55cc000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cdbf0 0x7f55c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55cc000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c4074750 con 0x7f55c40cd810 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55cc000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f55c40d0b10 con 0x7f55c40742f0 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55cc000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f55c406e970 con 0x7f55c40cdbf0 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c9600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f55c40cd810 0x7f55c4144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53388/0 (socket says 172.21.15.39:53388) 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c9600640 1 -- 172.21.15.39:0/176286419 learned_addr learned my addr 172.21.15.39:0/176286419 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c8c00640 1 --2- 172.21.15.39:0/176286419 >> v2:172.21.15.39:3300/0 conn(0x7f55c40742f0 0x7f55c40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55ca000640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cdbf0 0x7f55c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c8c00640 1 -- 172.21.15.39:0/176286419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cdbf0 msgr2=0x7f55c406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:51.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c8c00640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cdbf0 0x7f55c406ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c8c00640 1 -- 172.21.15.39:0/176286419 >> v1:172.21.15.39:6789/0 conn(0x7f55c40cd810 legacy=0x7f55c4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c8c00640 1 -- 172.21.15.39:0/176286419 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c40d0550 con 0x7f55c40742f0 2024-04-26T23:26:51.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.221+0000 7f55c3e00640 1 -- 172.21.15.39:0/176286419 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200494929 0 0) 0x7f55c4074750 con 0x7f55c40cd810 2024-04-26T23:26:51.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55c8c00640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c40cfe00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f55b00097c0 tx=0x7f55b001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2b391220b35879 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55c3e00640 1 -- 172.21.15.39:0/176286419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00b0070 con 0x7f55c40742f0 2024-04-26T23:26:51.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55c3e00640 1 -- 172.21.15.39:0/176286419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00ab600 con 0x7f55c40742f0 2024-04-26T23:26:51.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55c3e00640 1 -- 172.21.15.39:0/176286419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00ab9d0 con 0x7f55c40742f0 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- 172.21.15.39:0/176286419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 msgr2=0x7f55c40cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c40cfe00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f55b00097c0 tx=0x7f55b001c350 comp rx=0 tx=0).stop 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- 172.21.15.39:0/176286419 shutdown_connections 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cdbf0 0x7f55c406ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 --2- 172.21.15.39:0/176286419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c40cfe00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- 172.21.15.39:0/176286419 >> 172.21.15.39:0/176286419 conn(0x7f55c40b2af0 msgr2=0x7f55c40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:51.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- 172.21.15.39:0/176286419 shutdown_connections 2024-04-26T23:26:51.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- 172.21.15.39:0/176286419 wait complete. 2024-04-26T23:26:51.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 Processor -- start 2024-04-26T23:26:51.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.225+0000 7f55cc000640 1 -- start start 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cd810 0x7f55c40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c40cdbf0 0x7f55c4142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4143d30 con 0x7f55c40742f0 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4143bb0 con 0x7f55c40cdbf0 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f55c4169ef0 con 0x7f55c40cd810 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35302/0 (socket says 172.21.15.39:35302) 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 -- 172.21.15.39:0/1822417161 learned_addr learned my addr 172.21.15.39:0/1822417161 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55ca000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c40cdbf0 0x7f55c4142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c8c00640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cd810 0x7f55c40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 -- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cd810 msgr2=0x7f55c40b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cd810 0x7f55c40b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 -- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c40cdbf0 msgr2=0x7f55c4142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c40cdbf0 0x7f55c4142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 -- 172.21.15.39:0/1822417161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c40d0110 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c9600640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55b80011f0 tx=0x7f55b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8018070 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b80074e0 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8004a10 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c40b4690 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c40b4c50 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c4050740 con 0x7f55c40742f0 2024-04-26T23:26:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.229+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55b801b070 con 0x7f55c40742f0 2024-04-26T23:26:51.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.233+0000 7f55c1600640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 0x7f55a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.233+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55b8085c20 con 0x7f55c40742f0 2024-04-26T23:26:51.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.233+0000 7f55c8c00640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 0x7f55a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.233+0000 7f55c8c00640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 0x7f55a406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad000 tx=0x7f55b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.237+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f55b8055b90 con 0x7f55c40742f0 2024-04-26T23:26:51.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.401+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55c406d3e0 con 0x7f55c40742f0 2024-04-26T23:26:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55c1600640 1 -- 172.21.15.39:0/1822417161 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f55b8059e90 con 0x7f55c40742f0 2024-04-26T23:26:51.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:51.409 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 msgr2=0x7f55a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 0x7f55a406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad000 tx=0x7f55b0008040 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 msgr2=0x7f55c4161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55b80011f0 tx=0x7f55b800c9b0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 shutdown_connections 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f55a4068380 0x7f55a406a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c40cdbf0 0x7f55c4142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55c40cd810 0x7f55c40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 --2- 172.21.15.39:0/1822417161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55c40742f0 0x7f55c4161050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 >> 172.21.15.39:0/1822417161 conn(0x7f55c40b2af0 msgr2=0x7f55c40b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:51.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 shutdown_connections 2024-04-26T23:26:51.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.405+0000 7f55cc000640 1 -- 172.21.15.39:0/1822417161 wait complete. 2024-04-26T23:26:51.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:51.432 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:51.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.569+0000 7f007ee00640 1 Processor -- start 2024-04-26T23:26:51.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.569+0000 7f007ee00640 1 -- start start 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f007ee00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f007814d140 0x7f0078163c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f007ee00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f007806e460 0x7f00780d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f007ee00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007806ee40 con 0x7f007806e8c0 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f007ee00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f00781641b0 con 0x7f007806e460 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f007ee00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f007806f120 con 0x7f007814d140 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f007806e460 0x7f00780d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f007806e460 0x7f00780d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35316/0 (socket says 172.21.15.39:35316) 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 -- 172.21.15.39:0/1071974625 learned_addr learned my addr 172.21.15.39:0/1071974625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:51.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f0077e00640 1 --2- 172.21.15.39:0/1071974625 >> v2:172.21.15.71:3300/0 conn(0x7f007814d140 0x7f0078163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 -- 172.21.15.39:0/1071974625 >> v2:172.21.15.71:3300/0 conn(0x7f007814d140 msgr2=0x7f0078163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 --2- 172.21.15.39:0/1071974625 >> v2:172.21.15.71:3300/0 conn(0x7f007814d140 0x7f0078163c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 -- 172.21.15.39:0/1071974625 >> v1:172.21.15.71:6789/0 conn(0x7f007806e8c0 legacy=0x7f00780b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.573+0000 7f006fe00640 1 -- 172.21.15.39:0/1071974625 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007806f400 con 0x7f007806e460 2024-04-26T23:26:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f006fe00640 1 --2- 172.21.15.39:0/1071974625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e460 0x7f00780d11e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f007806fe60 tx=0x7f006001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b625ea8e0e18e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f0077400640 1 -- 172.21.15.39:0/1071974625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600b0070 con 0x7f007806e460 2024-04-26T23:26:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f0077400640 1 -- 172.21.15.39:0/1071974625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00600ab600 con 0x7f007806e460 2024-04-26T23:26:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f0077400640 1 -- 172.21.15.39:0/1071974625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600ab9d0 con 0x7f007806e460 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- 172.21.15.39:0/1071974625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e460 msgr2=0x7f00780d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- 172.21.15.39:0/1071974625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e460 0x7f00780d11e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f007806fe60 tx=0x7f006001c450 comp rx=0 tx=0).stop 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- 172.21.15.39:0/1071974625 shutdown_connections 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- 172.21.15.39:0/1071974625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e460 0x7f00780d11e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- 172.21.15.39:0/1071974625 >> v2:172.21.15.71:3300/0 conn(0x7f007814d140 0x7f0078163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- 172.21.15.39:0/1071974625 >> 172.21.15.39:0/1071974625 conn(0x7f007806c7d0 msgr2=0x7f007806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- 172.21.15.39:0/1071974625 shutdown_connections 2024-04-26T23:26:51.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- 172.21.15.39:0/1071974625 wait complete. 2024-04-26T23:26:51.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 Processor -- start 2024-04-26T23:26:51.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- start start 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f007806e460 0x7f00781450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f007814d140 0x7f0078163210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00780b58f0 con 0x7f007806e8c0 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00780b5770 con 0x7f007814d140 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.577+0000 7f007ee00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0078072230 con 0x7f007806e460 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35328/0 (socket says 172.21.15.39:35328) 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 -- 172.21.15.39:0/2903337121 learned_addr learned my addr 172.21.15.39:0/2903337121 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0077e00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f007806e460 0x7f00781450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f007ce00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f007814d140 0x7f0078163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 -- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f007806e460 msgr2=0x7f00781450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f007806e460 0x7f00781450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 -- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f007814d140 msgr2=0x7f0078163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f007814d140 0x7f0078163210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 -- 172.21.15.39:0/2903337121 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00781611a0 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f006fe00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f006001a080 tx=0x7f00600191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600b9070 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00600b4420 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600b0040 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0078161480 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0078161760 con 0x7f007806e8c0 2024-04-26T23:26:51.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007806a720 con 0x7f007806e8c0 2024-04-26T23:26:51.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00600bc070 con 0x7f007806e8c0 2024-04-26T23:26:51.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.581+0000 7f0074c00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 0x7f005406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.585+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f006011fb50 con 0x7f007806e8c0 2024-04-26T23:26:51.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.585+0000 7f0077e00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 0x7f005406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.585+0000 7f0077e00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 0x7f005406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0078200770 tx=0x7f0068008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.589+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00600160d0 con 0x7f007806e8c0 2024-04-26T23:26:51.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00780d05d0 con 0x7f007806e8c0 2024-04-26T23:26:51.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f0074c00640 1 -- 172.21.15.39:0/2903337121 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f00600efab0 con 0x7f007806e8c0 2024-04-26T23:26:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 msgr2=0x7f005406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 0x7f005406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0078200770 tx=0x7f0068008040 comp rx=0 tx=0).stop 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 msgr2=0x7f0078162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f006001a080 tx=0x7f00600191f0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 shutdown_connections 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0054068380 0x7f005406a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f007814d140 0x7f0078163210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f007806e8c0 0x7f0078162cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 --2- 172.21.15.39:0/2903337121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f007806e460 0x7f00781450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.753+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 >> 172.21.15.39:0/2903337121 conn(0x7f007806c7d0 msgr2=0x7f007814c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.757+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 shutdown_connections 2024-04-26T23:26:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.757+0000 7f007ee00640 1 -- 172.21.15.39:0/2903337121 wait complete. 2024-04-26T23:26:51.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:51.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 Processor -- start 2024-04-26T23:26:51.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 -- start start 2024-04-26T23:26:51.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff7ec161850 0x7ff7ec0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec0d1720 0x7ff7ec0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec06e500 con 0x7ff7ec140170 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ec06f110 con 0x7ff7ec161850 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7f1a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec06e7e0 con 0x7ff7ec0d1720 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff7ec161850 0x7ff7ec0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff7ec161850 0x7ff7ec0d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35332/0 (socket says 172.21.15.39:35332) 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 -- 172.21.15.39:0/4261946064 learned_addr learned my addr 172.21.15.39:0/4261946064 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7eb400640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec0d1720 0x7ff7ec0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 -- 172.21.15.39:0/4261946064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec0d1720 msgr2=0x7ff7ec0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec0d1720 0x7ff7ec0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 -- 172.21.15.39:0/4261946064 >> v1:172.21.15.71:6789/0 conn(0x7ff7ec140170 legacy=0x7ff7ec15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.921+0000 7ff7e2000640 1 -- 172.21.15.39:0/4261946064 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec06eac0 con 0x7ff7ec161850 2024-04-26T23:26:51.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7e2000640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec161850 0x7ff7ec0d11e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009870 tx=0x7ff7d401cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572f3e0a6068ae90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7ea000640 1 -- 172.21.15.39:0/4261946064 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40b1070 con 0x7ff7ec161850 2024-04-26T23:26:51.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7ea000640 1 -- 172.21.15.39:0/4261946064 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d40a8050 con 0x7ff7ec161850 2024-04-26T23:26:51.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7ea000640 1 -- 172.21.15.39:0/4261946064 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40ac860 con 0x7ff7ec161850 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- 172.21.15.39:0/4261946064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec161850 msgr2=0x7ff7ec0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec161850 0x7ff7ec0d11e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009870 tx=0x7ff7d401cef0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- 172.21.15.39:0/4261946064 shutdown_connections 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec0d1720 0x7ff7ec0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/4261946064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec161850 0x7ff7ec0d11e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- 172.21.15.39:0/4261946064 >> 172.21.15.39:0/4261946064 conn(0x7ff7ec06c7d0 msgr2=0x7ff7ec06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- 172.21.15.39:0/4261946064 shutdown_connections 2024-04-26T23:26:51.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- 172.21.15.39:0/4261946064 wait complete. 2024-04-26T23:26:51.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 Processor -- start 2024-04-26T23:26:51.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.925+0000 7ff7f1a00640 1 -- start start 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec140170 0x7ff7ec156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 0x7ff7ec13e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d0850 con 0x7ff7ec0d1720 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d06d0 con 0x7ff7ec161850 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d09d0 con 0x7ff7ec140170 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35346/0 (socket says 172.21.15.39:35346) 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 -- 172.21.15.39:0/3960287167 learned_addr learned my addr 172.21.15.39:0/3960287167 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eb400640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 0x7ff7ec13e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7e2000640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec140170 0x7ff7ec156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 -- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec140170 msgr2=0x7ff7ec156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec140170 0x7ff7ec156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 -- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 msgr2=0x7ff7ec13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 0x7ff7ec13e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 -- 172.21.15.39:0/3960287167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec137970 con 0x7ff7ec0d1720 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eb400640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 0x7ff7ec13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7eaa00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c420 tx=0x7ff7dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0052d0 con 0x7ff7ec0d1720 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc005470 con 0x7ff7ec0d1720 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec152f90 con 0x7ff7ec0d1720 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc007260 con 0x7ff7ec0d1720 2024-04-26T23:26:51.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec153990 con 0x7ff7ec0d1720 2024-04-26T23:26:51.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.929+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec06a720 con 0x7ff7ec0d1720 2024-04-26T23:26:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.933+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7dc007400 con 0x7ff7ec0d1720 2024-04-26T23:26:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.933+0000 7ff7e3400640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 0x7ff7c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.933+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff7dc085eb0 con 0x7ff7ec0d1720 2024-04-26T23:26:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.933+0000 7ff7e2000640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 0x7ff7c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.933+0000 7ff7e2000640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 0x7ff7c806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40ae000 tx=0x7ff7d4004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:51.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:51.937+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff7dc055d80 con 0x7ff7ec0d1720 2024-04-26T23:26:52.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7ec0cf950 con 0x7ff7ec0d1720 2024-04-26T23:26:52.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7e3400640 1 -- 172.21.15.39:0/3960287167 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ff7dc05a080 con 0x7ff7ec0d1720 2024-04-26T23:26:52.105 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 msgr2=0x7ff7c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 0x7ff7c806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40ae000 tx=0x7ff7d4004740 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 msgr2=0x7ff7ec137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c420 tx=0x7ff7dc00c8e0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 shutdown_connections 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7c8068380 0x7ff7c806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ec161850 0x7ff7ec13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ec140170 0x7ff7ec156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 --2- 172.21.15.39:0/3960287167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0d1720 0x7ff7ec137430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 >> 172.21.15.39:0/3960287167 conn(0x7ff7ec06c7d0 msgr2=0x7ff7ec1600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 shutdown_connections 2024-04-26T23:26:52.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.101+0000 7ff7f1a00640 1 -- 172.21.15.39:0/3960287167 wait complete. 2024-04-26T23:26:52.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 Processor -- start 2024-04-26T23:26:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 -- start start 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 0x7f6ae415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ae415e340 0x7f6ae40d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 0x7f6ae40d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae406f110 con 0x7f6ae415e340 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae406e500 con 0x7f6ae4161850 2024-04-26T23:26:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.265+0000 7f6aeb400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae406e7e0 con 0x7f6ae4140170 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ae415e340 0x7f6ae40d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ae415e340 0x7f6ae40d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35350/0 (socket says 172.21.15.39:35350) 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 -- 172.21.15.39:0/3458221161 learned_addr learned my addr 172.21.15.39:0/3458221161 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae8a00640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 0x7f6ae415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae9400640 1 --2- 172.21.15.39:0/3458221161 >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 0x7f6ae40d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 -- 172.21.15.39:0/3458221161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 msgr2=0x7f6ae415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 0x7f6ae415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 -- 172.21.15.39:0/3458221161 >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 msgr2=0x7f6ae40d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3458221161 >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 0x7f6ae40d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 -- 172.21.15.39:0/3458221161 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae406eac0 con 0x7f6ae415e340 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae8a00640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 0x7f6ae415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae9400640 1 --2- 172.21.15.39:0/3458221161 >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 0x7f6ae40d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae415e340 0x7f6ae40d11e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6ae41437a0 tx=0x7f6acc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd815103f410aad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae3e00640 1 -- 172.21.15.39:0/3458221161 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0ab640 con 0x7f6ae415e340 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae3e00640 1 -- 172.21.15.39:0/3458221161 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc0b0070 con 0x7f6ae415e340 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.269+0000 7f6ae3e00640 1 -- 172.21.15.39:0/3458221161 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0aba00 con 0x7f6ae415e340 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- 172.21.15.39:0/3458221161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae415e340 msgr2=0x7f6ae40d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae415e340 0x7f6ae40d11e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6ae41437a0 tx=0x7f6acc01c460 comp rx=0 tx=0).stop 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- 172.21.15.39:0/3458221161 shutdown_connections 2024-04-26T23:26:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3458221161 >> v2:172.21.15.71:3300/0 conn(0x7f6ae4161850 0x7f6ae40d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae415e340 0x7f6ae40d11e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3458221161 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae4140170 0x7f6ae415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- 172.21.15.39:0/3458221161 >> 172.21.15.39:0/3458221161 conn(0x7f6ae406c7d0 msgr2=0x7f6ae406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- 172.21.15.39:0/3458221161 shutdown_connections 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- 172.21.15.39:0/3458221161 wait complete. 2024-04-26T23:26:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 Processor -- start 2024-04-26T23:26:52.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- start start 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae415e340 0x7f6ae4137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 0x7f6ae40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41432a0 con 0x7f6ae4140170 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4143120 con 0x7f6ae4161850 2024-04-26T23:26:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6aeb400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae4143420 con 0x7f6ae415e340 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35352/0 (socket says 172.21.15.39:35352) 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 -- 172.21.15.39:0/3386375168 learned_addr learned my addr 172.21.15.39:0/3386375168 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae415e340 0x7f6ae4137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae9400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 0x7f6ae40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 -- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae415e340 msgr2=0x7f6ae4137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae415e340 0x7f6ae4137b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 -- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 msgr2=0x7f6ae40720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 0x7f6ae40720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae8a00640 1 -- 172.21.15.39:0/3386375168 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae4139580 con 0x7f6ae4140170 2024-04-26T23:26:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.273+0000 7f6ae9400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 0x7f6ae40720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae8a00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7f0 tx=0x7f6ad400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4007a30 con 0x7f6ae4140170 2024-04-26T23:26:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4007bd0 con 0x7f6ae4140170 2024-04-26T23:26:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40113f0 con 0x7f6ae4140170 2024-04-26T23:26:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae4138ce0 con 0x7f6ae4140170 2024-04-26T23:26:52.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41392a0 con 0x7f6ae4140170 2024-04-26T23:26:52.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae4075c00 con 0x7f6ae4140170 2024-04-26T23:26:52.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ad4011590 con 0x7f6ae4140170 2024-04-26T23:26:52.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 0x7f6ac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad4086b00 con 0x7f6ae4140170 2024-04-26T23:26:52.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.277+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 0x7f6ac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.281+0000 7f6adbe00640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 0x7f6ac006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0af000 tx=0x7f6acc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.281+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6ad4015020 con 0x7f6ae4140170 2024-04-26T23:26:52.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6ae406fdc0 con 0x7f6ae4140170 2024-04-26T23:26:52.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6ae1600640 1 -- 172.21.15.39:0/3386375168 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f6ad4056a60 con 0x7f6ae4140170 2024-04-26T23:26:52.454 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:52.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 msgr2=0x7f6ac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 0x7f6ac006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0af000 tx=0x7f6acc0a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:52.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 msgr2=0x7f6ae41565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.448+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7f0 tx=0x7f6ad400ccb0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 shutdown_connections 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ac0068380 0x7f6ac006a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae4161850 0x7f6ae40720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae415e340 0x7f6ae4137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 --2- 172.21.15.39:0/3386375168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ae4140170 0x7f6ae41565c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 >> 172.21.15.39:0/3386375168 conn(0x7f6ae406c7d0 msgr2=0x7f6ae40753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 shutdown_connections 2024-04-26T23:26:52.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.452+0000 7f6aeb400640 1 -- 172.21.15.39:0/3386375168 wait complete. 2024-04-26T23:26:52.475 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:26:52.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 Processor -- start 2024-04-26T23:26:52.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 -- start start 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe4a00cf8c0 0x7fe4a00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe4a006d970 0x7fe4a00b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a00d01e0 con 0x7fe4a006d4e0 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a006dd80 con 0x7fe4a006d970 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a6a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a006dfa0 con 0x7fe4a00cf8c0 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe497e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe4a006d4e0 0x7fe4a00d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53404/0 (socket says 172.21.15.39:53404) 2024-04-26T23:26:52.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe497e00640 1 -- 172.21.15.39:0/3007653427 learned_addr learned my addr 172.21.15.39:0/3007653427 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a4a00640 1 --2- 172.21.15.39:0/3007653427 >> v2:172.21.15.39:3300/0 conn(0x7fe4a006d970 0x7fe4a00b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe49fe00640 1 --2- 172.21.15.39:0/3007653427 >> v2:172.21.15.71:3300/0 conn(0x7fe4a00cf8c0 0x7fe4a00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a4a00640 1 -- 172.21.15.39:0/3007653427 >> v2:172.21.15.71:3300/0 conn(0x7fe4a00cf8c0 msgr2=0x7fe4a00cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a4a00640 1 --2- 172.21.15.39:0/3007653427 >> v2:172.21.15.71:3300/0 conn(0x7fe4a00cf8c0 0x7fe4a00cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a4a00640 1 -- 172.21.15.39:0/3007653427 >> v1:172.21.15.39:6789/0 conn(0x7fe4a006d4e0 legacy=0x7fe4a00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe4a4a00640 1 -- 172.21.15.39:0/3007653427 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a006e280 con 0x7fe4a006d970 2024-04-26T23:26:52.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.612+0000 7fe49f400640 1 -- 172.21.15.39:0/3007653427 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36240126 0 0) 0x7fe4a00d01e0 con 0x7fe4a006d4e0 2024-04-26T23:26:52.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a4a00640 1 --2- 172.21.15.39:0/3007653427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00b37f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00d3ca0 tx=0x7fe49801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e292bfb9168ad105 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe49f400640 1 -- 172.21.15.39:0/3007653427 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980b2070 con 0x7fe4a006d970 2024-04-26T23:26:52.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe49f400640 1 -- 172.21.15.39:0/3007653427 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4980a59c0 con 0x7fe4a006d970 2024-04-26T23:26:52.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe49f400640 1 -- 172.21.15.39:0/3007653427 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980a5d90 con 0x7fe4a006d970 2024-04-26T23:26:52.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 -- 172.21.15.39:0/3007653427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 msgr2=0x7fe4a00b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/3007653427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00b37f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00d3ca0 tx=0x7fe49801c900 comp rx=0 tx=0).stop 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 -- 172.21.15.39:0/3007653427 shutdown_connections 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/3007653427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00b37f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/3007653427 >> v2:172.21.15.71:3300/0 conn(0x7fe4a00cf8c0 0x7fe4a00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 -- 172.21.15.39:0/3007653427 >> 172.21.15.39:0/3007653427 conn(0x7fe4a00d3040 msgr2=0x7fe4a00d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 -- 172.21.15.39:0/3007653427 shutdown_connections 2024-04-26T23:26:52.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.616+0000 7fe4a6a00640 1 -- 172.21.15.39:0/3007653427 wait complete. 2024-04-26T23:26:52.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 Processor -- start 2024-04-26T23:26:52.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- start start 2024-04-26T23:26:52.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4a006d4e0 0x7fe4a00cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 0x7fe4a0158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00b4730 con 0x7fe4a006d970 2024-04-26T23:26:52.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00b4140 con 0x7fe4a00cf8c0 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a00d17e0 con 0x7fe4a006d4e0 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35374/0 (socket says 172.21.15.39:35374) 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 -- 172.21.15.39:0/2632168379 learned_addr learned my addr 172.21.15.39:0/2632168379 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe49fe00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4a006d4e0 0x7fe4a00cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a4a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 0x7fe4a0158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 -- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4a006d4e0 msgr2=0x7fe4a00cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4a006d4e0 0x7fe4a00cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 -- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 msgr2=0x7fe4a0158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 0x7fe4a0158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 -- 172.21.15.39:0/2632168379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a0151d70 con 0x7fe4a006d970 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a4a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 0x7fe4a0158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe497e00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c480 tx=0x7fe48800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe488018070 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe488007500 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe488004a30 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a0152050 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a0152610 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.620+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a006a720 con 0x7fe4a006d970 2024-04-26T23:26:52.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.624+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe488004bd0 con 0x7fe4a006d970 2024-04-26T23:26:52.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.624+0000 7fe49cc00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 0x7fe47c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:52.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.624+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe488085b90 con 0x7fe4a006d970 2024-04-26T23:26:52.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.624+0000 7fe49fe00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 0x7fe47c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:52.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.624+0000 7fe49fe00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 0x7fe47c06a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4a015a2e0 tx=0x7fe490008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:52.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.628+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe488055af0 con 0x7fe4a006d970 2024-04-26T23:26:52.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4a0152980 con 0x7fe4a006d970 2024-04-26T23:26:52.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe49cc00640 1 -- 172.21.15.39:0/2632168379 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe488059df0 con 0x7fe4a006d970 2024-04-26T23:26:52.809 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:26:52.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 msgr2=0x7fe47c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 0x7fe47c06a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4a015a2e0 tx=0x7fe490008040 comp rx=0 tx=0).stop 2024-04-26T23:26:52.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 msgr2=0x7fe4a00cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:52.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c480 tx=0x7fe48800c940 comp rx=0 tx=0).stop 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 shutdown_connections 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe47c0683b0 0x7fe47c06a870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4a00cf8c0 0x7fe4a0158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4a006d970 0x7fe4a00cdfd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 --2- 172.21.15.39:0/2632168379 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe4a006d4e0 0x7fe4a00cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 >> 172.21.15.39:0/2632168379 conn(0x7fe4a00d3040 msgr2=0x7fe4a00cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 shutdown_connections 2024-04-26T23:26:52.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:52.804+0000 7fe4a6a00640 1 -- 172.21.15.39:0/2632168379 wait complete. 2024-04-26T23:26:52.830 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-26T23:26:52.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:52.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-26T23:26:52.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:26:52.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:52.855 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T23:26:52.904 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:52.904 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:52.914 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:52.914 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:52.963 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:26:52.963 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:26:53.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:53.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 Processor -- start 2024-04-26T23:26:53.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 -- start start 2024-04-26T23:26:53.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f100c09c0f0 0x7f100c0b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c0cd810 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c0cdaf0 con 0x7f100c0b5710 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1013c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f100c0d26a0 con 0x7f100c09c0f0 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f100c15f340 0x7f100c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53416/0 (socket says 172.21.15.39:53416) 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011200640 1 -- 172.21.15.39:0/2671140338 learned_addr learned my addr 172.21.15.39:0/2671140338 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> v2:172.21.15.71:3300/0 conn(0x7f100c09c0f0 0x7f100c0b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444981189 0 0) 0x7f100c0cd810 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff4003530 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2675891332 0 0) 0x7f0ff4003530 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 >> v2:172.21.15.71:3300/0 conn(0x7f100c09c0f0 msgr2=0x7f100c0b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 --2- 172.21.15.39:0/2671140338 >> v2:172.21.15.71:3300/0 conn(0x7f100c09c0f0 0x7f100c0b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 >> v1:172.21.15.71:6789/0 conn(0x7f100c0b5710 legacy=0x7f100c09b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c0cddd0 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f1000001680 con 0x7f100c15f340 2024-04-26T23:26:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> v2:172.21.15.71:3300/0 conn(0x7f100c09c0f0 0x7f100c0b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 >> v1:172.21.15.39:6789/0 conn(0x7f100c15f340 legacy=0x7f100c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff4004810 0x7f0ff4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 0x7f0ff400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0d26a0 con 0x7f0ff40052f0 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff400c1c0 con 0x7f0ff40039c0 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff400c3c0 con 0x7f0ff4004810 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 0x7f0ff400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.152+0000 7f1011200640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f100be00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff4004810 0x7f0ff4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 -- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff4004810 msgr2=0x7f0ff4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff4004810 0x7f0ff4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 -- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40039c0 msgr2=0x7f0ff4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 -- 172.21.15.39:0/2671140338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4003530 con 0x7f0ff40052f0 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 -- 172.21.15.39:0/2671140338 reap_dead start 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1011c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 0x7f0ff400b9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f100c0737f0 tx=0x7f100401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902b4d06d4f13873 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004009c80 con 0x7f0ff40052f0 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10040a5cd0 con 0x7f0ff40052f0 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f100b400640 1 -- 172.21.15.39:0/2671140338 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040ad680 con 0x7f0ff40052f0 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 -- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 msgr2=0x7f0ff400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 0x7f0ff400b9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f100c0737f0 tx=0x7f100401cee0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 -- 172.21.15.39:0/2671140338 shutdown_connections 2024-04-26T23:26:53.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 --2- 172.21.15.39:0/2671140338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ff40052f0 0x7f0ff400b9d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 -- 172.21.15.39:0/2671140338 >> 172.21.15.39:0/2671140338 conn(0x7f100c0b4b80 msgr2=0x7f100c0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:53.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.156+0000 7f1013c00640 1 -- 172.21.15.39:0/2671140338 shutdown_connections 2024-04-26T23:26:53.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- 172.21.15.39:0/2671140338 wait complete. 2024-04-26T23:26:53.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 Processor -- start 2024-04-26T23:26:53.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- start start 2024-04-26T23:26:53.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40052f0 0x7f100c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f100c0cc5f0 0x7f100c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0ce140 con 0x7f100c0b8290 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f100c15f720 con 0x7f0ff40052f0 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f100c15f8a0 con 0x7f100c0cc5f0 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35390/0 (socket says 172.21.15.39:35390) 2024-04-26T23:26:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 -- 172.21.15.39:0/3809582434 learned_addr learned my addr 172.21.15.39:0/3809582434 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011200640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40052f0 0x7f100c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f100be00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f100c0cc5f0 0x7f100c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 -- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f100c0cc5f0 msgr2=0x7f100c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f100c0cc5f0 0x7f100c153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 -- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40052f0 msgr2=0x7f100c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40052f0 0x7f100c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 -- 172.21.15.39:0/3809582434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c0cb550 con 0x7f100c0b8290 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1011c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f100401cd10 tx=0x7f0ff4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004009c80 con 0x7f100c0b8290 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10040adcd0 con 0x7f100c0b8290 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004003bc0 con 0x7f100c0b8290 2024-04-26T23:26:53.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c0cb830 con 0x7f100c0b8290 2024-04-26T23:26:53.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.160+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c0cbdf0 con 0x7f100c0b8290 2024-04-26T23:26:53.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.164+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100c050740 con 0x7f100c0b8290 2024-04-26T23:26:53.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.164+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10040ac3e0 con 0x7f100c0b8290 2024-04-26T23:26:53.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.164+0000 7f1008c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 0x7f0fec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.164+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10041203e0 con 0x7f100c0b8290 2024-04-26T23:26:53.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.164+0000 7f1011200640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 0x7f0fec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.168+0000 7f1011200640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 0x7f0fec06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1000001ce0 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.168+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10040b5070 con 0x7f100c0b8290 2024-04-26T23:26:53.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.336+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f100c09bdf0 con 0x7f100c0b8290 2024-04-26T23:26:53.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.336+0000 7f1008c00640 1 -- 172.21.15.39:0/3809582434 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16545 (secure 0 0 0) 0x7f1004016bf0 con 0x7f100c0b8290 2024-04-26T23:26:53.343 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:53.343 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:15.713555+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:53.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 msgr2=0x7f0fec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 0x7f0fec06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1000001ce0 tx=0x7f1000009040 comp rx=0 tx=0).stop 2024-04-26T23:26:53.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 msgr2=0x7f100c0b8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f100401cd10 tx=0x7f0ff4005840 comp rx=0 tx=0).stop 2024-04-26T23:26:53.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 shutdown_connections 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0fec0683b0 0x7f0fec06a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f100c0b8290 0x7f100c0b8710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f100c0cc5f0 0x7f100c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 --2- 172.21.15.39:0/3809582434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff40052f0 0x7f100c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 >> 172.21.15.39:0/3809582434 conn(0x7f100c0b4b80 msgr2=0x7f100c0d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 shutdown_connections 2024-04-26T23:26:53.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.340+0000 7f1013c00640 1 -- 172.21.15.39:0/3809582434 wait complete. 2024-04-26T23:26:53.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:53.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:53.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 Processor -- start 2024-04-26T23:26:53.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 -- start start 2024-04-26T23:26:53.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbec4072e50 0x7fbec40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec4072180 con 0x7fbec41458d0 2024-04-26T23:26:53.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbec40739a0 con 0x7fbec4072e50 2024-04-26T23:26:53.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbecb800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbec4073c80 con 0x7fbec4073400 2024-04-26T23:26:53.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbebbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbec9800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbec4072e50 0x7fbec40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbebbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:56504/0 (socket says 172.21.15.39:56504) 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbebbe00640 1 -- 172.21.15.39:0/2589584275 learned_addr learned my addr 172.21.15.39:0/2589584275 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.504+0000 7fbec8e00640 1 --1- 172.21.15.39:0/2589584275 >> v1:172.21.15.71:6789/0 conn(0x7fbec41458d0 0x7fbec40b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:54834/0 (socket says 172.21.15.39:54834) 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec9800640 1 -- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 msgr2=0x7fbec4072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec9800640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec9800640 1 -- 172.21.15.39:0/2589584275 >> v1:172.21.15.71:6789/0 conn(0x7fbec41458d0 legacy=0x7fbec40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec9800640 1 -- 172.21.15.39:0/2589584275 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4145cb0 con 0x7fbec4072e50 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec3e00640 1 -- 172.21.15.39:0/2589584275 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255947603 0 0) 0x7fbec4072180 con 0x7fbec41458d0 2024-04-26T23:26:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbebbe00640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:53.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec9800640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec4072e50 0x7fbec40ce5e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009dc0 tx=0x7fbebc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff975c75d614f46b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec3e00640 1 -- 172.21.15.39:0/2589584275 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0b2070 con 0x7fbec4072e50 2024-04-26T23:26:53.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec3e00640 1 -- 172.21.15.39:0/2589584275 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0a5890 con 0x7fbec4072e50 2024-04-26T23:26:53.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbec3e00640 1 -- 172.21.15.39:0/2589584275 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0a5c60 con 0x7fbec4072e50 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 -- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec4072e50 msgr2=0x7fbec40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec4072e50 0x7fbec40ce5e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009dc0 tx=0x7fbebc01c8c0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 -- 172.21.15.39:0/2589584275 shutdown_connections 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec4072e50 0x7fbec40ce5e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 --2- 172.21.15.39:0/2589584275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec4072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.508+0000 7fbecb800640 1 -- 172.21.15.39:0/2589584275 >> 172.21.15.39:0/2589584275 conn(0x7fbec406c7d0 msgr2=0x7fbec406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- 172.21.15.39:0/2589584275 shutdown_connections 2024-04-26T23:26:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- 172.21.15.39:0/2589584275 wait complete. 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 Processor -- start 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- start start 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec41fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 0x7fbec41fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4169150 con 0x7fbec4072e50 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40cef30 con 0x7fbec41458d0 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbec41692d0 con 0x7fbec4073400 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35400/0 (socket says 172.21.15.39:35400) 2024-04-26T23:26:53.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 -- 172.21.15.39:0/275923087 learned_addr learned my addr 172.21.15.39:0/275923087 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 -- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 msgr2=0x7fbec41fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec41fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 -- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 msgr2=0x7fbec41fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec9800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 0x7fbec41fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 0x7fbec41fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 -- 172.21.15.39:0/275923087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41f9250 con 0x7fbec4072e50 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec9800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 0x7fbec41fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec8e00640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c480 tx=0x7fbeb400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4018070 con 0x7fbec4072e50 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb4007500 con 0x7fbec4072e50 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec4157500 con 0x7fbec4072e50 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4004a30 con 0x7fbec4072e50 2024-04-26T23:26:53.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.512+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41f9530 con 0x7fbec4072e50 2024-04-26T23:26:53.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec406a720 con 0x7fbec4072e50 2024-04-26T23:26:53.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbeb401b070 con 0x7fbec4072e50 2024-04-26T23:26:53.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbec1600640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 0x7fbea006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbeb4085d60 con 0x7fbec4072e50 2024-04-26T23:26:53.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbebbe00640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 0x7fbea006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.516+0000 7fbebbe00640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 0x7fbea006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009630 tx=0x7fbeac006ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.520+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbeb4056310 con 0x7fbec4072e50 2024-04-26T23:26:53.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.684+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbec40b4d80 con 0x7fbec4072e50 2024-04-26T23:26:53.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.684+0000 7fbec1600640 1 -- 172.21.15.39:0/275923087 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbeb4055c10 con 0x7fbec4072e50 2024-04-26T23:26:53.692 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 msgr2=0x7fbea006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 0x7fbea006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009630 tx=0x7fbeac006ea0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 msgr2=0x7fbec41f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c480 tx=0x7fbeb400c940 comp rx=0 tx=0).stop 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 shutdown_connections 2024-04-26T23:26:53.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbea0068380 0x7fbea006a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbec41458d0 0x7fbec41fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbec4073400 0x7fbec41fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 --2- 172.21.15.39:0/275923087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbec4072e50 0x7fbec41f8ae0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 >> 172.21.15.39:0/275923087 conn(0x7fbec406c7d0 msgr2=0x7fbec4144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 shutdown_connections 2024-04-26T23:26:53.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.688+0000 7fbecb800640 1 -- 172.21.15.39:0/275923087 wait complete. 2024-04-26T23:26:53.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:53.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.852+0000 7f9de9000640 1 Processor -- start 2024-04-26T23:26:53.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.852+0000 7f9de9000640 1 -- start start 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de9000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9de40709b0 0x7f9de406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9de406cae0 0x7f9de41638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de9000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de40cfd00 con 0x7f9de4070d90 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de9000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9de4163e20 con 0x7f9de40709b0 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de9000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9de40b1800 con 0x7f9de406cae0 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9de40709b0 0x7f9de406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9de40709b0 0x7f9de406ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35416/0 (socket says 172.21.15.39:35416) 2024-04-26T23:26:53.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 -- 172.21.15.39:0/3891824135 learned_addr learned my addr 172.21.15.39:0/3891824135 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:53.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3e00640 1 --2- 172.21.15.39:0/3891824135 >> v2:172.21.15.71:3300/0 conn(0x7f9de406cae0 0x7f9de41638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 -- 172.21.15.39:0/3891824135 >> v2:172.21.15.71:3300/0 conn(0x7f9de406cae0 msgr2=0x7f9de41638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 --2- 172.21.15.39:0/3891824135 >> v2:172.21.15.71:3300/0 conn(0x7f9de406cae0 0x7f9de41638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 -- 172.21.15.39:0/3891824135 >> v1:172.21.15.71:6789/0 conn(0x7f9de4070d90 legacy=0x7f9de406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:53.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.856+0000 7f9de3400640 1 -- 172.21.15.39:0/3891824135 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de40d1820 con 0x7f9de40709b0 2024-04-26T23:26:53.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de3400640 1 --2- 172.21.15.39:0/3891824135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de406ef80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9de4071c70 tx=0x7f9dd401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728cf6b53f1ba0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de2a00640 1 -- 172.21.15.39:0/3891824135 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40b5070 con 0x7f9de40709b0 2024-04-26T23:26:53.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de2a00640 1 -- 172.21.15.39:0/3891824135 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd40a8a10 con 0x7f9de40709b0 2024-04-26T23:26:53.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de2a00640 1 -- 172.21.15.39:0/3891824135 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40a8de0 con 0x7f9de40709b0 2024-04-26T23:26:53.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- 172.21.15.39:0/3891824135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 msgr2=0x7f9de406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 --2- 172.21.15.39:0/3891824135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de406ef80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9de4071c70 tx=0x7f9dd401ed10 comp rx=0 tx=0).stop 2024-04-26T23:26:53.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- 172.21.15.39:0/3891824135 shutdown_connections 2024-04-26T23:26:53.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 --2- 172.21.15.39:0/3891824135 >> v2:172.21.15.71:3300/0 conn(0x7f9de406cae0 0x7f9de41638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 --2- 172.21.15.39:0/3891824135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de406ef80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- 172.21.15.39:0/3891824135 >> 172.21.15.39:0/3891824135 conn(0x7f9de40d1e70 msgr2=0x7f9de40d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:53.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- 172.21.15.39:0/3891824135 shutdown_connections 2024-04-26T23:26:53.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- 172.21.15.39:0/3891824135 wait complete. 2024-04-26T23:26:53.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 Processor -- start 2024-04-26T23:26:53.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.860+0000 7f9de9000640 1 -- start start 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9de406cae0 0x7f9de415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de4070d90 0x7f9de40b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40cc840 con 0x7f9de40709b0 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40ccbb0 con 0x7f9de4070d90 2024-04-26T23:26:53.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9de40d1b00 con 0x7f9de406cae0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35418/0 (socket says 172.21.15.39:35418) 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 -- 172.21.15.39:0/2451187122 learned_addr learned my addr 172.21.15.39:0/2451187122 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de3400640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9de406cae0 0x7f9de415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de3e00640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de4070d90 0x7f9de40b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 -- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9de406cae0 msgr2=0x7f9de415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9de406cae0 0x7f9de415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 -- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de4070d90 msgr2=0x7f9de40b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de4070d90 0x7f9de40b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 -- 172.21.15.39:0/2451187122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de40b4bf0 con 0x7f9de40709b0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddbe00640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00c430 tx=0x7f9dcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0052d0 con 0x7f9de40709b0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc005470 con 0x7f9de40709b0 2024-04-26T23:26:53.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc007260 con 0x7f9de40709b0 2024-04-26T23:26:53.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de415eed0 con 0x7f9de40709b0 2024-04-26T23:26:53.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de40b4e50 con 0x7f9de40709b0 2024-04-26T23:26:53.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de40506d0 con 0x7f9de40709b0 2024-04-26T23:26:53.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.864+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9dcc007400 con 0x7f9de40709b0 2024-04-26T23:26:53.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.868+0000 7f9ddb400640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 0x7f9dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:53.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.868+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9dcc085f00 con 0x7f9de40709b0 2024-04-26T23:26:53.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.868+0000 7f9de3400640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 0x7f9dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:53.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.868+0000 7f9de3400640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 0x7f9dc006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40b2000 tx=0x7f9dd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:53.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:53.872+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9dcc055dd0 con 0x7f9de40709b0 2024-04-26T23:26:54.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.032+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9de40702a0 con 0x7f9de40709b0 2024-04-26T23:26:54.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.032+0000 7f9ddb400640 1 -- 172.21.15.39:0/2451187122 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f9dcc05a0d0 con 0x7f9de40709b0 2024-04-26T23:26:54.040 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:54.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 msgr2=0x7f9dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 0x7f9dc006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40b2000 tx=0x7f9dd4009040 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 msgr2=0x7f9de415c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00c430 tx=0x7f9dcc00c8f0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 shutdown_connections 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9dc0068380 0x7f9dc006a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de4070d90 0x7f9de40b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9de40709b0 0x7f9de415c4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 --2- 172.21.15.39:0/2451187122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9de406cae0 0x7f9de415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 >> 172.21.15.39:0/2451187122 conn(0x7f9de40d1e70 msgr2=0x7f9de406f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 shutdown_connections 2024-04-26T23:26:54.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.036+0000 7f9de9000640 1 -- 172.21.15.39:0/2451187122 wait complete. 2024-04-26T23:26:54.061 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 Processor -- start 2024-04-26T23:26:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 -- start start 2024-04-26T23:26:54.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b040d15c0 0x7f4b040723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b04072cf0 con 0x7f4b04162e20 2024-04-26T23:26:54.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4b04072fd0 con 0x7f4b040d15c0 2024-04-26T23:26:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b0a000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b040732b0 con 0x7f4b040d11e0 2024-04-26T23:26:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4afbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b040d15c0 0x7f4b040723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:56524/0 (socket says 172.21.15.39:56524) 2024-04-26T23:26:54.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 -- 172.21.15.39:0/2487392223 learned_addr learned my addr 172.21.15.39:0/2487392223 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:54.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 -- 172.21.15.39:0/2487392223 >> v2:172.21.15.71:3300/0 conn(0x7f4b040d15c0 msgr2=0x7f4b040723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:54.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 --2- 172.21.15.39:0/2487392223 >> v2:172.21.15.71:3300/0 conn(0x7f4b040d15c0 0x7f4b040723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 -- 172.21.15.39:0/2487392223 >> v1:172.21.15.71:6789/0 conn(0x7f4b04162e20 legacy=0x7f4b041632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.200+0000 7f4b03400640 1 -- 172.21.15.39:0/2487392223 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b04073590 con 0x7f4b040d11e0 2024-04-26T23:26:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b03400640 1 --2- 172.21.15.39:0/2487392223 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009870 tx=0x7f4af401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d29423a8ad14f0b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b02a00640 1 -- 172.21.15.39:0/2487392223 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40ab660 con 0x7f4b040d11e0 2024-04-26T23:26:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b02a00640 1 -- 172.21.15.39:0/2487392223 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af40b0070 con 0x7f4b040d11e0 2024-04-26T23:26:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b02a00640 1 -- 172.21.15.39:0/2487392223 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40aba20 con 0x7f4b040d11e0 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 -- 172.21.15.39:0/2487392223 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 msgr2=0x7f4b0406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 --2- 172.21.15.39:0/2487392223 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009870 tx=0x7f4af401c440 comp rx=0 tx=0).stop 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 -- 172.21.15.39:0/2487392223 shutdown_connections 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 --2- 172.21.15.39:0/2487392223 >> v2:172.21.15.71:3300/0 conn(0x7f4b040d15c0 0x7f4b040723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 --2- 172.21.15.39:0/2487392223 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b040d11e0 0x7f4b0406f2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 -- 172.21.15.39:0/2487392223 >> 172.21.15.39:0/2487392223 conn(0x7f4b0406c7d0 msgr2=0x7f4b0406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 -- 172.21.15.39:0/2487392223 shutdown_connections 2024-04-26T23:26:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.204+0000 7f4b0a000640 1 -- 172.21.15.39:0/2487392223 wait complete. 2024-04-26T23:26:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 Processor -- start 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- start start 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 0x7f4b04153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b04162e20 0x7f4b0414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b040d1b20 con 0x7f4b040d15c0 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b040d19a0 con 0x7f4b040d11e0 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b041629f0 con 0x7f4b04162e20 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35420/0 (socket says 172.21.15.39:35420) 2024-04-26T23:26:54.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 -- 172.21.15.39:0/317365347 learned_addr learned my addr 172.21.15.39:0/317365347 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b03e00640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b04162e20 0x7f4b0414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b03400640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 0x7f4b04153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 -- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b04162e20 msgr2=0x7f4b0414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b04162e20 0x7f4b0414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 -- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 msgr2=0x7f4b04153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 0x7f4b04153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 -- 172.21.15.39:0/317365347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b04153580 con 0x7f4b040d15c0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b03400640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 0x7f4b04153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afbe00640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00e870 tx=0x7f4aec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec017070 con 0x7f4b040d15c0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec00c940 con 0x7f4b040d15c0 2024-04-26T23:26:54.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b04152cc0 con 0x7f4b040d15c0 2024-04-26T23:26:54.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00ccf0 con 0x7f4b040d15c0 2024-04-26T23:26:54.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.208+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0414eb00 con 0x7f4b040d15c0 2024-04-26T23:26:54.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0406a720 con 0x7f4b040d15c0 2024-04-26T23:26:54.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4aec01a070 con 0x7f4b040d15c0 2024-04-26T23:26:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4afb400640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 0x7f4ae006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4aec086850 con 0x7f4b040d15c0 2024-04-26T23:26:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4b03400640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 0x7f4ae006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.212+0000 7f4b03400640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 0x7f4ae006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af40af000 tx=0x7f4af40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.216+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4aec056e00 con 0x7f4b040d15c0 2024-04-26T23:26:54.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.388+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b040ae8b0 con 0x7f4b040d15c0 2024-04-26T23:26:54.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4afb400640 1 -- 172.21.15.39:0/317365347 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f4aec056700 con 0x7f4b040d15c0 2024-04-26T23:26:54.396 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 msgr2=0x7f4ae006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 0x7f4ae006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af40af000 tx=0x7f4af40a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 msgr2=0x7f4b041f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00e870 tx=0x7f4aec00ec70 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 shutdown_connections 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ae0068380 0x7f4ae006a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b04162e20 0x7f4b0414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b040d15c0 0x7f4b041f8870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 --2- 172.21.15.39:0/317365347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040d11e0 0x7f4b04153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 >> 172.21.15.39:0/317365347 conn(0x7f4b0406c7d0 msgr2=0x7f4b040b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 shutdown_connections 2024-04-26T23:26:54.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.392+0000 7f4b0a000640 1 -- 172.21.15.39:0/317365347 wait complete. 2024-04-26T23:26:54.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:26:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.552+0000 7f0dd1400640 1 Processor -- start 2024-04-26T23:26:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.552+0000 7f0dd1400640 1 -- start start 2024-04-26T23:26:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dd1400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc0d11e0 0x7f0dcc06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dd1400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dd1400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dcc072cf0 con 0x7f0dcc162e20 2024-04-26T23:26:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dd1400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0dcc072fd0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dd1400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0dcc0732b0 con 0x7f0dcc0d11e0 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35430/0 (socket says 172.21.15.39:35430) 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 -- 172.21.15.39:0/1336460585 learned_addr learned my addr 172.21.15.39:0/1336460585 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dca800640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc0d11e0 0x7f0dcc06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 -- 172.21.15.39:0/1336460585 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc0d11e0 msgr2=0x7f0dcc06f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc0d11e0 0x7f0dcc06f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 -- 172.21.15.39:0/1336460585 >> v1:172.21.15.71:6789/0 conn(0x7f0dcc162e20 legacy=0x7f0dcc1632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.556+0000 7f0dc3e00640 1 -- 172.21.15.39:0/1336460585 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc073590 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dc3e00640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009870 tx=0x7f0db401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5489378ea7195800 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dc9e00640 1 -- 172.21.15.39:0/1336460585 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40ab660 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dc9e00640 1 -- 172.21.15.39:0/1336460585 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40b0070 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dc9e00640 1 -- 172.21.15.39:0/1336460585 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40aba20 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- 172.21.15.39:0/1336460585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 msgr2=0x7f0dcc0723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009870 tx=0x7f0db401c440 comp rx=0 tx=0).stop 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- 172.21.15.39:0/1336460585 shutdown_connections 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc0723c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 --2- 172.21.15.39:0/1336460585 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc0d11e0 0x7f0dcc06f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- 172.21.15.39:0/1336460585 >> 172.21.15.39:0/1336460585 conn(0x7f0dcc06c7d0 msgr2=0x7f0dcc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- 172.21.15.39:0/1336460585 shutdown_connections 2024-04-26T23:26:54.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- 172.21.15.39:0/1336460585 wait complete. 2024-04-26T23:26:54.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 Processor -- start 2024-04-26T23:26:54.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.560+0000 7f0dd1400640 1 -- start start 2024-04-26T23:26:54.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 0x7f0dcc14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 0x7f0dcc157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc072a80 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc072900 con 0x7f0dcc0d11e0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0dcc1629f0 con 0x7f0dcc162e20 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35434/0 (socket says 172.21.15.39:35434) 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 -- 172.21.15.39:0/850952555 learned_addr learned my addr 172.21.15.39:0/850952555 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 -- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 msgr2=0x7f0dcc157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dcb200640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 0x7f0dcc157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dca800640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 0x7f0dcc14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 0x7f0dcc157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 -- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 msgr2=0x7f0dcc14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 0x7f0dcc14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 -- 172.21.15.39:0/850952555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc1474c0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dca800640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 0x7f0dcc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dcb200640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 0x7f0dcc157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc3e00640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0db401a070 tx=0x7f0db401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40be5f0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40be7b0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40beba0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc15a3f0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc15a110 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc06a720 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.564+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0db40b43f0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.568+0000 7f0dc2a00640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 0x7f0da806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.568+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f0db4121610 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.568+0000 7f0dca800640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 0x7f0da806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.568+0000 7f0dca800640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 0x7f0da806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009ae0 tx=0x7f0dbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:54.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.572+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0db4016150 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.748+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0dcc0ae8b0 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.748+0000 7f0dc2a00640 1 -- 172.21.15.39:0/850952555 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0db40f1c50 con 0x7f0dcc0d15c0 2024-04-26T23:26:54.755 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:26:54.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 msgr2=0x7f0da806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 0x7f0da806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009ae0 tx=0x7f0dbc008040 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 msgr2=0x7f0dcc146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0db401a070 tx=0x7f0db401ac80 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 shutdown_connections 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0da80683b0 0x7f0da806a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dcc162e20 0x7f0dcc157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dcc0d15c0 0x7f0dcc146f80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 --2- 172.21.15.39:0/850952555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dcc0d11e0 0x7f0dcc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 >> 172.21.15.39:0/850952555 conn(0x7f0dcc06c7d0 msgr2=0x7f0dcc0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 shutdown_connections 2024-04-26T23:26:54.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.752+0000 7f0dd1400640 1 -- 172.21.15.39:0/850952555 wait complete. 2024-04-26T23:26:54.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-26T23:26:54.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:54.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-26T23:26:54.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:26:54.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:26:54.803 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T23:26:54.852 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:26:54.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 Processor -- start 2024-04-26T23:26:54.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 -- start start 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc15d160 0x7f93cc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f93cc06daf0 0x7f93cc0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93cc15d540 con 0x7f93cc0d1230 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc0cffe0 con 0x7f93cc06daf0 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.988+0000 7f93d2800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f93cc073c90 con 0x7f93cc15d160 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93c3e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f93cc0d1230 0x7f93cc06d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53420/0 (socket says 172.21.15.39:53420) 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93c3e00640 1 -- 172.21.15.39:0/446193325 learned_addr learned my addr 172.21.15.39:0/446193325 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 --2- 172.21.15.39:0/446193325 >> v2:172.21.15.39:3300/0 conn(0x7f93cc06daf0 0x7f93cc0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cb400640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc15d160 0x7f93cc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93caa00640 1 -- 172.21.15.39:0/446193325 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808515035 0 0) 0x7f93cc15d540 con 0x7f93cc0d1230 2024-04-26T23:26:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93caa00640 1 -- 172.21.15.39:0/446193325 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b0003530 con 0x7f93cc0d1230 2024-04-26T23:26:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 -- 172.21.15.39:0/446193325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc15d160 msgr2=0x7f93cc0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc15d160 0x7f93cc0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 -- 172.21.15.39:0/446193325 >> v1:172.21.15.39:6789/0 conn(0x7f93cc0d1230 legacy=0x7f93cc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 -- 172.21.15.39:0/446193325 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc0739b0 con 0x7f93cc06daf0 2024-04-26T23:26:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93cbe00640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc0b4510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009d90 tx=0x7f93c401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e372900b5f8a40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93caa00640 1 -- 172.21.15.39:0/446193325 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40b2070 con 0x7f93cc06daf0 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93caa00640 1 -- 172.21.15.39:0/446193325 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c40a5a00 con 0x7f93cc06daf0 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.992+0000 7f93caa00640 1 -- 172.21.15.39:0/446193325 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a5dd0 con 0x7f93cc06daf0 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- 172.21.15.39:0/446193325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 msgr2=0x7f93cc0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc0b4510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009d90 tx=0x7f93c401c940 comp rx=0 tx=0).stop 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- 172.21.15.39:0/446193325 shutdown_connections 2024-04-26T23:26:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc0b4510 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- 172.21.15.39:0/446193325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc15d160 0x7f93cc0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- 172.21.15.39:0/446193325 >> 172.21.15.39:0/446193325 conn(0x7f93cc0729d0 msgr2=0x7f93cc072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- 172.21.15.39:0/446193325 shutdown_connections 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- 172.21.15.39:0/446193325 wait complete. 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 Processor -- start 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- start start 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc15d160 0x7f93cc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc14c880 0x7f93cc152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0b4a50 con 0x7f93cc06daf0 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc073660 con 0x7f93cc15d160 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93d2800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f93cc0b4bd0 con 0x7f93cc14c880 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35448/0 (socket says 172.21.15.39:35448) 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 -- 172.21.15.39:0/2882551959 learned_addr learned my addr 172.21.15.39:0/2882551959 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 -- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc14c880 msgr2=0x7f93cc152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc14c880 0x7f93cc152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 -- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc15d160 msgr2=0x7f93cc154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc15d160 0x7f93cc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:54.996+0000 7f93cb400640 1 -- 172.21.15.39:0/2882551959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc1505b0 con 0x7f93cc06daf0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93cb400640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e870 tx=0x7f93bc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc017070 con 0x7f93cc06daf0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc00c940 con 0x7f93cc06daf0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00ccf0 con 0x7f93cc06daf0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc150890 con 0x7f93cc06daf0 2024-04-26T23:26:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc14eb10 con 0x7f93cc06daf0 2024-04-26T23:26:55.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc050740 con 0x7f93cc06daf0 2024-04-26T23:26:55.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f93bc01a070 con 0x7f93cc06daf0 2024-04-26T23:26:55.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 0x7f93a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f93bc086d50 con 0x7f93cc06daf0 2024-04-26T23:26:55.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.000+0000 7f93c3e00640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 0x7f93a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.004+0000 7f93c3e00640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 0x7f93a806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b4007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.004+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f93bc08a030 con 0x7f93cc06daf0 2024-04-26T23:26:55.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.208+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93cc068700 con 0x7f93cc06daf0 2024-04-26T23:26:55.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.208+0000 7f93c3400640 1 -- 172.21.15.39:0/2882551959 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f93bc057200 con 0x7f93cc06daf0 2024-04-26T23:26:55.214 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:55.214 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:55.214 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 msgr2=0x7f93a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 0x7f93a806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b4007900 comp rx=0 tx=0).stop 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 msgr2=0x7f93cc14fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e870 tx=0x7f93bc00ec70 comp rx=0 tx=0).stop 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 shutdown_connections 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93a8068380 0x7f93a806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93cc14c880 0x7f93cc152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc15d160 0x7f93cc154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 --2- 172.21.15.39:0/2882551959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93cc06daf0 0x7f93cc14fef0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 >> 172.21.15.39:0/2882551959 conn(0x7f93cc0729d0 msgr2=0x7f93cc06d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 shutdown_connections 2024-04-26T23:26:55.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.212+0000 7f93d2800640 1 -- 172.21.15.39:0/2882551959 wait complete. 2024-04-26T23:26:55.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.372+0000 7f7dff200640 1 Processor -- start 2024-04-26T23:26:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.372+0000 7f7dff200640 1 -- start start 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dff200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7df80742f0 0x7f7df80cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dff200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df8074750 con 0x7f7df80cd810 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dff200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df80d0550 con 0x7f7df80cdbf0 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dff200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7df80d0b10 con 0x7f7df80742f0 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7df80cd810 0x7f7df8144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53424/0 (socket says 172.21.15.39:53424) 2024-04-26T23:26:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 -- 172.21.15.39:0/605813495 learned_addr learned my addr 172.21.15.39:0/605813495 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7defe00640 1 --2- 172.21.15.39:0/605813495 >> v2:172.21.15.71:3300/0 conn(0x7f7df80742f0 0x7f7df80cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394345416 0 0) 0x7f7df8074750 con 0x7f7df80cd810 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc003530 con 0x7f7df80cd810 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 884268290 0 0) 0x7f7ddc003530 con 0x7f7df80cd810 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 >> v2:172.21.15.71:3300/0 conn(0x7f7df80742f0 msgr2=0x7f7df80cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 --2- 172.21.15.39:0/605813495 >> v2:172.21.15.71:3300/0 conn(0x7f7df80742f0 0x7f7df80cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 >> v1:172.21.15.71:6789/0 conn(0x7f7df80cdbf0 legacy=0x7f7df806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df80d0830 con 0x7f7df80cd810 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f7de8001680 con 0x7f7df80cd810 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 >> v1:172.21.15.39:6789/0 conn(0x7f7df80cd810 legacy=0x7f7df8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 0x7f7ddc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc004810 0x7f7ddc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ddc0051d0 0x7f7ddc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80d0b10 con 0x7f7ddc0051d0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc00c170 con 0x7f7ddc0039c0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc00c370 con 0x7f7ddc004810 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 0x7f7ddc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7defe00640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc004810 0x7f7ddc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dfd200640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ddc0051d0 0x7f7ddc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 -- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc004810 msgr2=0x7f7ddc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc004810 0x7f7ddc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 -- 172.21.15.39:0/605813495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ddc0051d0 msgr2=0x7f7ddc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ddc0051d0 0x7f7ddc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7df7e00640 1 -- 172.21.15.39:0/605813495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc003530 con 0x7f7ddc0039c0 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dfd200640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ddc0051d0 0x7f7ddc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.376+0000 7f7dfd200640 1 -- 172.21.15.39:0/605813495 reap_dead start 2024-04-26T23:26:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7df7e00640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 0x7f7ddc003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7de800c240 tx=0x7f7de801f3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5718d2f0e15aa7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8007d20 con 0x7f7ddc0039c0 2024-04-26T23:26:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de8005ae0 con 0x7f7ddc0039c0 2024-04-26T23:26:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7df7400640 1 -- 172.21.15.39:0/605813495 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8007070 con 0x7f7ddc0039c0 2024-04-26T23:26:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 msgr2=0x7f7ddc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 0x7f7ddc003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7de800c240 tx=0x7f7de801f3f0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- 172.21.15.39:0/605813495 shutdown_connections 2024-04-26T23:26:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 --2- 172.21.15.39:0/605813495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ddc0039c0 0x7f7ddc003de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- 172.21.15.39:0/605813495 >> 172.21.15.39:0/605813495 conn(0x7f7df80b2af0 msgr2=0x7f7df80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- 172.21.15.39:0/605813495 shutdown_connections 2024-04-26T23:26:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- 172.21.15.39:0/605813495 wait complete. 2024-04-26T23:26:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 Processor -- start 2024-04-26T23:26:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.380+0000 7f7dff200640 1 -- start start 2024-04-26T23:26:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 0x7f7df80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 0x7f7df815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80ce060 con 0x7f7df81603d0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7df806e970 con 0x7f7df81554d0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7df8143bb0 con 0x7f7ddc0039c0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35470/0 (socket says 172.21.15.39:35470) 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 -- 172.21.15.39:0/3223586938 learned_addr learned my addr 172.21.15.39:0/3223586938 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 -- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 msgr2=0x7f7df80b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dfd200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 0x7f7df815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7df7e00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 0x7f7df80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 0x7f7df80b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 -- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 msgr2=0x7f7df815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 0x7f7df815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 -- 172.21.15.39:0/3223586938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df8155e40 con 0x7f7df81603d0 2024-04-26T23:26:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dfd200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 0x7f7df815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7df7e00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 0x7f7df80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7defe00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7de0011ad0 tx=0x7f7de0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de000fbb0 con 0x7f7df81603d0 2024-04-26T23:26:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de000fd50 con 0x7f7df81603d0 2024-04-26T23:26:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0014680 con 0x7f7df81603d0 2024-04-26T23:26:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df80ae9f0 con 0x7f7df81603d0 2024-04-26T23:26:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df80aefb0 con 0x7f7df81603d0 2024-04-26T23:26:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.384+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df8050740 con 0x7f7df81603d0 2024-04-26T23:26:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.388+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7de0012040 con 0x7f7df81603d0 2024-04-26T23:26:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.388+0000 7f7df4c00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 0x7f7dd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.388+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7de0087180 con 0x7f7df81603d0 2024-04-26T23:26:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.388+0000 7f7df7e00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 0x7f7dd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.388+0000 7f7df7e00640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 0x7f7dd406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7de80af000 tx=0x7f7de80aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.392+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7de0019030 con 0x7f7df81603d0 2024-04-26T23:26:55.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.560+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7df815c250 con 0x7f7df81603d0 2024-04-26T23:26:55.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7df4c00640 1 -- 172.21.15.39:0/3223586938 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16793 (secure 0 0 0) 0x7f7de0057620 con 0x7f7df81603d0 2024-04-26T23:26:55.568 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:55.568 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:55.254925+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 msgr2=0x7f7dd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 0x7f7dd406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7de80af000 tx=0x7f7de80aa000 comp rx=0 tx=0).stop 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 msgr2=0x7f7df81407f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7de0011ad0 tx=0x7f7de0011f90 comp rx=0 tx=0).stop 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 shutdown_connections 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7dd4068380 0x7f7dd406a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7df81554d0 0x7f7df815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7df81603d0 0x7f7df81407f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 --2- 172.21.15.39:0/3223586938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ddc0039c0 0x7f7df80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 >> 172.21.15.39:0/3223586938 conn(0x7f7df80b2af0 msgr2=0x7f7df806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 shutdown_connections 2024-04-26T23:26:55.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.564+0000 7f7dff200640 1 -- 172.21.15.39:0/3223586938 wait complete. 2024-04-26T23:26:55.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:26:12.161427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:26:13.066427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:26:55.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:26:55.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.728+0000 7fa8fa400640 1 Processor -- start 2024-04-26T23:26:55.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.728+0000 7fa8fa400640 1 -- start start 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8fa400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8f40cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8fa400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8f406d940 0x7fa8f40b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8fa400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f40d01e0 con 0x7fa8f406d4e0 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8fa400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f406dfa0 con 0x7fa8f406d940 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8fa400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f406e280 con 0x7fa8f40cf8c0 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8eaa00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa8f406d4e0 0x7fa8f40d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53434/0 (socket says 172.21.15.39:53434) 2024-04-26T23:26:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8eaa00640 1 -- 172.21.15.39:0/1753331728 learned_addr learned my addr 172.21.15.39:0/1753331728 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3400640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8f40cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/1753331728 >> v2:172.21.15.71:3300/0 conn(0x7fa8f406d940 0x7fa8f40b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306691360 0 0) 0x7fa8f40d01e0 con 0x7fa8f406d4e0 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d8003530 con 0x7fa8f406d4e0 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4273624622 0 0) 0x7fa8d8003530 con 0x7fa8f406d4e0 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 msgr2=0x7fa8f40cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8f40cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 >> v2:172.21.15.71:3300/0 conn(0x7fa8f406d940 msgr2=0x7fa8f40b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 --2- 172.21.15.39:0/1753331728 >> v2:172.21.15.71:3300/0 conn(0x7fa8f406d940 0x7fa8f40b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f406e560 con 0x7fa8f406d4e0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fa8dc001680 con 0x7fa8f406d4e0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 >> v1:172.21.15.39:6789/0 conn(0x7fa8f406d4e0 legacy=0x7fa8f40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d80039c0 0x7fa8d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f406dfa0 con 0x7fa8d8004d50 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f406e280 con 0x7fa8d80039c0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d800b9d0 con 0x7fa8f40cf8c0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3400640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d80039c0 0x7fa8d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8eaa00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 -- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 msgr2=0x7fa8d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40cf8c0 0x7fa8d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 -- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d80039c0 msgr2=0x7fa8d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d80039c0 0x7fa8d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.732+0000 7fa8f3e00640 1 -- 172.21.15.39:0/1753331728 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d8003530 con 0x7fa8d8004d50 2024-04-26T23:26:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009fc0 tx=0x7fa8ec01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e293e5df2d6d3d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b2070 con 0x7fa8d8004d50 2024-04-26T23:26:55.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0a5cd0 con 0x7fa8d8004d50 2024-04-26T23:26:55.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8f2a00640 1 -- 172.21.15.39:0/1753331728 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec009c10 con 0x7fa8d8004d50 2024-04-26T23:26:55.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- 172.21.15.39:0/1753331728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 msgr2=0x7fa8d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 --2- 172.21.15.39:0/1753331728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009fc0 tx=0x7fa8ec01ccc0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8f3e00640 1 -- 172.21.15.39:0/1753331728 reap_dead start 2024-04-26T23:26:55.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- 172.21.15.39:0/1753331728 shutdown_connections 2024-04-26T23:26:55.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- 172.21.15.39:0/1753331728 >> 172.21.15.39:0/1753331728 conn(0x7fa8f40d3040 msgr2=0x7fa8f40d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- 172.21.15.39:0/1753331728 shutdown_connections 2024-04-26T23:26:55.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- 172.21.15.39:0/1753331728 wait complete. 2024-04-26T23:26:55.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 Processor -- start 2024-04-26T23:26:55.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.736+0000 7fa8fa400640 1 -- start start 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 0x7fa8f41f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 0x7fa8f41f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40b4730 con 0x7fa8d8004d50 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40b32d0 con 0x7fa8f41f4fa0 2024-04-26T23:26:55.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f40d17e0 con 0x7fa8f40b0270 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35482/0 (socket says 172.21.15.39:35482) 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 -- 172.21.15.39:0/4259315633 learned_addr learned my addr 172.21.15.39:0/4259315633 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8eaa00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 0x7fa8f41f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 0x7fa8f41f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 -- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 msgr2=0x7fa8f41f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 0x7fa8f41f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 -- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 msgr2=0x7fa8f41f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 0x7fa8f41f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 -- 172.21.15.39:0/4259315633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4152b00 con 0x7fa8d8004d50 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3e00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 0x7fa8f41f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8eaa00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 0x7fa8f41f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8f3400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4011960 tx=0x7fa8e4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400faf0 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e400fc90 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f40b0db0 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4014440 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f40b0ad0 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f406a720 con 0x7fa8d8004d50 2024-04-26T23:26:55.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.740+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8e4012040 con 0x7fa8d8004d50 2024-04-26T23:26:55.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.744+0000 7fa8ebe00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 0x7fa8d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:55.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.744+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa8e40870a0 con 0x7fa8d8004d50 2024-04-26T23:26:55.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.744+0000 7fa8eaa00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 0x7fa8d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:55.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.744+0000 7fa8eaa00640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 0x7fa8d006a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40c9100 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.748+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8e4019030 con 0x7fa8d8004d50 2024-04-26T23:26:55.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8f4072020 con 0x7fa8d8004d50 2024-04-26T23:26:55.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8ebe00640 1 -- 172.21.15.39:0/4259315633 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fa8e4056f80 con 0x7fa8d8004d50 2024-04-26T23:26:55.917 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:26:55.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 msgr2=0x7fa8d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 0x7fa8d006a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40c9100 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 msgr2=0x7fa8f40afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4011960 tx=0x7fa8e4011e20 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 shutdown_connections 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8d0068380 0x7fa8d006a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f41f4fa0 0x7fa8f41f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8f40b0270 0x7fa8f41f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 --2- 172.21.15.39:0/4259315633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d8004d50 0x7fa8f40afd30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 >> 172.21.15.39:0/4259315633 conn(0x7fa8f40d3040 msgr2=0x7fa8f409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 shutdown_connections 2024-04-26T23:26:55.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:55.912+0000 7fa8fa400640 1 -- 172.21.15.39:0/4259315633 wait complete. 2024-04-26T23:26:55.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:26:56.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 Processor -- start 2024-04-26T23:26:56.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 -- start start 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81981458d0 0x7f81980b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81980ce5e0 0x7f81980cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8198072180 con 0x7f8198073400 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f81980739a0 con 0x7f81981458d0 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.076+0000 7f819e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8198073c80 con 0x7f81980ce5e0 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f818ea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8198073400 0x7f8198072910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53446/0 (socket says 172.21.15.39:53446) 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f818ea00640 1 -- 172.21.15.39:0/1193907758 learned_addr learned my addr 172.21.15.39:0/1193907758 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 --2- 172.21.15.39:0/1193907758 >> v2:172.21.15.71:3300/0 conn(0x7f81981458d0 0x7f81980b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197e00640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81980ce5e0 0x7f81980cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8196a00640 1 -- 172.21.15.39:0/1193907758 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627715854 0 0) 0x7f8198072180 con 0x7f8198073400 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8196a00640 1 -- 172.21.15.39:0/1193907758 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f817c003530 con 0x7f8198073400 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 -- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81980ce5e0 msgr2=0x7f81980cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81980ce5e0 0x7f81980cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 -- 172.21.15.39:0/1193907758 >> v1:172.21.15.39:6789/0 conn(0x7f8198073400 legacy=0x7f8198072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 -- 172.21.15.39:0/1193907758 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8198145cb0 con 0x7f81981458d0 2024-04-26T23:26:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.080+0000 7f8197400640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f81980b4890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81880097c0 tx=0x7f818801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebea2e7207798714 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f8196a00640 1 -- 172.21.15.39:0/1193907758 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880b0070 con 0x7f81981458d0 2024-04-26T23:26:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f8196a00640 1 -- 172.21.15.39:0/1193907758 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81880ab600 con 0x7f81981458d0 2024-04-26T23:26:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f8196a00640 1 -- 172.21.15.39:0/1193907758 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880ab9d0 con 0x7f81981458d0 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 msgr2=0x7f81980b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f81980b4890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81880097c0 tx=0x7f818801c410 comp rx=0 tx=0).stop 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- 172.21.15.39:0/1193907758 shutdown_connections 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81980ce5e0 0x7f81980cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- 172.21.15.39:0/1193907758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f81980b4890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- 172.21.15.39:0/1193907758 >> 172.21.15.39:0/1193907758 conn(0x7f819806c7d0 msgr2=0x7f819806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- 172.21.15.39:0/1193907758 shutdown_connections 2024-04-26T23:26:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- 172.21.15.39:0/1193907758 wait complete. 2024-04-26T23:26:56.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 Processor -- start 2024-04-26T23:26:56.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- start start 2024-04-26T23:26:56.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 0x7f819815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f819815f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f819806e5e0 con 0x7f81980ce5e0 2024-04-26T23:26:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f819806e460 con 0x7f81981458d0 2024-04-26T23:26:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f819e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f819806e760 con 0x7f8198073400 2024-04-26T23:26:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f818ea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f818ea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35484/0 (socket says 172.21.15.39:35484) 2024-04-26T23:26:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f818ea00640 1 -- 172.21.15.39:0/2349727355 learned_addr learned my addr 172.21.15.39:0/2349727355 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.084+0000 7f8197400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 0x7f819815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f8197e00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f819815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 -- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 msgr2=0x7f819815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 0x7f819815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 -- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 msgr2=0x7f819815f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f819815f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 -- 172.21.15.39:0/2349727355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819815bf50 con 0x7f81980ce5e0 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f8197400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 0x7f819815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f8197e00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f819815f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818ea00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f818000c450 tx=0x7f818000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180017070 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180005cf0 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180007290 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81981604c0 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8198160d60 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81981608b0 con 0x7f81980ce5e0 2024-04-26T23:26:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f818001a070 con 0x7f81980ce5e0 2024-04-26T23:26:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 0x7f817406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.088+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8180085eb0 con 0x7f81980ce5e0 2024-04-26T23:26:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.092+0000 7f8197400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 0x7f817406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.092+0000 7f8197400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 0x7f817406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81880ad000 tx=0x7f8188008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.092+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8180056350 con 0x7f81980ce5e0 2024-04-26T23:26:56.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.256+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f819806a720 con 0x7f81980ce5e0 2024-04-26T23:26:56.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.256+0000 7f818fe00640 1 -- 172.21.15.39:0/2349727355 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f8180055c50 con 0x7f81980ce5e0 2024-04-26T23:26:56.264 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 msgr2=0x7f817406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 0x7f817406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81880ad000 tx=0x7f8188008040 comp rx=0 tx=0).stop 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 msgr2=0x7f8198164130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f818000c450 tx=0x7f818000c910 comp rx=0 tx=0).stop 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 shutdown_connections 2024-04-26T23:26:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8174068380 0x7f817406a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81981458d0 0x7f819815f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81980ce5e0 0x7f8198164130 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 --2- 172.21.15.39:0/2349727355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8198073400 0x7f819815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 >> 172.21.15.39:0/2349727355 conn(0x7f819806c7d0 msgr2=0x7f81980d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 shutdown_connections 2024-04-26T23:26:56.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.260+0000 7f819e400640 1 -- 172.21.15.39:0/2349727355 wait complete. 2024-04-26T23:26:56.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:26:56.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 Processor -- start 2024-04-26T23:26:56.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 -- start start 2024-04-26T23:26:56.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 0x7f96580cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9658072180 con 0x7f96581458d0 2024-04-26T23:26:56.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96580739a0 con 0x7f9658073400 2024-04-26T23:26:56.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f965e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9658073c80 con 0x7f96580ce5e0 2024-04-26T23:26:56.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f9657400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f96581458d0 0x7f96580b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53448/0 (socket says 172.21.15.39:53448) 2024-04-26T23:26:56.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f9657400640 1 -- 172.21.15.39:0/3768026141 learned_addr learned my addr 172.21.15.39:0/3768026141 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:56.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f9657e00640 1 --2- 172.21.15.39:0/3768026141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 0x7f96580cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.424+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638251455 0 0) 0x7f9658072180 con 0x7f96581458d0 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f963c003530 con 0x7f96581458d0 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558301828 0 0) 0x7f96580739a0 con 0x7f9658073400 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9658072180 con 0x7f9658073400 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9657e00640 1 -- 172.21.15.39:0/3768026141 >> v1:172.21.15.71:6789/0 conn(0x7f9658073400 legacy=0x7f9658072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9657e00640 1 -- 172.21.15.39:0/3768026141 >> v1:172.21.15.39:6789/0 conn(0x7f96581458d0 legacy=0x7f96580b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9657e00640 1 -- 172.21.15.39:0/3768026141 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658145cb0 con 0x7f96580ce5e0 2024-04-26T23:26:56.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9657e00640 1 --2- 172.21.15.39:0/3768026141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 0x7f96580cea70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9650009dc0 tx=0x7f965001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be80fda51317d2f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96500b2070 con 0x7f96580ce5e0 2024-04-26T23:26:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96500a58d0 con 0x7f96580ce5e0 2024-04-26T23:26:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f9656a00640 1 -- 172.21.15.39:0/3768026141 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5ca0 con 0x7f96580ce5e0 2024-04-26T23:26:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f965e400640 1 -- 172.21.15.39:0/3768026141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 msgr2=0x7f96580cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f965e400640 1 --2- 172.21.15.39:0/3768026141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 0x7f96580cea70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9650009dc0 tx=0x7f965001c900 comp rx=0 tx=0).stop 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f965e400640 1 -- 172.21.15.39:0/3768026141 shutdown_connections 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.428+0000 7f965e400640 1 --2- 172.21.15.39:0/3768026141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96580ce5e0 0x7f96580cea70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- 172.21.15.39:0/3768026141 >> 172.21.15.39:0/3768026141 conn(0x7f965806c7d0 msgr2=0x7f965806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- 172.21.15.39:0/3768026141 shutdown_connections 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- 172.21.15.39:0/3768026141 wait complete. 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 Processor -- start 2024-04-26T23:26:56.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- start start 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 0x7f965813f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96581458d0 0x7f96581586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f965816a160 con 0x7f9658073400 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9658073230 con 0x7f96580ce5e0 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f965816a2e0 con 0x7f96581458d0 2024-04-26T23:26:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35488/0 (socket says 172.21.15.39:35488) 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 -- 172.21.15.39:0/2667923811 learned_addr learned my addr 172.21.15.39:0/2667923811 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f964ea00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 0x7f965813f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657e00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96581458d0 0x7f96581586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 -- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96581458d0 msgr2=0x7f96581586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96581458d0 0x7f96581586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 -- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 msgr2=0x7f965813f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 0x7f965813f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 -- 172.21.15.39:0/2667923811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965813f5f0 con 0x7f9658073400 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f964ea00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 0x7f965813f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f9657400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f964800c450 tx=0x7f964800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648017070 con 0x7f9658073400 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9648005cf0 con 0x7f9658073400 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96480072b0 con 0x7f9658073400 2024-04-26T23:26:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965813f890 con 0x7f9658073400 2024-04-26T23:26:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.432+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9658140130 con 0x7f9658073400 2024-04-26T23:26:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965806a720 con 0x7f9658073400 2024-04-26T23:26:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f964801a070 con 0x7f9658073400 2024-04-26T23:26:56.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f964fe00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 0x7f963406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9648085e50 con 0x7f9658073400 2024-04-26T23:26:56.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f964ea00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 0x7f963406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.436+0000 7f964ea00640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 0x7f963406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96581425e0 tx=0x7f9640009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.440+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f96480562f0 con 0x7f9658073400 2024-04-26T23:26:56.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.604+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9658069610 con 0x7f9658073400 2024-04-26T23:26:56.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.604+0000 7f964fe00640 1 -- 172.21.15.39:0/2667923811 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f9648055bf0 con 0x7f9658073400 2024-04-26T23:26:56.611 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:26:56.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 msgr2=0x7f963406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 0x7f963406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96581425e0 tx=0x7f9640009040 comp rx=0 tx=0).stop 2024-04-26T23:26:56.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 msgr2=0x7f965815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f964800c450 tx=0x7f964800c910 comp rx=0 tx=0).stop 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 shutdown_connections 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9634068380 0x7f963406a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96581458d0 0x7f96581586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96580ce5e0 0x7f965813f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 --2- 172.21.15.39:0/2667923811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9658073400 0x7f965815b5e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 >> 172.21.15.39:0/2667923811 conn(0x7f965806c7d0 msgr2=0x7f96580ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 shutdown_connections 2024-04-26T23:26:56.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.608+0000 7f965e400640 1 -- 172.21.15.39:0/2667923811 wait complete. 2024-04-26T23:26:56.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:56.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 Processor -- start 2024-04-26T23:26:56.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 -- start start 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cd810 0x7f85a40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f85a40cdbf0 0x7f85a406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a40d0550 con 0x7f85a40cfe00 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f85a40d0b10 con 0x7f85a40cdbf0 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85ab600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85a406e970 con 0x7f85a40cd810 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f859be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f85a40cfe00 0x7f85a4144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53460/0 (socket says 172.21.15.39:53460) 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f859be00640 1 -- 172.21.15.39:0/15209778 learned_addr learned my addr 172.21.15.39:0/15209778 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85a9600640 1 --2- 172.21.15.39:0/15209778 >> v2:172.21.15.39:3300/0 conn(0x7f85a40cdbf0 0x7f85a406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85a8c00640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cd810 0x7f85a40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85a3e00640 1 -- 172.21.15.39:0/15209778 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455548097 0 0) 0x7f85a40d0550 con 0x7f85a40cfe00 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85a3e00640 1 -- 172.21.15.39:0/15209778 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8588003530 con 0x7f85a40cfe00 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.768+0000 7f85a9600640 1 -- 172.21.15.39:0/15209778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cd810 msgr2=0x7f85a40742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a9600640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cd810 0x7f85a40742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a9600640 1 -- 172.21.15.39:0/15209778 >> v1:172.21.15.39:6789/0 conn(0x7f85a40cfe00 legacy=0x7f85a4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a9600640 1 -- 172.21.15.39:0/15209778 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a40d0830 con 0x7f85a40cdbf0 2024-04-26T23:26:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a9600640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cdbf0 0x7f85a406ee00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f859c009d90 tx=0x7f859c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31e2cb5379d987b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a3e00640 1 -- 172.21.15.39:0/15209778 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b2070 con 0x7f85a40cdbf0 2024-04-26T23:26:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a3e00640 1 -- 172.21.15.39:0/15209778 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c0a5900 con 0x7f85a40cdbf0 2024-04-26T23:26:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85a3e00640 1 -- 172.21.15.39:0/15209778 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0a5cd0 con 0x7f85a40cdbf0 2024-04-26T23:26:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 -- 172.21.15.39:0/15209778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cdbf0 msgr2=0x7f85a406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cdbf0 0x7f85a406ee00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f859c009d90 tx=0x7f859c01c820 comp rx=0 tx=0).stop 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 -- 172.21.15.39:0/15209778 shutdown_connections 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cdbf0 0x7f85a406ee00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 --2- 172.21.15.39:0/15209778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cd810 0x7f85a40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 -- 172.21.15.39:0/15209778 >> 172.21.15.39:0/15209778 conn(0x7f85a40b2af0 msgr2=0x7f85a40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 -- 172.21.15.39:0/15209778 shutdown_connections 2024-04-26T23:26:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.772+0000 7f85ab600640 1 -- 172.21.15.39:0/15209778 wait complete. 2024-04-26T23:26:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 Processor -- start 2024-04-26T23:26:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- start start 2024-04-26T23:26:56.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85a40cdbf0 0x7f85a41f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 0x7f85a41f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4143d30 con 0x7f85a40cd810 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4143bb0 con 0x7f85a40cdbf0 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85a4169ef0 con 0x7f85a40cfe00 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35500/0 (socket says 172.21.15.39:35500) 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 -- 172.21.15.39:0/3115138938 learned_addr learned my addr 172.21.15.39:0/3115138938 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f859be00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85a40cdbf0 0x7f85a41f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a9600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 0x7f85a41f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 -- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 msgr2=0x7f85a41f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 0x7f85a41f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 -- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85a40cdbf0 msgr2=0x7f85a41f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85a40cdbf0 0x7f85a41f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 -- 172.21.15.39:0/3115138938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a4157d70 con 0x7f85a40cd810 2024-04-26T23:26:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a9600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 0x7f85a41f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a8c00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f859400e930 tx=0x7f859400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594017070 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859400ca00 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a4157ff0 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859400cdb0 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.776+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a41585b0 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a4050740 con 0x7f85a40cd810 2024-04-26T23:26:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f859401a070 con 0x7f85a40cd810 2024-04-26T23:26:56.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f85a1600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 0x7f858006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:56.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8594086df0 con 0x7f85a40cd810 2024-04-26T23:26:56.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f859be00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 0x7f858006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:56.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.780+0000 7f859be00640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 0x7f858006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f858c007fd0 tx=0x7f858c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:56.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.784+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f85a4157d70 con 0x7f85a40cd810 2024-04-26T23:26:56.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85a40b3c70 con 0x7f85a40cd810 2024-04-26T23:26:56.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85a1600640 1 -- 172.21.15.39:0/3115138938 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f8594056d00 con 0x7f85a40cd810 2024-04-26T23:26:56.989 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:56.989 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:56.989 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:56.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 msgr2=0x7f858006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 0x7f858006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f858c007fd0 tx=0x7f858c009040 comp rx=0 tx=0).stop 2024-04-26T23:26:56.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 msgr2=0x7f85a4156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f859400e930 tx=0x7f859400edf0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 shutdown_connections 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8580068380 0x7f858006a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85a40cfe00 0x7f85a41f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85a40cdbf0 0x7f85a41f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 --2- 172.21.15.39:0/3115138938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a40cd810 0x7f85a4156570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 >> 172.21.15.39:0/3115138938 conn(0x7f85a40b2af0 msgr2=0x7f85a41595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 shutdown_connections 2024-04-26T23:26:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:56.984+0000 7f85ab600640 1 -- 172.21.15.39:0/3115138938 wait complete. 2024-04-26T23:26:57.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:57.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.144+0000 7f863f200640 1 Processor -- start 2024-04-26T23:26:57.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.144+0000 7f863f200640 1 -- start start 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8638145820 0x7f86380cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86380b4950 0x7f86380b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f863806f570 0x7f863806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f86380cd5c0 con 0x7f86380b4950 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8638160060 con 0x7f863806f570 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8638160340 con 0x7f8638145820 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86380b4950 0x7f86380b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f86380b4950 0x7f86380b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35504/0 (socket says 172.21.15.39:35504) 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 -- 172.21.15.39:0/222909317 learned_addr learned my addr 172.21.15.39:0/222909317 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:57.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f8637e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8638145820 0x7f86380cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f863d200640 1 --2- 172.21.15.39:0/222909317 >> v2:172.21.15.71:3300/0 conn(0x7f863806f570 0x7f863806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 -- 172.21.15.39:0/222909317 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8638145820 msgr2=0x7f86380cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 --2- 172.21.15.39:0/222909317 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8638145820 0x7f86380cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 -- 172.21.15.39:0/222909317 >> v2:172.21.15.71:3300/0 conn(0x7f863806f570 msgr2=0x7f863806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 --2- 172.21.15.39:0/222909317 >> v2:172.21.15.71:3300/0 conn(0x7f863806f570 0x7f863806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.148+0000 7f862f400640 1 -- 172.21.15.39:0/222909317 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8638160620 con 0x7f86380b4950 2024-04-26T23:26:57.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f862f400640 1 --2- 172.21.15.39:0/222909317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86380b4d70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8638070460 tx=0x7f862001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d990f770928987ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f8637400640 1 -- 172.21.15.39:0/222909317 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b4070 con 0x7f86380b4950 2024-04-26T23:26:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f8637400640 1 -- 172.21.15.39:0/222909317 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200a7b90 con 0x7f86380b4950 2024-04-26T23:26:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f8637400640 1 -- 172.21.15.39:0/222909317 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200af440 con 0x7f86380b4950 2024-04-26T23:26:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- 172.21.15.39:0/222909317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 msgr2=0x7f86380b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 --2- 172.21.15.39:0/222909317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86380b4d70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8638070460 tx=0x7f862001ebf0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- 172.21.15.39:0/222909317 shutdown_connections 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 --2- 172.21.15.39:0/222909317 >> v2:172.21.15.71:3300/0 conn(0x7f863806f570 0x7f863806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 --2- 172.21.15.39:0/222909317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86380b4d70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 --2- 172.21.15.39:0/222909317 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8638145820 0x7f86380cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- 172.21.15.39:0/222909317 >> 172.21.15.39:0/222909317 conn(0x7f86380b2af0 msgr2=0x7f86380b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- 172.21.15.39:0/222909317 shutdown_connections 2024-04-26T23:26:57.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- 172.21.15.39:0/222909317 wait complete. 2024-04-26T23:26:57.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 Processor -- start 2024-04-26T23:26:57.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.152+0000 7f863f200640 1 -- start start 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f863806f570 0x7f8638138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638145820 0x7f8638155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86380ce260 con 0x7f86380b4950 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f863815fe40 con 0x7f8638145820 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f86380ce3e0 con 0x7f863806f570 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35514/0 (socket says 172.21.15.39:35514) 2024-04-26T23:26:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 -- 172.21.15.39:0/3776195097 learned_addr learned my addr 172.21.15.39:0/3776195097 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f8637e00640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f863806f570 0x7f8638138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863d200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638145820 0x7f8638155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 -- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f863806f570 msgr2=0x7f8638138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f863806f570 0x7f8638138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 -- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638145820 msgr2=0x7f8638155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638145820 0x7f8638155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 -- 172.21.15.39:0/3776195097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8638156cb0 con 0x7f86380b4950 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f862f400640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f862000b2c0 tx=0x7f862001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200c0070 con 0x7f86380b4950 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200afb60 con 0x7f86380b4950 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8638072d70 con 0x7f86380b4950 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b4040 con 0x7f86380b4950 2024-04-26T23:26:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8638073330 con 0x7f86380b4950 2024-04-26T23:26:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8638050740 con 0x7f86380b4950 2024-04-26T23:26:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.156+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86200c3070 con 0x7f86380b4950 2024-04-26T23:26:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.160+0000 7f8634c00640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.160+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8620122f00 con 0x7f86380b4950 2024-04-26T23:26:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.160+0000 7f8637e00640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.160+0000 7f8637e00640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 0x7f861406a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86280099d0 tx=0x7f8628008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.164+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86200187e0 con 0x7f86380b4950 2024-04-26T23:26:57.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.332+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8638074730 con 0x7f86380b4950 2024-04-26T23:26:57.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.332+0000 7f8634c00640 1 -- 172.21.15.39:0/3776195097 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16793 (secure 0 0 0) 0x7f86200f3420 con 0x7f86380b4950 2024-04-26T23:26:57.339 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:57.339 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:55.254925+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 msgr2=0x7f861406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 0x7f861406a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86280099d0 tx=0x7f8628008040 comp rx=0 tx=0).stop 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 msgr2=0x7f86381412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f862000b2c0 tx=0x7f862001b990 comp rx=0 tx=0).stop 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 shutdown_connections 2024-04-26T23:26:57.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638145820 0x7f8638155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86380b4950 0x7f86381412e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 --2- 172.21.15.39:0/3776195097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f863806f570 0x7f8638138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 >> 172.21.15.39:0/3776195097 conn(0x7f86380b2af0 msgr2=0x7f86380cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 shutdown_connections 2024-04-26T23:26:57.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.336+0000 7f863f200640 1 -- 172.21.15.39:0/3776195097 wait complete. 2024-04-26T23:26:57.361 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:26:57.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:57.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 Processor -- start 2024-04-26T23:26:57.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 -- start start 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 0x7f5c2815f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c28160340 con 0x7f5c2815fea0 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2815d3e0 con 0x7f5c2806fd70 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c2d400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5c28160900 con 0x7f5c2815d000 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c27200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5c2815fea0 0x7f5c280cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53472/0 (socket says 172.21.15.39:53472) 2024-04-26T23:26:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c27200640 1 -- 172.21.15.39:0/4062742714 learned_addr learned my addr 172.21.15.39:0/4062742714 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c26800640 1 --2- 172.21.15.39:0/4062742714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/4062742714 >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 0x7f5c2815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948717890 0 0) 0x7f5c28160340 con 0x7f5c2815fea0 2024-04-26T23:26:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.496+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c0c003530 con 0x7f5c2815fea0 2024-04-26T23:26:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2059697349 0 0) 0x7f5c0c003530 con 0x7f5c2815fea0 2024-04-26T23:26:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c26800640 1 -- 172.21.15.39:0/4062742714 >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 msgr2=0x7f5c2815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c26800640 1 --2- 172.21.15.39:0/4062742714 >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 0x7f5c2815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c26800640 1 -- 172.21.15.39:0/4062742714 >> v1:172.21.15.39:6789/0 conn(0x7f5c2815fea0 legacy=0x7f5c280cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c26800640 1 -- 172.21.15.39:0/4062742714 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c28160620 con 0x7f5c2815d000 2024-04-26T23:26:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/4062742714 >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 0x7f5c2815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:57.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c26800640 1 --2- 172.21.15.39:0/4062742714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2806ed90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c180097c0 tx=0x7f5c1801c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78be445bc3fc9ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c180b0070 con 0x7f5c2815d000 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c180ab400 con 0x7f5c2815d000 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.500+0000 7f5c25e00640 1 -- 172.21.15.39:0/4062742714 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20001a00 con 0x7f5c2815d000 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/4062742714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 msgr2=0x7f5c2806ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- 172.21.15.39:0/4062742714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2806ed90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c180097c0 tx=0x7f5c1801c270 comp rx=0 tx=0).stop 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/4062742714 shutdown_connections 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- 172.21.15.39:0/4062742714 >> v2:172.21.15.71:3300/0 conn(0x7f5c2806fd70 0x7f5c2815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- 172.21.15.39:0/4062742714 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2806ed90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/4062742714 >> 172.21.15.39:0/4062742714 conn(0x7f5c280b2af0 msgr2=0x7f5c280b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/4062742714 shutdown_connections 2024-04-26T23:26:57.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/4062742714 wait complete. 2024-04-26T23:26:57.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 Processor -- start 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- start start 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 0x7f5c28150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c280cdfe0 con 0x7f5c2806fd70 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c280cde60 con 0x7f5c2815fea0 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5c280cf4f0 con 0x7f5c2815d000 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35522/0 (socket says 172.21.15.39:35522) 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 -- 172.21.15.39:0/2449586855 learned_addr learned my addr 172.21.15.39:0/2449586855 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c27200640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 0x7f5c28150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 -- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 msgr2=0x7f5c2814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 -- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 msgr2=0x7f5c28150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 0x7f5c28150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 -- 172.21.15.39:0/2449586855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c280d1220 con 0x7f5c2806fd70 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c27200640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 0x7f5c28150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c26800640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c180ae040 tx=0x7f5c1801aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c180b0050 con 0x7f5c2806fd70 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c180b1040 con 0x7f5c2806fd70 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c180b7650 con 0x7f5c2806fd70 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.504+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c28148850 con 0x7f5c2806fd70 2024-04-26T23:26:57.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c28147fb0 con 0x7f5c2806fd70 2024-04-26T23:26:57.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c28050740 con 0x7f5c2806fd70 2024-04-26T23:26:57.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c180be030 con 0x7f5c2806fd70 2024-04-26T23:26:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c1ea00640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 0x7f5c0406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5c181207a0 con 0x7f5c2806fd70 2024-04-26T23:26:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 0x7f5c0406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.508+0000 7f5c1fe00640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 0x7f5c0406a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c28149100 tx=0x7f5c10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.512+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c180c5020 con 0x7f5c2806fd70 2024-04-26T23:26:57.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.712+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c2816a0c0 con 0x7f5c2806fd70 2024-04-26T23:26:57.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c1ea00640 1 -- 172.21.15.39:0/2449586855 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f5c18015fb0 con 0x7f5c2806fd70 2024-04-26T23:26:57.720 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:57.720 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:57.721 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 msgr2=0x7f5c0406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 0x7f5c0406a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c28149100 tx=0x7f5c10008040 comp rx=0 tx=0).stop 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 msgr2=0x7f5c28147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c180ae040 tx=0x7f5c1801aab0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 shutdown_connections 2024-04-26T23:26:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5c040683d0 0x7f5c0406a890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c2815fea0 0x7f5c28150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5c2815d000 0x7f5c2814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 --2- 172.21.15.39:0/2449586855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2806fd70 0x7f5c28147530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 >> 172.21.15.39:0/2449586855 conn(0x7f5c280b2af0 msgr2=0x7f5c28160c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 shutdown_connections 2024-04-26T23:26:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.716+0000 7f5c2d400640 1 -- 172.21.15.39:0/2449586855 wait complete. 2024-04-26T23:26:57.742 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:26:57.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.876+0000 7f7dd2e00640 1 Processor -- start 2024-04-26T23:26:57.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.876+0000 7f7dd2e00640 1 -- start start 2024-04-26T23:26:57.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd2e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7dcc0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd2e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc074750 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd2e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0d0550 con 0x7f7dcc0cd810 2024-04-26T23:26:57.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd2e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc0d0b10 con 0x7f7dcc0742f0 2024-04-26T23:26:57.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7dcc0cdbf0 0x7f7dcc06ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53484/0 (socket says 172.21.15.39:53484) 2024-04-26T23:26:57.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 -- 172.21.15.39:0/486680719 learned_addr learned my addr 172.21.15.39:0/486680719 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dc3400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7dcc0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000868875 0 0) 0x7f7dcc074750 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db0003530 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3285877558 0 0) 0x7f7db0003530 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 msgr2=0x7f7dcc0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7dcc0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 >> v1:172.21.15.71:6789/0 conn(0x7f7dcc0cd810 legacy=0x7f7dcc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0d0830 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f7dc4001a00 con 0x7f7dcc0cdbf0 2024-04-26T23:26:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 >> v1:172.21.15.39:6789/0 conn(0x7f7dcc0cdbf0 legacy=0x7f7dcc06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7db00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0003f30 0x7f7db0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7db0004d50 0x7f7db00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0d0b10 con 0x7f7db0004d50 2024-04-26T23:26:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7db000bae0 con 0x7f7db0003f30 2024-04-26T23:26:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7db000bce0 con 0x7f7dcc0742f0 2024-04-26T23:26:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7db0004d50 0x7f7db00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dcbe00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7db00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dc3400640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0003f30 0x7f7db0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 -- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 msgr2=0x7f7db00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7dcc0742f0 0x7f7db00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 -- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0003f30 msgr2=0x7f7db0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0003f30 0x7f7db0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.880+0000 7f7dd0e00640 1 -- 172.21.15.39:0/486680719 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db0003530 con 0x7f7db0004d50 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd0e00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7db0004d50 0x7f7db00051d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400a880 tx=0x7f7dc401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa0da2342230bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400a4a0 con 0x7f7db0004d50 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc40ad650 con 0x7f7db0004d50 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dcb400640 1 -- 172.21.15.39:0/486680719 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40ada80 con 0x7f7db0004d50 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- 172.21.15.39:0/486680719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7db0004d50 msgr2=0x7f7db00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/486680719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7db0004d50 0x7f7db00051d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400a880 tx=0x7f7dc401d380 comp rx=0 tx=0).stop 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd0e00640 1 -- 172.21.15.39:0/486680719 reap_dead start 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- 172.21.15.39:0/486680719 shutdown_connections 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- 172.21.15.39:0/486680719 >> 172.21.15.39:0/486680719 conn(0x7f7dcc0b2af0 msgr2=0x7f7dcc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- 172.21.15.39:0/486680719 shutdown_connections 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- 172.21.15.39:0/486680719 wait complete. 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 Processor -- start 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.884+0000 7f7dd2e00640 1 -- start start 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 0x7f7dcc13fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc162fc0 0x7f7dcc15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0ce1c0 con 0x7f7dcc166f80 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0ce040 con 0x7f7dcc162fc0 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc143bb0 con 0x7f7db0004d50 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35540/0 (socket says 172.21.15.39:35540) 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 -- 172.21.15.39:0/3619921987 learned_addr learned my addr 172.21.15.39:0/3619921987 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dcbe00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 0x7f7dcc13fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd0e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc162fc0 0x7f7dcc15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 -- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 msgr2=0x7f7dcc13fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 0x7f7dcc13fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 -- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc162fc0 msgr2=0x7f7dcc15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc162fc0 0x7f7dcc15c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 -- 172.21.15.39:0/3619921987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1619e0 con 0x7f7dcc166f80 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dcbe00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 0x7f7dcc13fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc3400640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7db4011a00 tx=0x7f7db4011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400fb50 con 0x7f7dcc166f80 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db400fcf0 con 0x7f7dcc166f80 2024-04-26T23:26:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc161cc0 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400fea0 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc162280 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.888+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc050740 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.892+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7db4012040 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.892+0000 7f7dc8c00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 0x7f7da806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.892+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7db40871a0 con 0x7f7dcc166f80 2024-04-26T23:26:57.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.892+0000 7f7dcbe00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 0x7f7da806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:57.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.892+0000 7f7dcbe00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 0x7f7da806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b0780 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:57.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:57.896+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7db4019030 con 0x7f7dcc166f80 2024-04-26T23:26:58.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dcc0cd360 con 0x7f7dcc166f80 2024-04-26T23:26:58.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dc8c00640 1 -- 172.21.15.39:0/3619921987 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5169 (secure 0 0 0) 0x7f7db4057790 con 0x7f7dcc166f80 2024-04-26T23:26:58.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:58.102 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/983439937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":983439937},{"type":"v1","addr":"172.21.15.71:6836","nonce":983439937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/483803464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":483803464},{"type":"v1","addr":"172.21.15.39:6834","nonce":483803464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1619888823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1619888823},{"type":"v1","addr":"172.21.15.39:6835","nonce":1619888823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:26:14.110510+0000","modified":"2024-04-26T23:26:17.119947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/1341599225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1341599225},{"type":"v1","addr":"172.21.15.71:6837","nonce":1341599225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T23:26:58.102 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 msgr2=0x7f7da806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 0x7f7da806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b0780 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 msgr2=0x7f7dcc162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7db4011a00 tx=0x7f7db4011ec0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 shutdown_connections 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7da8068380 0x7f7da806a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc162fc0 0x7f7dcc15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dcc166f80 0x7f7dcc162a80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 --2- 172.21.15.39:0/3619921987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7db0004d50 0x7f7dcc13fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 >> 172.21.15.39:0/3619921987 conn(0x7f7dcc0b2af0 msgr2=0x7f7dcc141ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:58.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 shutdown_connections 2024-04-26T23:26:58.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.096+0000 7f7dd2e00640 1 -- 172.21.15.39:0/3619921987 wait complete. 2024-04-26T23:26:58.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:26:58.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 Processor -- start 2024-04-26T23:26:58.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 -- start start 2024-04-26T23:26:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 0x7f083c163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f083c06cae0 0x7f083c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c15fad0 con 0x7f083c0d19b0 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f083c0d1580 con 0x7f083c06cae0 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0843800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f083c164110 con 0x7f083c15f6f0 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0840e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 0x7f083c163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0841800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f083c06cae0 0x7f083c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f083be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f083c0d19b0 0x7f083c06c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:54894/0 (socket says 172.21.15.39:54894) 2024-04-26T23:26:58.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f083be00640 1 -- 172.21.15.39:0/3126206939 learned_addr learned my addr 172.21.15.39:0/3126206939 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0841800640 1 -- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 msgr2=0x7f083c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0841800640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 0x7f083c163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0841800640 1 -- 172.21.15.39:0/3126206939 >> v1:172.21.15.71:6789/0 conn(0x7f083c0d19b0 legacy=0x7f083c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0841800640 1 -- 172.21.15.39:0/3126206939 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c0d0100 con 0x7f083c06cae0 2024-04-26T23:26:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.260+0000 7f0840e00640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 0x7f083c163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:26:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0841800640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c06f290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0834009dc0 tx=0x7f083401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d80173e73127a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f083b400640 1 -- 172.21.15.39:0/3126206939 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08340b2070 con 0x7f083c06cae0 2024-04-26T23:26:58.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f083b400640 1 -- 172.21.15.39:0/3126206939 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08340a59e0 con 0x7f083c06cae0 2024-04-26T23:26:58.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f083b400640 1 -- 172.21.15.39:0/3126206939 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08340a5db0 con 0x7f083c06cae0 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 -- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 msgr2=0x7f083c06f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c06f290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0834009dc0 tx=0x7f083401c920 comp rx=0 tx=0).stop 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 -- 172.21.15.39:0/3126206939 shutdown_connections 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c06f290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 --2- 172.21.15.39:0/3126206939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c15f6f0 0x7f083c163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 -- 172.21.15.39:0/3126206939 >> 172.21.15.39:0/3126206939 conn(0x7f083c0d1ee0 msgr2=0x7f083c0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 -- 172.21.15.39:0/3126206939 shutdown_connections 2024-04-26T23:26:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.264+0000 7f0843800640 1 -- 172.21.15.39:0/3126206939 wait complete. 2024-04-26T23:26:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 Processor -- start 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- start start 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c0af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c0d19b0 0x7f083c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f083c16c310 con 0x7f083c15f6f0 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0cfd90 con 0x7f083c06cae0 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f083c16c490 con 0x7f083c0d19b0 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35556/0 (socket says 172.21.15.39:35556) 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 -- 172.21.15.39:0/2366970081 learned_addr learned my addr 172.21.15.39:0/2366970081 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0840e00640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c0af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f083be00640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c0d19b0 0x7f083c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 -- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c0d19b0 msgr2=0x7f083c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c0d19b0 0x7f083c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 -- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 msgr2=0x7f083c0af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c0af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 -- 172.21.15.39:0/2366970081 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c1571f0 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0841800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08340b0040 tx=0x7f08340196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08340bd020 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08340b8670 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08340b2040 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c1574d0 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.268+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c157a90 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c050740 con 0x7f083c15f6f0 2024-04-26T23:26:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08340c0020 con 0x7f083c15f6f0 2024-04-26T23:26:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0838c00640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 0x7f081c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0834121a80 con 0x7f083c15f6f0 2024-04-26T23:26:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0840e00640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 0x7f081c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.272+0000 7f0840e00640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 0x7f081c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0830009580 tx=0x7f0830009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.276+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0834123e20 con 0x7f083c15f6f0 2024-04-26T23:26:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f083c1635e0 con 0x7f083c15f6f0 2024-04-26T23:26:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0838c00640 1 -- 172.21.15.39:0/2366970081 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16793 (secure 0 0 0) 0x7f08340c7030 con 0x7f083c15f6f0 2024-04-26T23:26:58.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:26:58.450 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:26:55.254925+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:26:12.161427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:26:13.066427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 msgr2=0x7f081c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 0x7f081c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0830009580 tx=0x7f0830009190 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 msgr2=0x7f083c152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08340b0040 tx=0x7f08340196c0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 shutdown_connections 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f081c068380 0x7f081c06a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f083c15f6f0 0x7f083c152f30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f083c0d19b0 0x7f083c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 --2- 172.21.15.39:0/2366970081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f083c06cae0 0x7f083c0af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 >> 172.21.15.39:0/2366970081 conn(0x7f083c0d1ee0 msgr2=0x7f083c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:58.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 shutdown_connections 2024-04-26T23:26:58.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.444+0000 7f0843800640 1 -- 172.21.15.39:0/2366970081 wait complete. 2024-04-26T23:26:58.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:26:58.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 Processor -- start 2024-04-26T23:26:58.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 -- start start 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc63415d5e0 0x7fc6340cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6340cfb70 0x7fc6340cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6340ceb20 con 0x7fc6340d0f20 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc6340affc0 con 0x7fc63415d5e0 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc639400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc6340cee00 con 0x7fc6340cfb70 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc63415d5e0 0x7fc6340cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc63415d5e0 0x7fc6340cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35560/0 (socket says 172.21.15.39:35560) 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 -- 172.21.15.39:0/762129682 learned_addr learned my addr 172.21.15.39:0/762129682 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc629e00640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6340cfb70 0x7fc6340cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 -- 172.21.15.39:0/762129682 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6340cfb70 msgr2=0x7fc6340cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6340cfb70 0x7fc6340cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 -- 172.21.15.39:0/762129682 >> v1:172.21.15.71:6789/0 conn(0x7fc6340d0f20 legacy=0x7fc6340d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.608+0000 7fc632800640 1 -- 172.21.15.39:0/762129682 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6340cf0e0 con 0x7fc63415d5e0 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc632800640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc63415d5e0 0x7fc6340cf630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc624009870 tx=0x7fc62401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92c1aa9f8676ddc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc631e00640 1 -- 172.21.15.39:0/762129682 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6240b2070 con 0x7fc63415d5e0 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc631e00640 1 -- 172.21.15.39:0/762129682 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6240a9070 con 0x7fc63415d5e0 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc631e00640 1 -- 172.21.15.39:0/762129682 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6240ad880 con 0x7fc63415d5e0 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 -- 172.21.15.39:0/762129682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc63415d5e0 msgr2=0x7fc6340cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc63415d5e0 0x7fc6340cf630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc624009870 tx=0x7fc62401c560 comp rx=0 tx=0).stop 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 -- 172.21.15.39:0/762129682 shutdown_connections 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6340cfb70 0x7fc6340cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 --2- 172.21.15.39:0/762129682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc63415d5e0 0x7fc6340cf630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 -- 172.21.15.39:0/762129682 >> 172.21.15.39:0/762129682 conn(0x7fc6340d3020 msgr2=0x7fc6340d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 -- 172.21.15.39:0/762129682 shutdown_connections 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.612+0000 7fc639400640 1 -- 172.21.15.39:0/762129682 wait complete. 2024-04-26T23:26:58.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 Processor -- start 2024-04-26T23:26:58.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- start start 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6340cfb70 0x7fc6340b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc63415d5e0 0x7fc6341564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc6340d2020 con 0x7fc6340d0f20 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6340d1ea0 con 0x7fc6340cfb70 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc63416aa50 con 0x7fc63415d5e0 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35568/0 (socket says 172.21.15.39:35568) 2024-04-26T23:26:58.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 -- 172.21.15.39:0/2456681795 learned_addr learned my addr 172.21.15.39:0/2456681795 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc632800640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6340cfb70 0x7fc6340b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc633200640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc63415d5e0 0x7fc6341564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 -- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc63415d5e0 msgr2=0x7fc6341564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc63415d5e0 0x7fc6341564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 -- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6340cfb70 msgr2=0x7fc6340b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6340cfb70 0x7fc6340b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 -- 172.21.15.39:0/2456681795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6341547f0 con 0x7fc6340d0f20 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc629e00640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d5f0 tx=0x7fc61c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0125f0 con 0x7fc6340d0f20 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c019070 con 0x7fc6340d0f20 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0129b0 con 0x7fc6340d0f20 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc634154a90 con 0x7fc6340d0f20 2024-04-26T23:26:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.616+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc634155050 con 0x7fc6340d0f20 2024-04-26T23:26:58.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63406a720 con 0x7fc6340d0f20 2024-04-26T23:26:58.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc61c012b50 con 0x7fc6340d0f20 2024-04-26T23:26:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc62b400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 0x7fc61006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc61c086da0 con 0x7fc6340d0f20 2024-04-26T23:26:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc632800640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 0x7fc61006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:58.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.620+0000 7fc632800640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 0x7fc61006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc6240af000 tx=0x7fc6240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:58.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.624+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc61c056bf0 con 0x7fc6340d0f20 2024-04-26T23:26:58.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.824+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc63415f750 con 0x7fc6340d0f20 2024-04-26T23:26:58.830 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-04-26T23:26:58.824+0000 7f6c56400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:26:58.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc62b400640 1 -- 172.21.15.39:0/2456681795 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fc61c05aef0 con 0x7fc6340d0f20 2024-04-26T23:26:58.832 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:26:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 msgr2=0x7fc61006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 0x7fc61006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc6240af000 tx=0x7fc6240a7000 comp rx=0 tx=0).stop 2024-04-26T23:26:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 msgr2=0x7fc634155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d5f0 tx=0x7fc61c00dab0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 shutdown_connections 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc610068380 0x7fc61006a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc63415d5e0 0x7fc6341564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6340d0f20 0x7fc634155fa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 --2- 172.21.15.39:0/2456681795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6340cfb70 0x7fc6340b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 >> 172.21.15.39:0/2456681795 conn(0x7fc6340d3020 msgr2=0x7fc63415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 shutdown_connections 2024-04-26T23:26:58.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.828+0000 7fc639400640 1 -- 172.21.15.39:0/2456681795 wait complete. 2024-04-26T23:26:58.848 INFO:tasks.ceph.mds.b.smithi071.stderr: -7651> 2024-04-26T23:26:18.409+0000 7fb823600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:26:58.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:26:58.902 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-04-26T23:26:59.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 Processor -- start 2024-04-26T23:26:59.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 -- start start 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6c00cf940 0x7fb6c006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c01492a0 con 0x7fb6c01488f0 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c006d740 con 0x7fb6c00cf940 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c0070840 con 0x7fb6c006d2f0 2024-04-26T23:26:59.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c5000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb6c01488f0 0x7fb6c00cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53488/0 (socket says 172.21.15.39:53488) 2024-04-26T23:26:59.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c5000640 1 -- 172.21.15.39:0/2206259494 learned_addr learned my addr 172.21.15.39:0/2206259494 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:26:59.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/2206259494 >> v2:172.21.15.71:3300/0 conn(0x7fb6c00cf940 0x7fb6c006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6c5a00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6bfe00640 1 -- 172.21.15.39:0/2206259494 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796182955 0 0) 0x7fb6c01492a0 con 0x7fb6c01488f0 2024-04-26T23:26:59.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6bfe00640 1 -- 172.21.15.39:0/2206259494 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a4003530 con 0x7fb6c01488f0 2024-04-26T23:26:59.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6b7e00640 1 -- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 msgr2=0x7fb6c006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:26:59.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c006f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6b7e00640 1 -- 172.21.15.39:0/2206259494 >> v1:172.21.15.39:6789/0 conn(0x7fb6c01488f0 legacy=0x7fb6c00cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:58.996+0000 7fb6b7e00640 1 -- 172.21.15.39:0/2206259494 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c006d9c0 con 0x7fb6c00cf940 2024-04-26T23:26:59.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c00cf940 0x7fb6c006cdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80097c0 tx=0x7fb6a801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60e7830c7b33d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6bfe00640 1 -- 172.21.15.39:0/2206259494 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a7070 con 0x7fb6c00cf940 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6bfe00640 1 -- 172.21.15.39:0/2206259494 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80b0070 con 0x7fb6c00cf940 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6bfe00640 1 -- 172.21.15.39:0/2206259494 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80ab890 con 0x7fb6c00cf940 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c00cf940 msgr2=0x7fb6c006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c00cf940 0x7fb6c006cdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80097c0 tx=0x7fb6a801c470 comp rx=0 tx=0).stop 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- 172.21.15.39:0/2206259494 shutdown_connections 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/2206259494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c00cf940 0x7fb6c006cdb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- 172.21.15.39:0/2206259494 >> 172.21.15.39:0/2206259494 conn(0x7fb6c00ce0e0 msgr2=0x7fb6c00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:59.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- 172.21.15.39:0/2206259494 shutdown_connections 2024-04-26T23:26:59.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- 172.21.15.39:0/2206259494 wait complete. 2024-04-26T23:26:59.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 Processor -- start 2024-04-26T23:26:59.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.000+0000 7fb6c7a00640 1 -- start start 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c01488f0 0x7fb6c00b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0148cd0 con 0x7fb6c00cf940 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c006f070 con 0x7fb6c01488f0 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c00702e0 con 0x7fb6c006d2f0 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35574/0 (socket says 172.21.15.39:35574) 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 -- 172.21.15.39:0/496598011 learned_addr learned my addr 172.21.15.39:0/496598011 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c5000640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c5a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c01488f0 0x7fb6c00b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 -- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 msgr2=0x7fb6c00c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c00c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 -- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c01488f0 msgr2=0x7fb6c00b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c01488f0 0x7fb6c00b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 -- 172.21.15.39:0/496598011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c00c5410 con 0x7fb6c00cf940 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c5000640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6b7e00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80ad040 tx=0x7fb6a801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80bf610 con 0x7fb6c00cf940 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80bf7f0 con 0x7fb6c00cf940 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c00c56f0 con 0x7fb6c00cf940 2024-04-26T23:26:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80bfbe0 con 0x7fb6c00cf940 2024-04-26T23:26:59.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c0157be0 con 0x7fb6c00cf940 2024-04-26T23:26:59.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.004+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c006a720 con 0x7fb6c00cf940 2024-04-26T23:26:59.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.008+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6a80bd020 con 0x7fb6c00cf940 2024-04-26T23:26:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.008+0000 7fb6bd600640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 0x7fb69c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:26:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.008+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7fb6a8120ff0 con 0x7fb6c00cf940 2024-04-26T23:26:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.008+0000 7fb6c5000640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 0x7fb69c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:26:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.008+0000 7fb6c5000640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 0x7fb69c06a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0005890 tx=0x7fb6b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:26:59.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.012+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6a8016090 con 0x7fb6c00cf940 2024-04-26T23:26:59.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.212+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb6c00c58c0 con 0x7fb6c00cf940 2024-04-26T23:26:59.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6bd600640 1 -- 172.21.15.39:0/496598011 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fb6a80f0e30 con 0x7fb6c00cf940 2024-04-26T23:26:59.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 msgr2=0x7fb69c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 0x7fb69c06a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0005890 tx=0x7fb6b0009040 comp rx=0 tx=0).stop 2024-04-26T23:26:59.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 msgr2=0x7fb6c00b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:26:59.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80ad040 tx=0x7fb6a801acb0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 shutdown_connections 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb69c068380 0x7fb69c06a840 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0005890 tx=0x7fb6b0009040 comp rx=0 tx=0).stop 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6c01488f0 0x7fb6c00b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6c00cf940 0x7fb6c00b69b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 --2- 172.21.15.39:0/496598011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c006d2f0 0x7fb6c00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 >> 172.21.15.39:0/496598011 conn(0x7fb6c00ce0e0 msgr2=0x7fb6c00ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 shutdown_connections 2024-04-26T23:26:59.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:26:59.836+0000 7fb6c7a00640 1 -- 172.21.15.39:0/496598011 wait complete. 2024-04-26T23:26:59.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:27:00.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 Processor -- start 2024-04-26T23:27:00.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 -- start start 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8354145870 0x7f83540cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f835406f4d0 0x7f835406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83540cfd30 con 0x7f835415fa90 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8354073d00 con 0x7f835406f4d0 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f835b200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f83540d0010 con 0x7f8354145870 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f835406f4d0 0x7f835406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f835406f4d0 0x7f835406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35582/0 (socket says 172.21.15.39:35582) 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 -- 172.21.15.39:0/217027938 learned_addr learned my addr 172.21.15.39:0/217027938 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f8353e00640 1 --2- 172.21.15.39:0/217027938 >> v2:172.21.15.71:3300/0 conn(0x7f8354145870 0x7f83540cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 -- 172.21.15.39:0/217027938 >> v2:172.21.15.71:3300/0 conn(0x7f8354145870 msgr2=0x7f83540cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:00.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 --2- 172.21.15.39:0/217027938 >> v2:172.21.15.71:3300/0 conn(0x7f8354145870 0x7f83540cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 -- 172.21.15.39:0/217027938 >> v1:172.21.15.71:6789/0 conn(0x7f835415fa90 legacy=0x7f835415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.004+0000 7f834be00640 1 -- 172.21.15.39:0/217027938 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83540d02f0 con 0x7f835406f4d0 2024-04-26T23:27:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f834be00640 1 --2- 172.21.15.39:0/217027938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835406f4d0 0x7f835406f960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8354070540 tx=0x7f833c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ccba377c7ba449 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f8353400640 1 -- 172.21.15.39:0/217027938 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0b4070 con 0x7f835406f4d0 2024-04-26T23:27:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f8353400640 1 -- 172.21.15.39:0/217027938 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833c0a7ad0 con 0x7f835406f4d0 2024-04-26T23:27:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f8353400640 1 -- 172.21.15.39:0/217027938 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0af440 con 0x7f835406f4d0 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 -- 172.21.15.39:0/217027938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835406f4d0 msgr2=0x7f835406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 --2- 172.21.15.39:0/217027938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835406f4d0 0x7f835406f960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8354070540 tx=0x7f833c01ebf0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 -- 172.21.15.39:0/217027938 shutdown_connections 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 --2- 172.21.15.39:0/217027938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835406f4d0 0x7f835406f960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 --2- 172.21.15.39:0/217027938 >> v2:172.21.15.71:3300/0 conn(0x7f8354145870 0x7f83540cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 -- 172.21.15.39:0/217027938 >> 172.21.15.39:0/217027938 conn(0x7f83540b2cc0 msgr2=0x7f83540b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 -- 172.21.15.39:0/217027938 shutdown_connections 2024-04-26T23:27:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.008+0000 7f835b200640 1 -- 172.21.15.39:0/217027938 wait complete. 2024-04-26T23:27:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 Processor -- start 2024-04-26T23:27:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- start start 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f835406f4d0 0x7f8354138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8354145870 0x7f835415ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f835415d710 con 0x7f835415fa90 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f835415d590 con 0x7f8354145870 2024-04-26T23:27:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f83540722a0 con 0x7f835406f4d0 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35596/0 (socket says 172.21.15.39:35596) 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 -- 172.21.15.39:0/563088199 learned_addr learned my addr 172.21.15.39:0/563088199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8353e00640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f835406f4d0 0x7f8354138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f834be00640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8354145870 0x7f835415ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 -- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f835406f4d0 msgr2=0x7f8354138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f835406f4d0 0x7f8354138b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 -- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8354145870 msgr2=0x7f835415ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8354145870 0x7f835415ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 -- 172.21.15.39:0/563088199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8354165d40 con 0x7f835415fa90 2024-04-26T23:27:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8359200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c730 tx=0x7f834c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c003b80 con 0x7f835415fa90 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c003d20 con 0x7f835415fa90 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00aa30 con 0x7f835415fa90 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8354166020 con 0x7f835415fa90 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.012+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541665e0 con 0x7f835415fa90 2024-04-26T23:27:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8354050740 con 0x7f835415fa90 2024-04-26T23:27:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f834c00abd0 con 0x7f835415fa90 2024-04-26T23:27:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f8350c00640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 0x7f833006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f834c086740 con 0x7f835415fa90 2024-04-26T23:27:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f8353e00640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 0x7f833006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.016+0000 7f8353e00640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 0x7f833006a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8354166a30 tx=0x7f8344009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:00.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.020+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f834c056650 con 0x7f835415fa90 2024-04-26T23:27:00.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.184+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f835415af80 con 0x7f835415fa90 2024-04-26T23:27:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.836+0000 7f8350c00640 1 -- 172.21.15.39:0/563088199 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f834c05a950 con 0x7f835415fa90 2024-04-26T23:27:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:27:00.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 msgr2=0x7f833006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 0x7f833006a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8354166a30 tx=0x7f8344009190 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 msgr2=0x7f835415de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c730 tx=0x7f834c00cbf0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 shutdown_connections 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f83300683b0 0x7f833006a870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f835415fa90 0x7f835415de80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8354145870 0x7f835415ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 --2- 172.21.15.39:0/563088199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f835406f4d0 0x7f8354138b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 >> 172.21.15.39:0/563088199 conn(0x7f83540b2cc0 msgr2=0x7f83540b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 shutdown_connections 2024-04-26T23:27:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:00.840+0000 7f835b200640 1 -- 172.21.15.39:0/563088199 wait complete. 2024-04-26T23:27:00.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:27:01.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.008+0000 7f5b4d200640 1 Processor -- start 2024-04-26T23:27:01.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 -- start start 2024-04-26T23:27:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 0x7f5b4806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b480cfd30 con 0x7f5b48145870 2024-04-26T23:27:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b480cfa10 con 0x7f5b4806f4d0 2024-04-26T23:27:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b4d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5b480d0010 con 0x7f5b48072cf0 2024-04-26T23:27:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b3fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 0x7f5b4806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b3fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 0x7f5b4806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:44222/0 (socket says 172.21.15.39:44222) 2024-04-26T23:27:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b3fe00640 1 -- 172.21.15.39:0/809553007 learned_addr learned my addr 172.21.15.39:0/809553007 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:39414/0 (socket says 172.21.15.39:39414) 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b45e00640 1 --1- 172.21.15.39:0/809553007 >> v1:172.21.15.71:6789/0 conn(0x7f5b48145870 0x7f5b480cf300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:45942/0 (socket says 172.21.15.39:45942) 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 -- 172.21.15.39:0/809553007 >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 msgr2=0x7f5b4806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 --2- 172.21.15.39:0/809553007 >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 0x7f5b4806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 -- 172.21.15.39:0/809553007 >> v1:172.21.15.71:6789/0 conn(0x7f5b48145870 legacy=0x7f5b480cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.012+0000 7f5b46800640 1 -- 172.21.15.39:0/809553007 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b480d02f0 con 0x7f5b48072cf0 2024-04-26T23:27:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b46800640 1 --2- 172.21.15.39:0/809553007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009d90 tx=0x7f5b4001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d4516be10c3066 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b45400640 1 -- 172.21.15.39:0/809553007 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b400b2070 con 0x7f5b48072cf0 2024-04-26T23:27:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b45400640 1 -- 172.21.15.39:0/809553007 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b400a5940 con 0x7f5b48072cf0 2024-04-26T23:27:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b45400640 1 -- 172.21.15.39:0/809553007 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b400a5d10 con 0x7f5b48072cf0 2024-04-26T23:27:01.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- 172.21.15.39:0/809553007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 msgr2=0x7f5b48073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 --2- 172.21.15.39:0/809553007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009d90 tx=0x7f5b4001c970 comp rx=0 tx=0).stop 2024-04-26T23:27:01.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- 172.21.15.39:0/809553007 shutdown_connections 2024-04-26T23:27:01.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 --2- 172.21.15.39:0/809553007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b48072cf0 0x7f5b48073160 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 --2- 172.21.15.39:0/809553007 >> v2:172.21.15.71:3300/0 conn(0x7f5b4806f4d0 0x7f5b4806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- 172.21.15.39:0/809553007 >> 172.21.15.39:0/809553007 conn(0x7f5b480b2cc0 msgr2=0x7f5b480b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:01.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- 172.21.15.39:0/809553007 shutdown_connections 2024-04-26T23:27:01.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- 172.21.15.39:0/809553007 wait complete. 2024-04-26T23:27:01.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 Processor -- start 2024-04-26T23:27:01.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.016+0000 7f5b4d200640 1 -- start start 2024-04-26T23:27:01.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 0x7f5b4813ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 0x7f5b481689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48072420 con 0x7f5b48072cf0 2024-04-26T23:27:01.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480722a0 con 0x7f5b48145870 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5b48073ab0 con 0x7f5b4806f4d0 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42910/0 (socket says 172.21.15.39:42910) 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 -- 172.21.15.39:0/2431251643 learned_addr learned my addr 172.21.15.39:0/2431251643 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b45e00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 0x7f5b4813ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b46800640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 0x7f5b481689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 -- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 msgr2=0x7f5b4813ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 0x7f5b4813ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 -- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 msgr2=0x7f5b481689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 0x7f5b481689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 -- 172.21.15.39:0/2431251643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b48139d00 con 0x7f5b48072cf0 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b46800640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 0x7f5b481689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:01.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b45e00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 0x7f5b4813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:01.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3fe00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000e820 tx=0x7f5b3000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:01.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30017070 con 0x7f5b48072cf0 2024-04-26T23:27:01.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3000c940 con 0x7f5b48072cf0 2024-04-26T23:27:01.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b48139fe0 con 0x7f5b48072cf0 2024-04-26T23:27:01.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000cd30 con 0x7f5b48072cf0 2024-04-26T23:27:01.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4813a5a0 con 0x7f5b48072cf0 2024-04-26T23:27:01.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.020+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b48050740 con 0x7f5b48072cf0 2024-04-26T23:27:01.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.024+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b3001a070 con 0x7f5b48072cf0 2024-04-26T23:27:01.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.024+0000 7f5b3e000640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:01.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.024+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f5b30086b50 con 0x7f5b48072cf0 2024-04-26T23:27:01.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.024+0000 7f5b45e00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:01.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.024+0000 7f5b45e00640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b48145180 tx=0x7f5b38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:01.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.028+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b300571f0 con 0x7f5b48072cf0 2024-04-26T23:27:01.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.192+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b480695c0 con 0x7f5b48072cf0 2024-04-26T23:27:01.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.844+0000 7f5b3e000640 1 -- 172.21.15.39:0/2431251643 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f5b30056af0 con 0x7f5b48072cf0 2024-04-26T23:27:01.852 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-04-26T23:27:01.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 msgr2=0x7f5b2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b48145180 tx=0x7f5b38009040 comp rx=0 tx=0).stop 2024-04-26T23:27:01.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 msgr2=0x7f5b48137b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:01.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000e820 tx=0x7f5b3000ece0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 shutdown_connections 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b24068380 0x7f5b2406a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b48145870 0x7f5b481689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b48072cf0 0x7f5b48137b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 --2- 172.21.15.39:0/2431251643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b4806f4d0 0x7f5b4813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 >> 172.21.15.39:0/2431251643 conn(0x7f5b480b2cc0 msgr2=0x7f5b4813f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 shutdown_connections 2024-04-26T23:27:01.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:01.848+0000 7f5b4d200640 1 -- 172.21.15.39:0/2431251643 wait complete. 2024-04-26T23:27:01.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:27:01.881 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:27:01.881 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:27:01.881 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:01.881 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:27:01.881 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:27:01.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:27:01.881 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:01.882 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:27:01.882 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:27:01.882 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:27:01.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:01.882 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:27:01.882 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:27:01.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:27:01.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:01.895 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:27:01.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:27:01.896 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:27:01.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:27:01.897 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:27:01.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:27:01.898 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:27:01.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:27:01.945 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:27:01.947 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:01.950 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:27:01.952 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:27:01.952 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:27:01.952 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:01.953 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:01.953 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:01.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:27:02.030 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-04-26T23:27:02.032 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:27:02.033 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:27:02.033 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-04-26T23:27:02.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 Processor -- start 2024-04-26T23:27:02.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 -- start start 2024-04-26T23:27:02.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 0x7f30840b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308406e750 con 0x7f30840d0f20 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f308406ea30 con 0x7f30840d1a90 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3089000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f308406ed10 con 0x7f308415f990 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3079400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f30840d0f20 0x7f30840d1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50958/0 (socket says 172.21.15.39:50958) 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3079400640 1 -- 172.21.15.39:0/1365070367 learned_addr learned my addr 172.21.15.39:0/1365070367 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3082800640 1 --2- 172.21.15.39:0/1365070367 >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 0x7f30840b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081e00640 1 --2- 172.21.15.39:0/1365070367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081400640 1 -- 172.21.15.39:0/1365070367 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523122625 0 0) 0x7f308406e750 con 0x7f30840d0f20 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081400640 1 -- 172.21.15.39:0/1365070367 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3068003530 con 0x7f30840d0f20 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081e00640 1 -- 172.21.15.39:0/1365070367 >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 msgr2=0x7f30840b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081e00640 1 --2- 172.21.15.39:0/1365070367 >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 0x7f30840b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081e00640 1 -- 172.21.15.39:0/1365070367 >> v1:172.21.15.39:6789/0 conn(0x7f30840d0f20 legacy=0x7f30840d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3081e00640 1 -- 172.21.15.39:0/1365070367 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30840b2a00 con 0x7f308415f990 2024-04-26T23:27:02.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.096+0000 7f3082800640 1 --2- 172.21.15.39:0/1365070367 >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 0x7f30840b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3081e00640 1 --2- 172.21.15.39:0/1365070367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b4530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30740097c0 tx=0x7f307401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8491f6b3039e1cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3081400640 1 -- 172.21.15.39:0/1365070367 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30740b0070 con 0x7f308415f990 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3081400640 1 -- 172.21.15.39:0/1365070367 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30740ab600 con 0x7f308415f990 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3081400640 1 -- 172.21.15.39:0/1365070367 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30740ab9d0 con 0x7f308415f990 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 -- 172.21.15.39:0/1365070367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 msgr2=0x7f30840b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 --2- 172.21.15.39:0/1365070367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b4530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30740097c0 tx=0x7f307401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 -- 172.21.15.39:0/1365070367 shutdown_connections 2024-04-26T23:27:02.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 --2- 172.21.15.39:0/1365070367 >> v2:172.21.15.71:3300/0 conn(0x7f30840d1a90 0x7f30840b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 --2- 172.21.15.39:0/1365070367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b4530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 -- 172.21.15.39:0/1365070367 >> 172.21.15.39:0/1365070367 conn(0x7f30840d3020 msgr2=0x7f30840d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:02.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 -- 172.21.15.39:0/1365070367 shutdown_connections 2024-04-26T23:27:02.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.100+0000 7f3089000640 1 -- 172.21.15.39:0/1365070367 wait complete. 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 Processor -- start 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- start start 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 0x7f3084152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30840b4000 con 0x7f30840d1a90 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30840b3e80 con 0x7f30840d0f20 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f30840b4180 con 0x7f308415f990 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3079400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3079400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42950/0 (socket says 172.21.15.39:42950) 2024-04-26T23:27:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3079400640 1 -- 172.21.15.39:0/2548397367 learned_addr learned my addr 172.21.15.39:0/2548397367 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 0x7f3084152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3082800640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 -- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 msgr2=0x7f30840b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 -- 172.21.15.39:0/2548397367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 msgr2=0x7f30841540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 -- 172.21.15.39:0/2548397367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308415d850 con 0x7f30840d0f20 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3079400640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3081e00640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 0x7f3084152e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30740ab000 tx=0x7f307401ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30740b0050 con 0x7f30840d0f20 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30740bc070 con 0x7f30840d0f20 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30740b5a50 con 0x7f30840d0f20 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308415db30 con 0x7f30840d0f20 2024-04-26T23:27:02.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.104+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3084160e40 con 0x7f30840d0f20 2024-04-26T23:27:02.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308415e050 con 0x7f30840d0f20 2024-04-26T23:27:02.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30740ab480 con 0x7f30840d0f20 2024-04-26T23:27:02.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f307aa00640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 0x7f306006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:02.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f3074120fd0 con 0x7f30840d0f20 2024-04-26T23:27:02.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f3079400640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 0x7f306006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:02.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.108+0000 7f3079400640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 0x7f306006a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30840c9d30 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:02.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.112+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3074016090 con 0x7f30840d0f20 2024-04-26T23:27:02.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.296+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f308406a720 con 0x7f30840d0f20 2024-04-26T23:27:02.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.860+0000 7f307aa00640 1 -- 172.21.15.39:0/2548397367 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f30740f1900 con 0x7f30840d0f20 2024-04-26T23:27:02.868 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2024-04-26T23:27:02.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 msgr2=0x7f306006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 0x7f306006a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30840c9d30 tx=0x7f306c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 msgr2=0x7f3084152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 0x7f3084152e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30740ab000 tx=0x7f307401ace0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 shutdown_connections 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3060068380 0x7f306006a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f308415f990 0x7f30840b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30840d1a90 0x7f30841540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 --2- 172.21.15.39:0/2548397367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30840d0f20 0x7f3084152e10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 >> 172.21.15.39:0/2548397367 conn(0x7f30840d3020 msgr2=0x7f30840ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 shutdown_connections 2024-04-26T23:27:02.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:02.864+0000 7f3089000640 1 -- 172.21.15.39:0/2548397367 wait complete. 2024-04-26T23:27:02.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:27:03.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 Processor -- start 2024-04-26T23:27:03.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 -- start start 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f593806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593806eab0 con 0x7f593815f1f0 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59380aedf0 con 0x7f59380ae850 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.032+0000 7f593d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f59380b4d70 con 0x7f593815f5d0 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f593815f1f0 0x7f5938073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50974/0 (socket says 172.21.15.39:50974) 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935e00640 1 -- 172.21.15.39:0/3887636494 learned_addr learned my addr 172.21.15.39:0/3887636494 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:03.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935400640 1 --2- 172.21.15.39:0/3887636494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f593806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802619053 0 0) 0x7f59380aedf0 con 0x7f59380ae850 2024-04-26T23:27:03.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f591c003530 con 0x7f59380ae850 2024-04-26T23:27:03.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828603352 0 0) 0x7f5928001120 con 0x7f593815f1f0 2024-04-26T23:27:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59380aedf0 con 0x7f593815f1f0 2024-04-26T23:27:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935400640 1 -- 172.21.15.39:0/3887636494 >> v1:172.21.15.71:6789/0 conn(0x7f59380ae850 legacy=0x7f59380b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935400640 1 -- 172.21.15.39:0/3887636494 >> v1:172.21.15.39:6789/0 conn(0x7f593815f1f0 legacy=0x7f5938073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935400640 1 -- 172.21.15.39:0/3887636494 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59380b4720 con 0x7f593815f5d0 2024-04-26T23:27:03.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.036+0000 7f5935400640 1 --2- 172.21.15.39:0/3887636494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f593806d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59240097f0 tx=0x7f592401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e6f76c8363cbe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240b5070 con 0x7f593815f5d0 2024-04-26T23:27:03.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240a89d0 con 0x7f593815f5d0 2024-04-26T23:27:03.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5934a00640 1 -- 172.21.15.39:0/3887636494 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240a8d80 con 0x7f593815f5d0 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- 172.21.15.39:0/3887636494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 msgr2=0x7f593806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 --2- 172.21.15.39:0/3887636494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f593806d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59240097f0 tx=0x7f592401ecd0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- 172.21.15.39:0/3887636494 shutdown_connections 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 --2- 172.21.15.39:0/3887636494 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f593806d3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- 172.21.15.39:0/3887636494 >> 172.21.15.39:0/3887636494 conn(0x7f59380729d0 msgr2=0x7f5938072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- 172.21.15.39:0/3887636494 shutdown_connections 2024-04-26T23:27:03.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- 172.21.15.39:0/3887636494 wait complete. 2024-04-26T23:27:03.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 Processor -- start 2024-04-26T23:27:03.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- start start 2024-04-26T23:27:03.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59380ae850 0x7f5938152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f59381519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f593806daa0 con 0x7f593815f1f0 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f593806d920 con 0x7f59380ae850 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f593d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f593806dc20 con 0x7f593815f5d0 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5935400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5935400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42956/0 (socket says 172.21.15.39:42956) 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5935400640 1 -- 172.21.15.39:0/1199961236 learned_addr learned my addr 172.21.15.39:0/1199961236 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5935e00640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59380ae850 0x7f5938152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.040+0000 7f5936800640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f59381519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 -- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 msgr2=0x7f59381519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f59381519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 -- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59380ae850 msgr2=0x7f5938152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59380ae850 0x7f5938152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 -- 172.21.15.39:0/1199961236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938160900 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f5935400640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5924000c10 tx=0x7f592401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240bf070 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240b0640 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240b5040 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5938160b80 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5938161140 con 0x7f593815f1f0 2024-04-26T23:27:03.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5938050740 con 0x7f593815f1f0 2024-04-26T23:27:03.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59240b09f0 con 0x7f593815f1f0 2024-04-26T23:27:03.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.044+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f5924122d80 con 0x7f593815f1f0 2024-04-26T23:27:03.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.048+0000 7f5935e00640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.048+0000 7f5935e00640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 0x7f591806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5928005890 tx=0x7f5928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.048+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5938160900 con 0x7f593815f1f0 2024-04-26T23:27:03.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.268+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5938163d30 con 0x7f593815f1f0 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f592e000640 1 -- 172.21.15.39:0/1199961236 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f5924018830 con 0x7f593815f1f0 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqV33LRAAEJGRcr66jyYjplL5wl+brg==", 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.276 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmxfZIOhAAqBAlj+xssqRyWvvbCYfPwA==", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmSwdTNRAA9WY84j6z2N65LmrYLj+lYA==", 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.278 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmau88BhAAGTd6/z68e7znV/KHRCCDGA==", 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:03.279 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDdNyxmZuaFKhAAsfRLhoI4+QYnw9ufIR28iA==", 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.280 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDgNyxmPDO6NBAAdHN3Ijn/eE9d0sEomTfEtw==", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.281 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDkNyxmTFCfAhAA/Q6nJAECSWB/CwTzLIV3rA==", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDnNyxmh9LLCxAA+qQSaClk3U21trpe22vj3A==", 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.282 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDtNyxmbifsBRAAjNjFGc0ejjAFGEcIugsBvA==", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.283 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDwNyxmnTs7ERAA//zGSDQBvm2tcRzZTOlNvA==", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDzNyxm5C8dHBAAeWFaQRTmZVLQqrfyScFj3A==", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.284 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD2Nyxmek04JRAALoMi3/NJ6Sp0Lfx6VeWKWA==", 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2024-04-26T23:27:03.285 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g==", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmTGgYFBAAVTR5yp7RgxU5styz5dROGw==", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:03.286 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmT9aVEBAAib2ep6XrtA1R8JCqVmQbRw==", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2024-04-26T23:27:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmMDXpGRAA9orIW7EXyWBNIend4Gr4pA==", 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.288 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxm5J90ERAA9DJ7JqkuVegQd3DC6U1UCA==", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mds", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmvI47JxAAY2yhEnBrHYf+tYoTYvGRMg==", 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmCpk7JxAAhALTJpEfuRqGdGWa5zROwA==", 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-osd", 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmuaE7JxAAJWVH/k/dxMjzaPstHU+XfA==", 2024-04-26T23:27:03.290 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmZKo7JxAAN/BQi7drRJTLkid9a2aYZg==", 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmcLQ7JxAAfZpze+UaMDeYJfJtpkX/kg==", 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.291 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD8NyxmUr07JxAAp87WmNiM9vpCnCyt3IRw6Q==", 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmW4xWKRAA7+rz/WwBsBWQ5XhHVOvfkQ==", 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:03.292 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqK9rJRAA9aE1iwhQtH0eYlqn5obd/A==", 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-04-26T23:27:03.293 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 msgr2=0x7f591806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 0x7f591806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5928005890 tx=0x7f5928009040 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 msgr2=0x7f59381603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5924000c10 tx=0x7f592401ba70 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 shutdown_connections 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f593815f5d0 0x7f59381519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f593815f1f0 0x7f59381603c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 --2- 172.21.15.39:0/1199961236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59380ae850 0x7f5938152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 >> 172.21.15.39:0/1199961236 conn(0x7f59380729d0 msgr2=0x7f59380cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 shutdown_connections 2024-04-26T23:27:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.272+0000 7f593d200640 1 -- 172.21.15.39:0/1199961236 wait complete. 2024-04-26T23:27:03.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T23:27:03.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.432+0000 7fb7b0400640 1 Processor -- start 2024-04-26T23:27:03.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.432+0000 7fb7b0400640 1 -- start start 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7b0400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb7a815ce60 0x7fb7a80b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7b0400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a8163f40 con 0x7fb7a80b1d60 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7b0400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a815fc00 con 0x7fb7a815d240 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7b0400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a80ae040 con 0x7fb7a815ce60 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ae400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb7a80b1d60 0x7fb7a80739a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50990/0 (socket says 172.21.15.39:50990) 2024-04-26T23:27:03.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ae400640 1 -- 172.21.15.39:0/3915376583 learned_addr learned my addr 172.21.15.39:0/3915376583 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:03.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ada00640 1 --2- 172.21.15.39:0/3915376583 >> v2:172.21.15.71:3300/0 conn(0x7fb7a815ce60 0x7fb7a80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884451697 0 0) 0x7fb7a8163f40 con 0x7fb7a80b1d60 2024-04-26T23:27:03.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb790003530 con 0x7fb7a80b1d60 2024-04-26T23:27:03.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199428371 0 0) 0x7fb7a815fc00 con 0x7fb7a815d240 2024-04-26T23:27:03.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a8163f40 con 0x7fb7a815d240 2024-04-26T23:27:03.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ada00640 1 -- 172.21.15.39:0/3915376583 >> v1:172.21.15.71:6789/0 conn(0x7fb7a815d240 legacy=0x7fb7a80b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3182654274 0 0) 0x7fb790003530 con 0x7fb7a80b1d60 2024-04-26T23:27:03.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ada00640 1 -- 172.21.15.39:0/3915376583 >> v1:172.21.15.39:6789/0 conn(0x7fb7a80b1d60 legacy=0x7fb7a80739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.436+0000 7fb7ada00640 1 -- 172.21.15.39:0/3915376583 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a815fee0 con 0x7fb7a815ce60 2024-04-26T23:27:03.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7ada00640 1 --2- 172.21.15.39:0/3915376583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815ce60 0x7fb7a80b0520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097c0 tx=0x7fb79c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7a894b2faf1a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0b0070 con 0x7fb7a815ce60 2024-04-26T23:27:03.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0ab400 con 0x7fb7a815ce60 2024-04-26T23:27:03.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7a7e00640 1 -- 172.21.15.39:0/3915376583 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0001a00 con 0x7fb7a815ce60 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- 172.21.15.39:0/3915376583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815ce60 msgr2=0x7fb7a80b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 --2- 172.21.15.39:0/3915376583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815ce60 0x7fb7a80b0520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097c0 tx=0x7fb79c01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- 172.21.15.39:0/3915376583 shutdown_connections 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 --2- 172.21.15.39:0/3915376583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815ce60 0x7fb7a80b0520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- 172.21.15.39:0/3915376583 >> 172.21.15.39:0/3915376583 conn(0x7fb7a80b65c0 msgr2=0x7fb7a80b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- 172.21.15.39:0/3915376583 shutdown_connections 2024-04-26T23:27:03.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- 172.21.15.39:0/3915376583 wait complete. 2024-04-26T23:27:03.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 Processor -- start 2024-04-26T23:27:03.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.440+0000 7fb7b0400640 1 -- start start 2024-04-26T23:27:03.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb7a815ce60 0x7fb7a80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815d240 0x7fb7a8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8163af0 con 0x7fb7a80b1d60 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80b0d60 con 0x7fb7a815d240 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a8163c70 con 0x7fb7a815ce60 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42968/0 (socket says 172.21.15.39:42968) 2024-04-26T23:27:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 -- 172.21.15.39:0/1052657766 learned_addr learned my addr 172.21.15.39:0/1052657766 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 -- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb7a815ce60 msgr2=0x7fb7a80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb7a815ce60 0x7fb7a80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 -- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815d240 msgr2=0x7fb7a8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815d240 0x7fb7a8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 -- 172.21.15.39:0/1052657766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80cba90 con 0x7fb7a80b1d60 2024-04-26T23:27:03.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7ada00640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ae040 tx=0x7fb79c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0bb020 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0b1040 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0b0050 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a80b4a60 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a80b5020 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a806a720 con 0x7fb7a80b1d60 2024-04-26T23:27:03.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.444+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb79c0be070 con 0x7fb7a80b1d60 2024-04-26T23:27:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.448+0000 7fb7a5600640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 0x7fb78806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.448+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fb79c11fc80 con 0x7fb7a80b1d60 2024-04-26T23:27:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.448+0000 7fb7ad000640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 0x7fb78806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.448+0000 7fb7ad000640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 0x7fb78806a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb794007fd0 tx=0x7fb794007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.452+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb79c015fb0 con 0x7fb7a80b1d60 2024-04-26T23:27:03.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.676+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb7a806d570 con 0x7fb7a80b1d60 2024-04-26T23:27:03.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.676+0000 7fb7a5600640 1 -- 172.21.15.39:0/1052657766 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fb79c0f0600 con 0x7fb7a80b1d60 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 msgr2=0x7fb78806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 0x7fb78806a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb794007fd0 tx=0x7fb794007960 comp rx=0 tx=0).stop 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 msgr2=0x7fb7a809b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ae040 tx=0x7fb79c01ac00 comp rx=0 tx=0).stop 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 shutdown_connections 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb7880683d0 0x7fb78806a890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7a815d240 0x7fb7a8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb7a815ce60 0x7fb7a80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 --2- 172.21.15.39:0/1052657766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7a80b1d60 0x7fb7a809b150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 >> 172.21.15.39:0/1052657766 conn(0x7fb7a80b65c0 msgr2=0x7fb7a80ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 shutdown_connections 2024-04-26T23:27:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.680+0000 7fb7b0400640 1 -- 172.21.15.39:0/1052657766 wait complete. 2024-04-26T23:27:03.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T23:27:03.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.840+0000 7fcaf8600640 1 Processor -- start 2024-04-26T23:27:03.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.840+0000 7fcaf8600640 1 -- start start 2024-04-26T23:27:03.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf8600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcaf00cf940 0x7fcaf006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf8600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf01492a0 con 0x7fcaf01488f0 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf8600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf0070840 con 0x7fcaf006d2f0 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf8600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf006d700 con 0x7fcaf00cf940 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcaf00cf940 0x7fcaf006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcaf01488f0 0x7fcaf00cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51000/0 (socket says 172.21.15.39:51000) 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5c00640 1 -- 172.21.15.39:0/564360997 learned_addr learned my addr 172.21.15.39:0/564360997 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5200640 1 -- 172.21.15.39:0/564360997 >> v1:172.21.15.71:6789/0 conn(0x7fcaf006d2f0 legacy=0x7fcaf006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:03.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5200640 1 -- 172.21.15.39:0/564360997 >> v1:172.21.15.39:6789/0 conn(0x7fcaf01488f0 legacy=0x7fcaf00cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.844+0000 7fcaf5200640 1 -- 172.21.15.39:0/564360997 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf006d9c0 con 0x7fcaf00cf940 2024-04-26T23:27:03.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf5200640 1 --2- 172.21.15.39:0/564360997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf00cf940 0x7fcaf006cdb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0097c0 tx=0x7fcadc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4ca5329cb3c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaefe00640 1 -- 172.21.15.39:0/564360997 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0ab430 con 0x7fcaf00cf940 2024-04-26T23:27:03.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaefe00640 1 -- 172.21.15.39:0/564360997 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc0b0070 con 0x7fcaf00cf940 2024-04-26T23:27:03.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaefe00640 1 -- 172.21.15.39:0/564360997 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0ab7f0 con 0x7fcaf00cf940 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- 172.21.15.39:0/564360997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf00cf940 msgr2=0x7fcaf006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 --2- 172.21.15.39:0/564360997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf00cf940 0x7fcaf006cdb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0097c0 tx=0x7fcadc01c430 comp rx=0 tx=0).stop 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- 172.21.15.39:0/564360997 shutdown_connections 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 --2- 172.21.15.39:0/564360997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf00cf940 0x7fcaf006cdb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- 172.21.15.39:0/564360997 >> 172.21.15.39:0/564360997 conn(0x7fcaf00ce0e0 msgr2=0x7fcaf00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- 172.21.15.39:0/564360997 shutdown_connections 2024-04-26T23:27:03.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- 172.21.15.39:0/564360997 wait complete. 2024-04-26T23:27:03.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 Processor -- start 2024-04-26T23:27:03.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- start start 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf006d2f0 0x7fcaf015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcaf00cf940 0x7fcaf015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0148cd0 con 0x7fcaf01488f0 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf006f070 con 0x7fcaf006d2f0 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf8600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf016d3f0 con 0x7fcaf00cf940 2024-04-26T23:27:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf6600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf6600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42988/0 (socket says 172.21.15.39:42988) 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.848+0000 7fcaf6600640 1 -- 172.21.15.39:0/3662918226 learned_addr learned my addr 172.21.15.39:0/3662918226 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf5c00640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf006d2f0 0x7fcaf015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf5200640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcaf00cf940 0x7fcaf015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 -- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcaf00cf940 msgr2=0x7fcaf015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcaf00cf940 0x7fcaf015ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 -- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf006d2f0 msgr2=0x7fcaf015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf006d2f0 0x7fcaf015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 -- 172.21.15.39:0/3662918226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf00ca360 con 0x7fcaf01488f0 2024-04-26T23:27:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf6600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcae800b9c0 tx=0x7fcae800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8019070 con 0x7fcaf01488f0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae800cba0 con 0x7fcaf01488f0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8014440 con 0x7fcaf01488f0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf00ca640 con 0x7fcaf01488f0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf00c9780 con 0x7fcaf01488f0 2024-04-26T23:27:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf006a720 con 0x7fcaf01488f0 2024-04-26T23:27:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcae801c070 con 0x7fcaf01488f0 2024-04-26T23:27:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 0x7fcad006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.852+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fcae8086380 con 0x7fcaf01488f0 2024-04-26T23:27:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.856+0000 7fcaf5c00640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 0x7fcad006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.856+0000 7fcaf5c00640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 0x7fcad006a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000f70 tx=0x7fcae4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:03.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:03.860+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcae8056d00 con 0x7fcaf01488f0 2024-04-26T23:27:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.084+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fcaf00cf720 con 0x7fcaf01488f0 2024-04-26T23:27:04.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaed600640 1 -- 172.21.15.39:0/3662918226 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fcae8056600 con 0x7fcaf01488f0 2024-04-26T23:27:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 msgr2=0x7fcad006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 0x7fcad006a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000f70 tx=0x7fcae4009040 comp rx=0 tx=0).stop 2024-04-26T23:27:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 msgr2=0x7fcaf015f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcae800b9c0 tx=0x7fcae800be80 comp rx=0 tx=0).stop 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 shutdown_connections 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcad00683d0 0x7fcad006a890 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcaf01488f0 0x7fcaf015f110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcaf00cf940 0x7fcaf015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 --2- 172.21.15.39:0/3662918226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf006d2f0 0x7fcaf015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 >> 172.21.15.39:0/3662918226 conn(0x7fcaf00ce0e0 msgr2=0x7fcaf00b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 shutdown_connections 2024-04-26T23:27:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.088+0000 7fcaf8600640 1 -- 172.21.15.39:0/3662918226 wait complete. 2024-04-26T23:27:04.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T23:27:04.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 Processor -- start 2024-04-26T23:27:04.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 -- start start 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32680cf8c0 0x7f32680cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 0x7f326806d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f32680d10d0 0x7f32680d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f32680d01e0 con 0x7f32680cf8c0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f326806dfa0 con 0x7f32680d10d0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326f600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f326806e280 con 0x7f326806d4e0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32680cf8c0 0x7f32680cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32680cf8c0 0x7f32680cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42992/0 (socket says 172.21.15.39:42992) 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 -- 172.21.15.39:0/2387942089 learned_addr learned my addr 172.21.15.39:0/2387942089 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f3267e00640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 0x7f326806d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326d600640 1 --2- 172.21.15.39:0/2387942089 >> v2:172.21.15.71:3300/0 conn(0x7f32680d10d0 0x7f32680d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 -- 172.21.15.39:0/2387942089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 msgr2=0x7f326806d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:04.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 0x7f326806d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 -- 172.21.15.39:0/2387942089 >> v2:172.21.15.71:3300/0 conn(0x7f32680d10d0 msgr2=0x7f32680d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:04.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 --2- 172.21.15.39:0/2387942089 >> v2:172.21.15.71:3300/0 conn(0x7f32680d10d0 0x7f32680d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f326cc00640 1 -- 172.21.15.39:0/2387942089 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326806e560 con 0x7f32680cf8c0 2024-04-26T23:27:04.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.252+0000 7f3267e00640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 0x7f326806d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:04.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326cc00640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32680cf8c0 0x7f32680cfca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32680d2ba0 tx=0x7f325c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1076f2b3a09454ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f3267400640 1 -- 172.21.15.39:0/2387942089 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0aa610 con 0x7f32680cf8c0 2024-04-26T23:27:04.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f3267400640 1 -- 172.21.15.39:0/2387942089 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c0af070 con 0x7f32680cf8c0 2024-04-26T23:27:04.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f3267400640 1 -- 172.21.15.39:0/2387942089 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0aa9d0 con 0x7f32680cf8c0 2024-04-26T23:27:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 -- 172.21.15.39:0/2387942089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32680cf8c0 msgr2=0x7f32680cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32680cf8c0 0x7f32680cfca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32680d2ba0 tx=0x7f325c01c4f0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 -- 172.21.15.39:0/2387942089 shutdown_connections 2024-04-26T23:27:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 --2- 172.21.15.39:0/2387942089 >> v2:172.21.15.71:3300/0 conn(0x7f32680d10d0 0x7f32680d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f326806d4e0 0x7f326806d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 --2- 172.21.15.39:0/2387942089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32680cf8c0 0x7f32680cfca0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 -- 172.21.15.39:0/2387942089 >> 172.21.15.39:0/2387942089 conn(0x7f32680d3040 msgr2=0x7f32680d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 -- 172.21.15.39:0/2387942089 shutdown_connections 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.256+0000 7f326f600640 1 -- 172.21.15.39:0/2387942089 wait complete. 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 Processor -- start 2024-04-26T23:27:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- start start 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 0x7f32680afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32680d10d0 0x7f32680b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f326815f6f0 con 0x7f326806d4e0 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f326815f570 con 0x7f32680cf8c0 2024-04-26T23:27:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f326809b9e0 con 0x7f32680d10d0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43006/0 (socket says 172.21.15.39:43006) 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 -- 172.21.15.39:0/2213443754 learned_addr learned my addr 172.21.15.39:0/2213443754 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326d600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32680d10d0 0x7f32680b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f3267e00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 0x7f32680afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 -- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32680d10d0 msgr2=0x7f32680b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32680d10d0 0x7f32680b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 -- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 msgr2=0x7f32680afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 0x7f32680afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 -- 172.21.15.39:0/2213443754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326814f060 con 0x7f326806d4e0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f3267e00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 0x7f32680afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326cc00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f325c01aba0 tx=0x7f325c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0bd5f0 con 0x7f326806d4e0 2024-04-26T23:27:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c0bd790 con 0x7f326806d4e0 2024-04-26T23:27:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0bdb60 con 0x7f326806d4e0 2024-04-26T23:27:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f326814f300 con 0x7f326806d4e0 2024-04-26T23:27:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.260+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32680b1640 con 0x7f326806d4e0 2024-04-26T23:27:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f326814f820 con 0x7f326806d4e0 2024-04-26T23:27:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f325c0b33f0 con 0x7f326806d4e0 2024-04-26T23:27:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f3264c00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f325c120fd0 con 0x7f326806d4e0 2024-04-26T23:27:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f3267e00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.264+0000 7f3267e00640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 0x7f324806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32680b8580 tx=0x7f3254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.268+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f325c0a7070 con 0x7f326806d4e0 2024-04-26T23:27:04.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.488+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f32680b1460 con 0x7f326806d4e0 2024-04-26T23:27:04.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.492+0000 7f3264c00640 1 -- 172.21.15.39:0/2213443754 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f32680b1460 con 0x7f326806d4e0 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 msgr2=0x7f324806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 0x7f324806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32680b8580 tx=0x7f3254008040 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 msgr2=0x7f32681fb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f325c01aba0 tx=0x7f325c01ad30 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 shutdown_connections 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32680d10d0 0x7f32680b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32680cf8c0 0x7f32680afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 --2- 172.21.15.39:0/2213443754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f326806d4e0 0x7f32681fb250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 >> 172.21.15.39:0/2213443754 conn(0x7f32680d3040 msgr2=0x7f32680d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 shutdown_connections 2024-04-26T23:27:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.496+0000 7f326f600640 1 -- 172.21.15.39:0/2213443754 wait complete. 2024-04-26T23:27:04.520 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T23:27:04.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.656+0000 7efd26a00640 1 Processor -- start 2024-04-26T23:27:04.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.656+0000 7efd26a00640 1 -- start start 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd200d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd200b2820 con 0x7efd200b3e40 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd200b2b00 con 0x7efd200c5d70 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efd200b3430 con 0x7efd200b38c0 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd24c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efd200b3e40 0x7efd200cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51012/0 (socket says 172.21.15.39:51012) 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd24c00640 1 -- 172.21.15.39:0/2878211552 learned_addr learned my addr 172.21.15.39:0/2878211552 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd200d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605366155 0 0) 0x7efd200b2820 con 0x7efd200b3e40 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd08003530 con 0x7efd200b3e40 2024-04-26T23:27:04.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875648262 0 0) 0x7efd200b2b00 con 0x7efd200c5d70 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd200b2820 con 0x7efd200c5d70 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 918953526 0 0) 0x7efd08003530 con 0x7efd200b3e40 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 msgr2=0x7efd200d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd200d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 >> v1:172.21.15.71:6789/0 conn(0x7efd200c5d70 legacy=0x7efd200c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd200b2de0 con 0x7efd200b3e40 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7efd0c001680 con 0x7efd200b3e40 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd200d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 >> v1:172.21.15.39:6789/0 conn(0x7efd200b3e40 legacy=0x7efd200cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd08003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd080040c0 0x7efd08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd08004d50 0x7efd080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd200b3430 con 0x7efd08004d50 2024-04-26T23:27:04.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800ba80 con 0x7efd080040c0 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efd0800bc80 con 0x7efd200b38c0 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd08004d50 0x7efd080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd25600640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd08003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd24c00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd080040c0 0x7efd08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 -- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 msgr2=0x7efd08003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd08003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 -- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd080040c0 msgr2=0x7efd08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd080040c0 0x7efd08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd26000640 1 -- 172.21.15.39:0/2878211552 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd08003530 con 0x7efd08004d50 2024-04-26T23:27:04.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.660+0000 7efd25600640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd200b38c0 0x7efd08003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:04.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26000640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd08004d50 0x7efd080051d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd1800e350 tx=0x7efd1801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9205cd112dd9917 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18009dc0 con 0x7efd08004d50 2024-04-26T23:27:04.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd180a5e10 con 0x7efd08004d50 2024-04-26T23:27:04.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd1fe00640 1 -- 172.21.15.39:0/2878211552 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18003ba0 con 0x7efd08004d50 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- 172.21.15.39:0/2878211552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd08004d50 msgr2=0x7efd080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 --2- 172.21.15.39:0/2878211552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd08004d50 0x7efd080051d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd1800e350 tx=0x7efd1801ce00 comp rx=0 tx=0).stop 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26000640 1 -- 172.21.15.39:0/2878211552 reap_dead start 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- 172.21.15.39:0/2878211552 shutdown_connections 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- 172.21.15.39:0/2878211552 >> 172.21.15.39:0/2878211552 conn(0x7efd200d2da0 msgr2=0x7efd200d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- 172.21.15.39:0/2878211552 shutdown_connections 2024-04-26T23:27:04.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- 172.21.15.39:0/2878211552 wait complete. 2024-04-26T23:27:04.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 Processor -- start 2024-04-26T23:27:04.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.664+0000 7efd26a00640 1 -- start start 2024-04-26T23:27:04.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd08004d50 0x7efd200c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd200d11e0 0x7efd200c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd20163b90 con 0x7efd200c83b0 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd20163a10 con 0x7efd200d11e0 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efd200d38c0 con 0x7efd08004d50 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43020/0 (socket says 172.21.15.39:43020) 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 -- 172.21.15.39:0/1729131028 learned_addr learned my addr 172.21.15.39:0/1729131028 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd25600640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd08004d50 0x7efd200c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd24c00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd200d11e0 0x7efd200c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 -- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd08004d50 msgr2=0x7efd200c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd08004d50 0x7efd200c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 -- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd200d11e0 msgr2=0x7efd200c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd200d11e0 0x7efd200c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 -- 172.21.15.39:0/1729131028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd200b8560 con 0x7efd200c83b0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26000640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd1801cc30 tx=0x7efd18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18009dc0 con 0x7efd200c83b0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd18009a50 con 0x7efd200c83b0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd180a5c10 con 0x7efd200c83b0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd200c8d80 con 0x7efd200c83b0 2024-04-26T23:27:04.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd200d19c0 con 0x7efd200c83b0 2024-04-26T23:27:04.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd200506d0 con 0x7efd200c83b0 2024-04-26T23:27:04.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.668+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd180bf020 con 0x7efd200c83b0 2024-04-26T23:27:04.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.672+0000 7efd1d600640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 0x7efd0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:04.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.672+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7efd18120af0 con 0x7efd200c83b0 2024-04-26T23:27:04.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.672+0000 7efd25600640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 0x7efd0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:04.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.672+0000 7efd25600640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 0x7efd0006a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efd14007fd0 tx=0x7efd14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:04.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.676+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efd18016b10 con 0x7efd200c83b0 2024-04-26T23:27:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.896+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7efd200b0980 con 0x7efd200c83b0 2024-04-26T23:27:04.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.900+0000 7efd1d600640 1 -- 172.21.15.39:0/1729131028 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7efd180f0e30 con 0x7efd200c83b0 2024-04-26T23:27:04.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 msgr2=0x7efd0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 0x7efd0006a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efd14007fd0 tx=0x7efd14009040 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 msgr2=0x7efd200c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd1801cc30 tx=0x7efd18009750 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 shutdown_connections 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd000683b0 0x7efd0006a870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd200c83b0 0x7efd200c8840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd200d11e0 0x7efd200c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 --2- 172.21.15.39:0/1729131028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd08004d50 0x7efd200c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 >> 172.21.15.39:0/1729131028 conn(0x7efd200d2da0 msgr2=0x7efd200b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 shutdown_connections 2024-04-26T23:27:04.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:04.904+0000 7efd26a00640 1 -- 172.21.15.39:0/1729131028 wait complete. 2024-04-26T23:27:04.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T23:27:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.064+0000 7f3c63800640 1 Processor -- start 2024-04-26T23:27:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.064+0000 7f3c63800640 1 -- start start 2024-04-26T23:27:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c63800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3c5c1458d0 0x7f3c5c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c63800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 0x7f3c5c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c63800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5c072180 con 0x7f3c5c073400 2024-04-26T23:27:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c63800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c0739a0 con 0x7f3c5c1458d0 2024-04-26T23:27:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c63800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c073c80 con 0x7f3c5c0ce5e0 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3c5c1458d0 0x7f3c5c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3c5c1458d0 0x7f3c5c0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43030/0 (socket says 172.21.15.39:43030) 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 -- 172.21.15.39:0/4190854465 learned_addr learned my addr 172.21.15.39:0/4190854465 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c61800640 1 --2- 172.21.15.39:0/4190854465 >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 0x7f3c5c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 -- 172.21.15.39:0/4190854465 >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 msgr2=0x7f3c5c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 --2- 172.21.15.39:0/4190854465 >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 0x7f3c5c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 -- 172.21.15.39:0/4190854465 >> v1:172.21.15.71:6789/0 conn(0x7f3c5c073400 legacy=0x7f3c5c072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c60e00640 1 -- 172.21.15.39:0/4190854465 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c145cb0 con 0x7f3c5c1458d0 2024-04-26T23:27:05.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.068+0000 7f3c61800640 1 --2- 172.21.15.39:0/4190854465 >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 0x7f3c5c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c60e00640 1 --2- 172.21.15.39:0/4190854465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c0b4890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000bb10 tx=0x7f3c5001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3379ce803617c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c5b400640 1 -- 172.21.15.39:0/4190854465 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c500b4070 con 0x7f3c5c1458d0 2024-04-26T23:27:05.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c5b400640 1 -- 172.21.15.39:0/4190854465 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c500a7b00 con 0x7f3c5c1458d0 2024-04-26T23:27:05.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c5b400640 1 -- 172.21.15.39:0/4190854465 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c500af440 con 0x7f3c5c1458d0 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- 172.21.15.39:0/4190854465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 msgr2=0x7f3c5c0b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 --2- 172.21.15.39:0/4190854465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c0b4890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000bb10 tx=0x7f3c5001eb20 comp rx=0 tx=0).stop 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- 172.21.15.39:0/4190854465 shutdown_connections 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 --2- 172.21.15.39:0/4190854465 >> v2:172.21.15.71:3300/0 conn(0x7f3c5c0ce5e0 0x7f3c5c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 --2- 172.21.15.39:0/4190854465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c0b4890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- 172.21.15.39:0/4190854465 >> 172.21.15.39:0/4190854465 conn(0x7f3c5c06c7d0 msgr2=0x7f3c5c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- 172.21.15.39:0/4190854465 shutdown_connections 2024-04-26T23:27:05.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- 172.21.15.39:0/4190854465 wait complete. 2024-04-26T23:27:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 Processor -- start 2024-04-26T23:27:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 -- start start 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.072+0000 7f3c63800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 0x7f3c5c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5c0ce5e0 0x7f3c5c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c06ec70 con 0x7f3c5c1458d0 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c073230 con 0x7f3c5c0ce5e0 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c06edf0 con 0x7f3c5c073400 2024-04-26T23:27:05.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43042/0 (socket says 172.21.15.39:43042) 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 -- 172.21.15.39:0/545409368 learned_addr learned my addr 172.21.15.39:0/545409368 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c60e00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 0x7f3c5c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c5be00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5c0ce5e0 0x7f3c5c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 -- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 msgr2=0x7f3c5c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 0x7f3c5c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 -- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5c0ce5e0 msgr2=0x7f3c5c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5c0ce5e0 0x7f3c5c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 -- 172.21.15.39:0/545409368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c15dd20 con 0x7f3c5c1458d0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c60e00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 0x7f3c5c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c61800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400cf20 tx=0x7f3c5400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5401a070 con 0x7f3c5c1458d0 2024-04-26T23:27:05.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5400d840 con 0x7f3c5c1458d0 2024-04-26T23:27:05.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400dc30 con 0x7f3c5c1458d0 2024-04-26T23:27:05.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c15e000 con 0x7f3c5c1458d0 2024-04-26T23:27:05.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c15e5c0 con 0x7f3c5c1458d0 2024-04-26T23:27:05.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5c06a720 con 0x7f3c5c1458d0 2024-04-26T23:27:05.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c5401d070 con 0x7f3c5c1458d0 2024-04-26T23:27:05.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.076+0000 7f3c58c00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 0x7f3c3c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.080+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3c54086f50 con 0x7f3c5c1458d0 2024-04-26T23:27:05.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.080+0000 7f3c60e00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 0x7f3c3c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.080+0000 7f3c60e00640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 0x7f3c3c06a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c500b1000 tx=0x7f3c500a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.080+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3c540577c0 con 0x7f3c5c1458d0 2024-04-26T23:27:05.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.308+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3c5c0b1b40 con 0x7f3c5c1458d0 2024-04-26T23:27:05.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c58c00640 1 -- 172.21.15.39:0/545409368 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f3c540570c0 con 0x7f3c5c1458d0 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 msgr2=0x7f3c3c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 0x7f3c3c06a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c500b1000 tx=0x7f3c500a9070 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 msgr2=0x7f3c5c15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400cf20 tx=0x7f3c5400a7d0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 shutdown_connections 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3c3c0683b0 0x7f3c3c06a870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c5c1458d0 0x7f3c5c15edc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5c0ce5e0 0x7f3c5c15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 --2- 172.21.15.39:0/545409368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c5c073400 0x7f3c5c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 >> 172.21.15.39:0/545409368 conn(0x7f3c5c06c7d0 msgr2=0x7f3c5c0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 shutdown_connections 2024-04-26T23:27:05.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.312+0000 7f3c63800640 1 -- 172.21.15.39:0/545409368 wait complete. 2024-04-26T23:27:05.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T23:27:05.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.472+0000 7f456d200640 1 Processor -- start 2024-04-26T23:27:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.472+0000 7f456d200640 1 -- start start 2024-04-26T23:27:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f456d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f456d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4568070050 0x7f456806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f456d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45680684f0 con 0x7f456806d9d0 2024-04-26T23:27:05.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f456d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4568068790 con 0x7f4568070050 2024-04-26T23:27:05.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f456d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f456806c470 con 0x7f456806ea10 2024-04-26T23:27:05.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:39614/0 (socket says 172.21.15.39:39614) 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 -- 172.21.15.39:0/3841298607 learned_addr learned my addr 172.21.15.39:0/3841298607 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f455fe00640 1 --2- 172.21.15.39:0/3841298607 >> v2:172.21.15.71:3300/0 conn(0x7f4568070050 0x7f456806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 -- 172.21.15.39:0/3841298607 >> v2:172.21.15.71:3300/0 conn(0x7f4568070050 msgr2=0x7f456806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 --2- 172.21.15.39:0/3841298607 >> v2:172.21.15.71:3300/0 conn(0x7f4568070050 0x7f456806d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 -- 172.21.15.39:0/3841298607 >> v1:172.21.15.71:6789/0 conn(0x7f456806d9d0 legacy=0x7f456806edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.476+0000 7f4565e00640 1 -- 172.21.15.39:0/3841298607 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456806c750 con 0x7f456806ea10 2024-04-26T23:27:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f4565e00640 1 --2- 172.21.15.39:0/3841298607 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4558009870 tx=0x7f455801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19dba1915d2a84bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f4565400640 1 -- 172.21.15.39:0/3841298607 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580a9640 con 0x7f456806ea10 2024-04-26T23:27:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f4565400640 1 -- 172.21.15.39:0/3841298607 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45580a97e0 con 0x7f456806ea10 2024-04-26T23:27:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f4565400640 1 -- 172.21.15.39:0/3841298607 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580a9bb0 con 0x7f456806ea10 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- 172.21.15.39:0/3841298607 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 msgr2=0x7f456806cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 --2- 172.21.15.39:0/3841298607 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4558009870 tx=0x7f455801c560 comp rx=0 tx=0).stop 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- 172.21.15.39:0/3841298607 shutdown_connections 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 --2- 172.21.15.39:0/3841298607 >> v2:172.21.15.71:3300/0 conn(0x7f4568070050 0x7f456806d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 --2- 172.21.15.39:0/3841298607 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456806cf50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- 172.21.15.39:0/3841298607 >> 172.21.15.39:0/3841298607 conn(0x7f45680ce0e0 msgr2=0x7f45680ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- 172.21.15.39:0/3841298607 shutdown_connections 2024-04-26T23:27:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- 172.21.15.39:0/3841298607 wait complete. 2024-04-26T23:27:05.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 Processor -- start 2024-04-26T23:27:05.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.480+0000 7f456d200640 1 -- start start 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f456806d9d0 0x7f4568159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f456816a0d0 con 0x7f4568070050 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4568169f50 con 0x7f456806d9d0 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f456816a250 con 0x7f456806ea10 2024-04-26T23:27:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43058/0 (socket says 172.21.15.39:43058) 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 -- 172.21.15.39:0/2315753329 learned_addr learned my addr 172.21.15.39:0/2315753329 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f455fe00640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4565e00640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f456806d9d0 0x7f4568159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 -- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 msgr2=0x7f456815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 -- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f456806d9d0 msgr2=0x7f4568159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f456806d9d0 0x7f4568159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 -- 172.21.15.39:0/2315753329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45680c7ad0 con 0x7f4568070050 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f4566800640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f456000c730 tx=0x7f456000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560003b80 con 0x7f4568070050 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4560003d20 con 0x7f4568070050 2024-04-26T23:27:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456000aa30 con 0x7f4568070050 2024-04-26T23:27:05.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4568159cd0 con 0x7f4568070050 2024-04-26T23:27:05.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45680c7d40 con 0x7f4568070050 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456806a720 con 0x7f4568070050 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.484+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f456000abd0 con 0x7f4568070050 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.488+0000 7f455e000640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.488+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f45600863c0 con 0x7f4568070050 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.488+0000 7f4565e00640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.488+0000 7f4565e00640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 0x7f454406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45580ae000 tx=0x7f45580b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.492+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4560056670 con 0x7f4568070050 2024-04-26T23:27:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.712+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f45680b6e00 con 0x7f4568070050 2024-04-26T23:27:05.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f455e000640 1 -- 172.21.15.39:0/2315753329 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f456005a970 con 0x7f4568070050 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 msgr2=0x7f454406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 0x7f454406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45580ae000 tx=0x7f45580b3040 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 msgr2=0x7f456815ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f456000c730 tx=0x7f456000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 shutdown_connections 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4568070050 0x7f456815ca70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f456806ea10 0x7f456815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 --2- 172.21.15.39:0/2315753329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f456806d9d0 0x7f4568159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 >> 172.21.15.39:0/2315753329 conn(0x7f45680ce0e0 msgr2=0x7f45680b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 shutdown_connections 2024-04-26T23:27:05.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.716+0000 7f456d200640 1 -- 172.21.15.39:0/2315753329 wait complete. 2024-04-26T23:27:05.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:05.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 Processor -- start 2024-04-26T23:27:05.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 -- start start 2024-04-26T23:27:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c409c0f0 0x7f99c40b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99c40d1640 0x7f99c40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c409c7a0 con 0x7f99c415d170 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f99c40c6be0 con 0x7f99c40d1640 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.876+0000 7f99cae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40d1b70 con 0x7f99c409c0f0 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c3e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f99c415d170 0x7f99c409b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51026/0 (socket says 172.21.15.39:51026) 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c3e00640 1 -- 172.21.15.39:0/1157753556 learned_addr learned my addr 172.21.15.39:0/1157753556 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 --2- 172.21.15.39:0/1157753556 >> v2:172.21.15.39:3300/0 conn(0x7f99c40d1640 0x7f99c40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c3400640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c409c0f0 0x7f99c40b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c2a00640 1 -- 172.21.15.39:0/1157753556 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646049197 0 0) 0x7f99c409c7a0 con 0x7f99c415d170 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c2a00640 1 -- 172.21.15.39:0/1157753556 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a8003530 con 0x7f99c415d170 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 -- 172.21.15.39:0/1157753556 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c409c0f0 msgr2=0x7f99c40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c409c0f0 0x7f99c40b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 -- 172.21.15.39:0/1157753556 >> v1:172.21.15.39:6789/0 conn(0x7f99c415d170 legacy=0x7f99c409b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 -- 172.21.15.39:0/1157753556 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c40d1e50 con 0x7f99c40d1640 2024-04-26T23:27:05.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c8e00640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c40d1640 0x7f99c40c7630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d90 tx=0x7f99bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab4aeddedb9f978 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c2a00640 1 -- 172.21.15.39:0/1157753556 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0b2070 con 0x7f99c40d1640 2024-04-26T23:27:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c2a00640 1 -- 172.21.15.39:0/1157753556 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc0a5920 con 0x7f99c40d1640 2024-04-26T23:27:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.880+0000 7f99c2a00640 1 -- 172.21.15.39:0/1157753556 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0a5cf0 con 0x7f99c40d1640 2024-04-26T23:27:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- 172.21.15.39:0/1157753556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c40d1640 msgr2=0x7f99c40c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c40d1640 0x7f99c40c7630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d90 tx=0x7f99bc01c970 comp rx=0 tx=0).stop 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- 172.21.15.39:0/1157753556 shutdown_connections 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c40d1640 0x7f99c40c7630 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- 172.21.15.39:0/1157753556 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c409c0f0 0x7f99c40b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- 172.21.15.39:0/1157753556 >> 172.21.15.39:0/1157753556 conn(0x7f99c40b4b80 msgr2=0x7f99c40b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- 172.21.15.39:0/1157753556 shutdown_connections 2024-04-26T23:27:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- 172.21.15.39:0/1157753556 wait complete. 2024-04-26T23:27:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 Processor -- start 2024-04-26T23:27:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- start start 2024-04-26T23:27:05.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 0x7f99c415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c415d170 0x7f99c4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f99c40c8710 con 0x7f99c409c0f0 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99c40c8590 con 0x7f99c415d170 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99cae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40c8890 con 0x7f99c40d1640 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43080/0 (socket says 172.21.15.39:43080) 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 -- 172.21.15.39:0/269189086 learned_addr learned my addr 172.21.15.39:0/269189086 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c8e00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c415d170 0x7f99c4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3400640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 0x7f99c415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 -- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 msgr2=0x7f99c415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 0x7f99c415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 -- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c415d170 msgr2=0x7f99c4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c415d170 0x7f99c4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3e00640 1 -- 172.21.15.39:0/269189086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c415f160 con 0x7f99c409c0f0 2024-04-26T23:27:05.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.884+0000 7f99c3400640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 0x7f99c415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99c3e00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c3f0 tx=0x7f99b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4017070 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b4005cf0 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40072f0 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c415f440 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c415fa00 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c4050740 con 0x7f99c409c0f0 2024-04-26T23:27:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99b401a070 con 0x7f99c409c0f0 2024-04-26T23:27:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 0x7f99a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f99b4085af0 con 0x7f99c409c0f0 2024-04-26T23:27:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.888+0000 7f99c3400640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 0x7f99a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:05.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.892+0000 7f99c3400640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 0x7f99a406a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99c415bd30 tx=0x7f99b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:05.892+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f99b4056360 con 0x7f99c409c0f0 2024-04-26T23:27:06.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.060+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99c4072060 con 0x7f99c409c0f0 2024-04-26T23:27:06.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.060+0000 7f99bbe00640 1 -- 172.21.15.39:0/269189086 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12831 (secure 0 0 0) 0x7f99b4055c60 con 0x7f99c409c0f0 2024-04-26T23:27:06.067 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:06.067 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:02.875705+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:06.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 msgr2=0x7f99a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 0x7f99a406a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99c415bd30 tx=0x7f99b0008040 comp rx=0 tx=0).stop 2024-04-26T23:27:06.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 msgr2=0x7f99c41536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c3f0 tx=0x7f99b400c8b0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 shutdown_connections 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99a40683b0 0x7f99a406a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c415d170 0x7f99c4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f99c40d1640 0x7f99c415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 --2- 172.21.15.39:0/269189086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99c409c0f0 0x7f99c41536b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 >> 172.21.15.39:0/269189086 conn(0x7f99c40b4b80 msgr2=0x7f99c4071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 shutdown_connections 2024-04-26T23:27:06.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.064+0000 7f99cae00640 1 -- 172.21.15.39:0/269189086 wait complete. 2024-04-26T23:27:06.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:06.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:06.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.224+0000 7f4f68c00640 1 Processor -- start 2024-04-26T23:27:06.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 -- start start 2024-04-26T23:27:06.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f6415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f6415e340 0x7f4f640d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6406e500 con 0x7f4f64161850 2024-04-26T23:27:06.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6406f110 con 0x7f4f6415e340 2024-04-26T23:27:06.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f68c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6406e7e0 con 0x7f4f64140170 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f62800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4f64161850 0x7f4f64142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51040/0 (socket says 172.21.15.39:51040) 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f62800640 1 -- 172.21.15.39:0/569456691 learned_addr learned my addr 172.21.15.39:0/569456691 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f6415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f59400640 1 --2- 172.21.15.39:0/569456691 >> v2:172.21.15.71:3300/0 conn(0x7f4f6415e340 0x7f4f640d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916429239 0 0) 0x7f4f6406e500 con 0x7f4f64161850 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f48003530 con 0x7f4f64161850 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4273710492 0 0) 0x7f4f48003530 con 0x7f4f64161850 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 msgr2=0x7f4f6415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f6415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 >> v2:172.21.15.71:3300/0 conn(0x7f4f6415e340 msgr2=0x7f4f640d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 --2- 172.21.15.39:0/569456691 >> v2:172.21.15.71:3300/0 conn(0x7f4f6415e340 0x7f4f640d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6406eac0 con 0x7f4f64161850 2024-04-26T23:27:06.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f4f5c001a00 con 0x7f4f64161850 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f6415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f59400640 1 --2- 172.21.15.39:0/569456691 >> v2:172.21.15.71:3300/0 conn(0x7f4f6415e340 0x7f4f640d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 >> v1:172.21.15.39:6789/0 conn(0x7f4f64161850 legacy=0x7f4f64142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f480039c0 0x7f4f48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f48004d50 0x7f4f480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6406f110 con 0x7f4f480039c0 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6406e7e0 con 0x7f4f48004d50 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4800b9d0 con 0x7f4f64140170 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f480039c0 0x7f4f48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f59400640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f62800640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f48004d50 0x7f4f480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 -- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 msgr2=0x7f4f48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64140170 0x7f4f48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 -- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f48004d50 msgr2=0x7f4f480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f48004d50 0x7f4f480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f61e00640 1 -- 172.21.15.39:0/569456691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f48003530 con 0x7f4f480039c0 2024-04-26T23:27:06.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.228+0000 7f4f62800640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f48004d50 0x7f4f480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f61e00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f480039c0 0x7f4f48003de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009cb0 tx=0x7f4f5401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdbe70574cbf9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f540b2070 con 0x7f4f480039c0 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f540a5790 con 0x7f4f480039c0 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f61400640 1 -- 172.21.15.39:0/569456691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54009880 con 0x7f4f480039c0 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 -- 172.21.15.39:0/569456691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f480039c0 msgr2=0x7f4f48003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 --2- 172.21.15.39:0/569456691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f480039c0 0x7f4f48003de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009cb0 tx=0x7f4f5401cb80 comp rx=0 tx=0).stop 2024-04-26T23:27:06.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f62800640 1 -- 172.21.15.39:0/569456691 reap_dead start 2024-04-26T23:27:06.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 -- 172.21.15.39:0/569456691 shutdown_connections 2024-04-26T23:27:06.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 -- 172.21.15.39:0/569456691 >> 172.21.15.39:0/569456691 conn(0x7f4f6406c7d0 msgr2=0x7f4f6406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 -- 172.21.15.39:0/569456691 shutdown_connections 2024-04-26T23:27:06.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.232+0000 7f4f68c00640 1 -- 172.21.15.39:0/569456691 wait complete. 2024-04-26T23:27:06.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 Processor -- start 2024-04-26T23:27:06.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- start start 2024-04-26T23:27:06.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f480039c0 0x7f4f640b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 0x7f4f64153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640d1ab0 con 0x7f4f64072a20 2024-04-26T23:27:06.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640d1930 con 0x7f4f480039c0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4f64167fa0 con 0x7f4f64152eb0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43100/0 (socket says 172.21.15.39:43100) 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 -- 172.21.15.39:0/4081717807 learned_addr learned my addr 172.21.15.39:0/4081717807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f61e00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f480039c0 0x7f4f640b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f62800640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 0x7f4f64153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 -- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 msgr2=0x7f4f64153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 0x7f4f64153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 -- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f480039c0 msgr2=0x7f4f640b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f480039c0 0x7f4f640b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 -- 172.21.15.39:0/4081717807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64153870 con 0x7f4f64072a20 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f62800640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 0x7f4f64153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f59400640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c011d00 tx=0x7f4f4c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00fd20 con 0x7f4f64072a20 2024-04-26T23:27:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c004030 con 0x7f4f64072a20 2024-04-26T23:27:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c004400 con 0x7f4f64072a20 2024-04-26T23:27:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f640734a0 con 0x7f4f64072a20 2024-04-26T23:27:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.236+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f64073a60 con 0x7f4f64072a20 2024-04-26T23:27:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6406a720 con 0x7f4f64072a20 2024-04-26T23:27:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f4c012040 con 0x7f4f64072a20 2024-04-26T23:27:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f5aa00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 0x7f4f4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f4f4c086ba0 con 0x7f4f64072a20 2024-04-26T23:27:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f61e00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 0x7f4f4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.240+0000 7f4f61e00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 0x7f4f4006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f540af000 tx=0x7f4f540046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.244+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f4c019070 con 0x7f4f64072a20 2024-04-26T23:27:06.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.408+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f6406fdc0 con 0x7f4f64072a20 2024-04-26T23:27:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.408+0000 7f4f5aa00640 1 -- 172.21.15.39:0/4081717807 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f4f4c056d30 con 0x7f4f64072a20 2024-04-26T23:27:06.416 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:06.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 msgr2=0x7f4f4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 0x7f4f4006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f540af000 tx=0x7f4f540046d0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 msgr2=0x7f4f64072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c011d00 tx=0x7f4f4c00f610 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 shutdown_connections 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4f40068380 0x7f4f4006a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f64152eb0 0x7f4f64153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f64072a20 0x7f4f64072e80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 --2- 172.21.15.39:0/4081717807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f480039c0 0x7f4f640b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 >> 172.21.15.39:0/4081717807 conn(0x7f4f6406c7d0 msgr2=0x7f4f6406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 shutdown_connections 2024-04-26T23:27:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.412+0000 7f4f68c00640 1 -- 172.21.15.39:0/4081717807 wait complete. 2024-04-26T23:27:06.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:27:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 Processor -- start 2024-04-26T23:27:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 -- start start 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01ac0cd810 0x7f01ac0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 0x7f01ac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ac0d0550 con 0x7f01ac0cfe00 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f01ac0d0b10 con 0x7f01ac0cd810 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b3a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f01ac06e970 con 0x7f01ac0cdbf0 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.572+0000 7f01b1000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01ac0cd810 0x7f01ac0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f01ac0cd810 0x7f01ac0742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43104/0 (socket says 172.21.15.39:43104) 2024-04-26T23:27:06.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 -- 172.21.15.39:0/2401957157 learned_addr learned my addr 172.21.15.39:0/2401957157 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 -- 172.21.15.39:0/2401957157 >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 msgr2=0x7f01ac06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1a00640 1 --2- 172.21.15.39:0/2401957157 >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 0x7f01ac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 --2- 172.21.15.39:0/2401957157 >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 0x7f01ac06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 -- 172.21.15.39:0/2401957157 >> v1:172.21.15.71:6789/0 conn(0x7f01ac0cfe00 legacy=0x7f01ac144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 -- 172.21.15.39:0/2401957157 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac0d0830 con 0x7f01ac0cd810 2024-04-26T23:27:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1a00640 1 --2- 172.21.15.39:0/2401957157 >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 0x7f01ac06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01b1000640 1 --2- 172.21.15.39:0/2401957157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac0742f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0719c0 tx=0x7f019c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522aed14b7bba1f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01abe00640 1 -- 172.21.15.39:0/2401957157 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0b0070 con 0x7f01ac0cd810 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01abe00640 1 -- 172.21.15.39:0/2401957157 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0ab600 con 0x7f01ac0cd810 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.576+0000 7f01abe00640 1 -- 172.21.15.39:0/2401957157 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0ab9d0 con 0x7f01ac0cd810 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- 172.21.15.39:0/2401957157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 msgr2=0x7f01ac0742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- 172.21.15.39:0/2401957157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac0742f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0719c0 tx=0x7f019c01c390 comp rx=0 tx=0).stop 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- 172.21.15.39:0/2401957157 shutdown_connections 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- 172.21.15.39:0/2401957157 >> v2:172.21.15.71:3300/0 conn(0x7f01ac0cdbf0 0x7f01ac06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- 172.21.15.39:0/2401957157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac0742f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- 172.21.15.39:0/2401957157 >> 172.21.15.39:0/2401957157 conn(0x7f01ac0b2af0 msgr2=0x7f01ac0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- 172.21.15.39:0/2401957157 shutdown_connections 2024-04-26T23:27:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- 172.21.15.39:0/2401957157 wait complete. 2024-04-26T23:27:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 Processor -- start 2024-04-26T23:27:06.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- start start 2024-04-26T23:27:06.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ac0cdbf0 0x7f01ac15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01ac0cfe00 0x7f01ac15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac143d30 con 0x7f01ac0cd810 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac143bb0 con 0x7f01ac0cdbf0 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b3a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f01ac169ef0 con 0x7f01ac0cfe00 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01a3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ac0cdbf0 0x7f01ac15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43120/0 (socket says 172.21.15.39:43120) 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 -- 172.21.15.39:0/481924869 learned_addr learned my addr 172.21.15.39:0/481924869 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01ac0cfe00 0x7f01ac15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 -- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01ac0cfe00 msgr2=0x7f01ac15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01ac0cfe00 0x7f01ac15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 -- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ac0cdbf0 msgr2=0x7f01ac15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ac0cdbf0 0x7f01ac15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 -- 172.21.15.39:0/481924869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac0b42d0 con 0x7f01ac0cd810 2024-04-26T23:27:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.580+0000 7f01b1000640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ae040 tx=0x7f019c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0b0040 con 0x7f01ac0cd810 2024-04-26T23:27:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0b9070 con 0x7f01ac0cd810 2024-04-26T23:27:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0b48a0 con 0x7f01ac0cd810 2024-04-26T23:27:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ac0b4610 con 0x7f01ac0cd810 2024-04-26T23:27:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ac0b4e50 con 0x7f01ac0cd810 2024-04-26T23:27:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ac050740 con 0x7f01ac0cd810 2024-04-26T23:27:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f019c0ab4c0 con 0x7f01ac0cd810 2024-04-26T23:27:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 0x7f018806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f019c120210 con 0x7f01ac0cd810 2024-04-26T23:27:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.584+0000 7f01a3e00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 0x7f018806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.588+0000 7f01a3e00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 0x7f018806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01ac158800 tx=0x7f0194009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.588+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01ac0b4610 con 0x7f01ac0cd810 2024-04-26T23:27:06.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f01ac0b1020 con 0x7f01ac0cd810 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01a9600640 1 -- 172.21.15.39:0/481924869 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f019c0160d0 con 0x7f01ac0cd810 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:06.762 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 msgr2=0x7f018806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 0x7f018806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01ac158800 tx=0x7f0194009060 comp rx=0 tx=0).stop 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 msgr2=0x7f01ac1565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ae040 tx=0x7f019c019130 comp rx=0 tx=0).stop 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 shutdown_connections 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0188068380 0x7f018806a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01ac0cfe00 0x7f01ac15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ac0cdbf0 0x7f01ac15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 --2- 172.21.15.39:0/481924869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01ac0cd810 0x7f01ac1565f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 >> 172.21.15.39:0/481924869 conn(0x7f01ac0b2af0 msgr2=0x7f01ac0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 shutdown_connections 2024-04-26T23:27:06.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.756+0000 7f01b3a00640 1 -- 172.21.15.39:0/481924869 wait complete. 2024-04-26T23:27:06.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:27:06.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:27:06.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 Processor -- start 2024-04-26T23:27:06.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 -- start start 2024-04-26T23:27:06.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc4c8145870 0x7fc4c80cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c81608b0 con 0x7fc4c806f4d0 2024-04-26T23:27:06.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c806fdd0 con 0x7fc4c806f960 2024-04-26T23:27:06.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4cda00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c8073d00 con 0x7fc4c8145870 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4c6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc4c8145870 0x7fc4c80cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4bfe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc4c806f4d0 0x7fc4c815fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51044/0 (socket says 172.21.15.39:51044) 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4bfe00640 1 -- 172.21.15.39:0/1356130285 learned_addr learned my addr 172.21.15.39:0/1356130285 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4c6a00640 1 -- 172.21.15.39:0/1356130285 >> v1:172.21.15.71:6789/0 conn(0x7fc4c806f960 legacy=0x7fc4c81601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4c6a00640 1 -- 172.21.15.39:0/1356130285 >> v1:172.21.15.39:6789/0 conn(0x7fc4c806f4d0 legacy=0x7fc4c815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.924+0000 7fc4c6a00640 1 -- 172.21.15.39:0/1356130285 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c80cfd30 con 0x7fc4c8145870 2024-04-26T23:27:06.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4c6a00640 1 --2- 172.21.15.39:0/1356130285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c8145870 0x7fc4c80cf300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c60475ab8b752 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4c6000640 1 -- 172.21.15.39:0/1356130285 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ab660 con 0x7fc4c8145870 2024-04-26T23:27:06.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4c6000640 1 -- 172.21.15.39:0/1356130285 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80b0070 con 0x7fc4c8145870 2024-04-26T23:27:06.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4c6000640 1 -- 172.21.15.39:0/1356130285 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80aba20 con 0x7fc4c8145870 2024-04-26T23:27:06.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 -- 172.21.15.39:0/1356130285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c8145870 msgr2=0x7fc4c80cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 --2- 172.21.15.39:0/1356130285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c8145870 0x7fc4c80cf300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c460 comp rx=0 tx=0).stop 2024-04-26T23:27:06.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 -- 172.21.15.39:0/1356130285 shutdown_connections 2024-04-26T23:27:06.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 --2- 172.21.15.39:0/1356130285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c8145870 0x7fc4c80cf300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 -- 172.21.15.39:0/1356130285 >> 172.21.15.39:0/1356130285 conn(0x7fc4c80b2cc0 msgr2=0x7fc4c80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:06.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 -- 172.21.15.39:0/1356130285 shutdown_connections 2024-04-26T23:27:06.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 -- 172.21.15.39:0/1356130285 wait complete. 2024-04-26T23:27:06.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.928+0000 7fc4cda00640 1 Processor -- start 2024-04-26T23:27:06.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- start start 2024-04-26T23:27:06.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c806f4d0 0x7fc4c8137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4c8145870 0x7fc4c813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8145dd0 con 0x7fc4c806f960 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8145c50 con 0x7fc4c806f4d0 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c80cf840 con 0x7fc4c8145870 2024-04-26T23:27:06.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43134/0 (socket says 172.21.15.39:43134) 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 -- 172.21.15.39:0/3059426747 learned_addr learned my addr 172.21.15.39:0/3059426747 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4c6a00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c806f4d0 0x7fc4c8137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4c7400640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4c8145870 0x7fc4c813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 -- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4c8145870 msgr2=0x7fc4c813da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4c8145870 0x7fc4c813da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 -- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c806f4d0 msgr2=0x7fc4c8137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:06.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c806f4d0 0x7fc4c8137b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:06.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 -- 172.21.15.39:0/3059426747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c80b16b0 con 0x7fc4c806f960 2024-04-26T23:27:06.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bfe00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c420 tx=0x7fc4b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0017070 con 0x7fc4c806f960 2024-04-26T23:27:06.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0005cf0 con 0x7fc4c806f960 2024-04-26T23:27:06.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00072f0 con 0x7fc4c806f960 2024-04-26T23:27:06.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c8157710 con 0x7fc4c806f960 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c8157cd0 con 0x7fc4c806f960 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.932+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c8157ed0 con 0x7fc4c806f960 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.936+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4b001a070 con 0x7fc4c806f960 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.936+0000 7fc4bea00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 0x7fc4a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.936+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc4b0085980 con 0x7fc4c806f960 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.936+0000 7fc4c6a00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 0x7fc4a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:06.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.936+0000 7fc4c6a00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 0x7fc4a406a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80af000 tx=0x7fc4b80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:06.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:06.940+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc4c8157ed0 con 0x7fc4c806f960 2024-04-26T23:27:07.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.104+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc4c8050740 con 0x7fc4c806f960 2024-04-26T23:27:07.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.884+0000 7fc4bea00640 1 -- 172.21.15.39:0/3059426747 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7fc4b0055c30 con 0x7fc4c806f960 2024-04-26T23:27:07.891 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-04-26T23:27:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 msgr2=0x7fc4a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 0x7fc4a406a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80af000 tx=0x7fc4b80a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 msgr2=0x7fc4c813d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c420 tx=0x7fc4b000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:27:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 shutdown_connections 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc4a4068380 0x7fc4a406a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4c8145870 0x7fc4c813da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4c806f960 0x7fc4c813d540 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 --2- 172.21.15.39:0/3059426747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c806f4d0 0x7fc4c8137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 >> 172.21.15.39:0/3059426747 conn(0x7fc4c80b2cc0 msgr2=0x7fc4c815c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 shutdown_connections 2024-04-26T23:27:07.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:07.888+0000 7fc4cda00640 1 -- 172.21.15.39:0/3059426747 wait complete. 2024-04-26T23:27:07.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:27:08.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 Processor -- start 2024-04-26T23:27:08.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 -- start start 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc68073400 0x7efc68072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efc68072e50 0x7efc680ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc68072180 con 0x7efc681458d0 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efc680739a0 con 0x7efc68073400 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc70600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7efc68073c80 con 0x7efc68072e50 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc6d200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc68073400 0x7efc68072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc6d200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc68073400 0x7efc68072910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43144/0 (socket says 172.21.15.39:43144) 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc6d200640 1 -- 172.21.15.39:0/116050842 learned_addr learned my addr 172.21.15.39:0/116050842 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.072+0000 7efc6e600640 1 --2- 172.21.15.39:0/116050842 >> v2:172.21.15.71:3300/0 conn(0x7efc68072e50 0x7efc680ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc6d200640 1 -- 172.21.15.39:0/116050842 >> v2:172.21.15.71:3300/0 conn(0x7efc68072e50 msgr2=0x7efc680ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:08.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc6d200640 1 --2- 172.21.15.39:0/116050842 >> v2:172.21.15.71:3300/0 conn(0x7efc68072e50 0x7efc680ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc6d200640 1 -- 172.21.15.39:0/116050842 >> v1:172.21.15.71:6789/0 conn(0x7efc681458d0 legacy=0x7efc680b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc6d200640 1 -- 172.21.15.39:0/116050842 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc68145cb0 con 0x7efc68073400 2024-04-26T23:27:08.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc6d200640 1 --2- 172.21.15.39:0/116050842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc68073400 0x7efc68072910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efc54009870 tx=0x7efc5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac761bc4ca5c5264 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:08.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc67e00640 1 -- 172.21.15.39:0/116050842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540b1070 con 0x7efc68073400 2024-04-26T23:27:08.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc67e00640 1 -- 172.21.15.39:0/116050842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc540ac600 con 0x7efc68073400 2024-04-26T23:27:08.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc67e00640 1 -- 172.21.15.39:0/116050842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540ac9d0 con 0x7efc68073400 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 -- 172.21.15.39:0/116050842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc68073400 msgr2=0x7efc68072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 --2- 172.21.15.39:0/116050842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc68073400 0x7efc68072910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efc54009870 tx=0x7efc5401c490 comp rx=0 tx=0).stop 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 -- 172.21.15.39:0/116050842 shutdown_connections 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 --2- 172.21.15.39:0/116050842 >> v2:172.21.15.71:3300/0 conn(0x7efc68072e50 0x7efc680ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 --2- 172.21.15.39:0/116050842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc68073400 0x7efc68072910 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 -- 172.21.15.39:0/116050842 >> 172.21.15.39:0/116050842 conn(0x7efc6806c7d0 msgr2=0x7efc6806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.076+0000 7efc70600640 1 -- 172.21.15.39:0/116050842 shutdown_connections 2024-04-26T23:27:08.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- 172.21.15.39:0/116050842 wait complete. 2024-04-26T23:27:08.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 Processor -- start 2024-04-26T23:27:08.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- start start 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc68072e50 0x7efc6813b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc68073400 0x7efc681690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc68167950 con 0x7efc681458d0 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc68073260 con 0x7efc68072e50 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efc68167ad0 con 0x7efc68073400 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc68072e50 0x7efc6813b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43152/0 (socket says 172.21.15.39:43152) 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 -- 172.21.15.39:0/2228112451 learned_addr learned my addr 172.21.15.39:0/2228112451 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6d200640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc68073400 0x7efc681690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 -- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc68073400 msgr2=0x7efc681690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc68073400 0x7efc681690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 -- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc68072e50 msgr2=0x7efc6813b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc68072e50 0x7efc6813b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 -- 172.21.15.39:0/2228112451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc68140e50 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc6e600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc60007e40 tx=0x7efc6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60014620 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60019070 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60014a20 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc68141130 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.080+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc681416f0 con 0x7efc681458d0 2024-04-26T23:27:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.084+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6806a720 con 0x7efc681458d0 2024-04-26T23:27:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.084+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc60014bc0 con 0x7efc681458d0 2024-04-26T23:27:08.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.084+0000 7efc65600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:08.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.084+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7efc60086fe0 con 0x7efc681458d0 2024-04-26T23:27:08.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.084+0000 7efc6dc00640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:08.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.088+0000 7efc6dc00640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 0x7efc4806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007fd0 tx=0x7efc5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:08.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.092+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc60057090 con 0x7efc681458d0 2024-04-26T23:27:08.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.256+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc680b50b0 con 0x7efc681458d0 2024-04-26T23:27:08.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:27:08.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:27:08.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.888+0000 7efc65600640 1 -- 172.21.15.39:0/2228112451 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7efc6005b390 con 0x7efc681458d0 2024-04-26T23:27:08.895 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-04-26T23:27:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 msgr2=0x7efc4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 0x7efc4806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007fd0 tx=0x7efc5c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 msgr2=0x7efc681695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc60007e40 tx=0x7efc6000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 shutdown_connections 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc681458d0 0x7efc681695e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc68073400 0x7efc681690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 --2- 172.21.15.39:0/2228112451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc68072e50 0x7efc6813b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 >> 172.21.15.39:0/2228112451 conn(0x7efc6806c7d0 msgr2=0x7efc6806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 shutdown_connections 2024-04-26T23:27:08.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:08.892+0000 7efc70600640 1 -- 172.21.15.39:0/2228112451 wait complete. 2024-04-26T23:27:08.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:27:09.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 Processor -- start 2024-04-26T23:27:09.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 -- start start 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb50161850 0x7fcb500d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 0x7fcb500cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb5006e500 con 0x7fcb50140170 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5006f110 con 0x7fcb50161850 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb57400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5006e7e0 con 0x7fcb500d1720 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb50161850 0x7fcb500d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb50161850 0x7fcb500d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43164/0 (socket says 172.21.15.39:43164) 2024-04-26T23:27:09.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 -- 172.21.15.39:0/716984539 learned_addr learned my addr 172.21.15.39:0/716984539 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb55400640 1 --2- 172.21.15.39:0/716984539 >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 0x7fcb500cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 -- 172.21.15.39:0/716984539 >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 msgr2=0x7fcb500cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 --2- 172.21.15.39:0/716984539 >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 0x7fcb500cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 -- 172.21.15.39:0/716984539 >> v1:172.21.15.71:6789/0 conn(0x7fcb50140170 legacy=0x7fcb5015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb4fe00640 1 -- 172.21.15.39:0/716984539 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5006eac0 con 0x7fcb50161850 2024-04-26T23:27:09.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.076+0000 7fcb55400640 1 --2- 172.21.15.39:0/716984539 >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 0x7fcb500cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:09.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb4fe00640 1 --2- 172.21.15.39:0/716984539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb500d11e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcb50074570 tx=0x7fcb3c01ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a556ec7a4625800d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:09.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb4f400640 1 -- 172.21.15.39:0/716984539 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b2070 con 0x7fcb50161850 2024-04-26T23:27:09.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb4f400640 1 -- 172.21.15.39:0/716984539 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0a9070 con 0x7fcb50161850 2024-04-26T23:27:09.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb4f400640 1 -- 172.21.15.39:0/716984539 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0ad880 con 0x7fcb50161850 2024-04-26T23:27:09.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- 172.21.15.39:0/716984539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 msgr2=0x7fcb500d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 --2- 172.21.15.39:0/716984539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb500d11e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcb50074570 tx=0x7fcb3c01ce70 comp rx=0 tx=0).stop 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- 172.21.15.39:0/716984539 shutdown_connections 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 --2- 172.21.15.39:0/716984539 >> v2:172.21.15.71:3300/0 conn(0x7fcb500d1720 0x7fcb500cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 --2- 172.21.15.39:0/716984539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb500d11e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- 172.21.15.39:0/716984539 >> 172.21.15.39:0/716984539 conn(0x7fcb5006c7d0 msgr2=0x7fcb5006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- 172.21.15.39:0/716984539 shutdown_connections 2024-04-26T23:27:09.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- 172.21.15.39:0/716984539 wait complete. 2024-04-26T23:27:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 Processor -- start 2024-04-26T23:27:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.080+0000 7fcb57400640 1 -- start start 2024-04-26T23:27:09.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb500d1720 0x7fcb50153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 0x7fcb50161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500d07d0 con 0x7fcb50161850 2024-04-26T23:27:09.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500d0650 con 0x7fcb500d1720 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb500d0950 con 0x7fcb50140170 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43174/0 (socket says 172.21.15.39:43174) 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 -- 172.21.15.39:0/2144324916 learned_addr learned my addr 172.21.15.39:0/2144324916 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb54a00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb500d1720 0x7fcb50153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb4fe00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 0x7fcb50161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 -- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 msgr2=0x7fcb50161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 0x7fcb50161c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 -- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb500d1720 msgr2=0x7fcb50153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb500d1720 0x7fcb50153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 -- 172.21.15.39:0/2144324916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb501621a0 con 0x7fcb50161850 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb4fe00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 0x7fcb50161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb55400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800cef0 tx=0x7fcb4800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4801a070 con 0x7fcb50161850 2024-04-26T23:27:09.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4800d860 con 0x7fcb50161850 2024-04-26T23:27:09.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800dc50 con 0x7fcb50161850 2024-04-26T23:27:09.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb50162440 con 0x7fcb50161850 2024-04-26T23:27:09.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb50141ab0 con 0x7fcb50161850 2024-04-26T23:27:09.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.084+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5006a720 con 0x7fcb50161850 2024-04-26T23:27:09.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.088+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb4801d070 con 0x7fcb50161850 2024-04-26T23:27:09.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.088+0000 7fcb4cc00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 0x7fcb3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:09.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.088+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fcb480872a0 con 0x7fcb50161850 2024-04-26T23:27:09.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.088+0000 7fcb54a00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 0x7fcb3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:09.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.088+0000 7fcb54a00640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 0x7fcb3006a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007fd0 tx=0x7fcb44007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:09.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.092+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb48057200 con 0x7fcb50161850 2024-04-26T23:27:09.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.292+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcb500cf780 con 0x7fcb50161850 2024-04-26T23:27:09.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.912+0000 7fcb4cc00640 1 -- 172.21.15.39:0/2144324916 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fcb4805b500 con 0x7fcb50161850 2024-04-26T23:27:09.927 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T23:27:09.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 msgr2=0x7fcb3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:09.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 0x7fcb3006a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007fd0 tx=0x7fcb44007e40 comp rx=0 tx=0).stop 2024-04-26T23:27:09.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 msgr2=0x7fcb501422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:09.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800cef0 tx=0x7fcb4800a710 comp rx=0 tx=0).stop 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 shutdown_connections 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb30068380 0x7fcb3006a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb50161850 0x7fcb501422b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb50140170 0x7fcb50161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 --2- 172.21.15.39:0/2144324916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb500d1720 0x7fcb50153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:09.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.932+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 >> 172.21.15.39:0/2144324916 conn(0x7fcb5006c7d0 msgr2=0x7fcb500b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:09.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.936+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 shutdown_connections 2024-04-26T23:27:09.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:09.940+0000 7fcb57400640 1 -- 172.21.15.39:0/2144324916 wait complete. 2024-04-26T23:27:09.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 Processor -- start 2024-04-26T23:27:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 -- start start 2024-04-26T23:27:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9d40d1580 0x7fc9d40d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc9d40d0be0 0x7fc9d40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d40ceed0 con 0x7fc9d409b9e0 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d40ce630 con 0x7fc9d40d0be0 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9dba00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d40ce910 con 0x7fc9d40d1580 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc9d40d0be0 0x7fc9d40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc9d40d0be0 0x7fc9d40d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33074/0 (socket says 172.21.15.39:33074) 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 -- 172.21.15.39:0/4174976077 learned_addr learned my addr 172.21.15.39:0/4174976077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9d9000640 1 --2- 172.21.15.39:0/4174976077 >> v2:172.21.15.71:3300/0 conn(0x7fc9d40d1580 0x7fc9d40d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 -- 172.21.15.39:0/4174976077 >> v2:172.21.15.71:3300/0 conn(0x7fc9d40d1580 msgr2=0x7fc9d40d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 --2- 172.21.15.39:0/4174976077 >> v2:172.21.15.71:3300/0 conn(0x7fc9d40d1580 0x7fc9d40d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 -- 172.21.15.39:0/4174976077 >> v1:172.21.15.71:6789/0 conn(0x7fc9d409b9e0 legacy=0x7fc9d409be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.112+0000 7fc9cbe00640 1 -- 172.21.15.39:0/4174976077 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d40cebf0 con 0x7fc9d40d0be0 2024-04-26T23:27:10.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9cbe00640 1 --2- 172.21.15.39:0/4174976077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d0be0 0x7fc9d40d1020 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40737f0 tx=0x7fc9bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7becce82005b2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9d3e00640 1 -- 172.21.15.39:0/4174976077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0ab610 con 0x7fc9d40d0be0 2024-04-26T23:27:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9d3e00640 1 -- 172.21.15.39:0/4174976077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc0b0070 con 0x7fc9d40d0be0 2024-04-26T23:27:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9d3e00640 1 -- 172.21.15.39:0/4174976077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0ab9d0 con 0x7fc9d40d0be0 2024-04-26T23:27:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 -- 172.21.15.39:0/4174976077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d0be0 msgr2=0x7fc9d40d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 --2- 172.21.15.39:0/4174976077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d0be0 0x7fc9d40d1020 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40737f0 tx=0x7fc9bc01c520 comp rx=0 tx=0).stop 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 -- 172.21.15.39:0/4174976077 shutdown_connections 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 --2- 172.21.15.39:0/4174976077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d0be0 0x7fc9d40d1020 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 --2- 172.21.15.39:0/4174976077 >> v2:172.21.15.71:3300/0 conn(0x7fc9d40d1580 0x7fc9d40d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 -- 172.21.15.39:0/4174976077 >> 172.21.15.39:0/4174976077 conn(0x7fc9d40b4b00 msgr2=0x7fc9d40b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 -- 172.21.15.39:0/4174976077 shutdown_connections 2024-04-26T23:27:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.116+0000 7fc9dba00640 1 -- 172.21.15.39:0/4174976077 wait complete. 2024-04-26T23:27:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 Processor -- start 2024-04-26T23:27:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- start start 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9d409b9e0 0x7fc9d415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d40d0be0 0x7fc9d414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d415d6c0 con 0x7fc9d40d1580 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d415d540 con 0x7fc9d40d0be0 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d416a650 con 0x7fc9d409b9e0 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33084/0 (socket says 172.21.15.39:33084) 2024-04-26T23:27:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 -- 172.21.15.39:0/1183961184 learned_addr learned my addr 172.21.15.39:0/1183961184 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9000640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9d409b9e0 0x7fc9d415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9cbe00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d40d0be0 0x7fc9d414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 -- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9d409b9e0 msgr2=0x7fc9d415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9d409b9e0 0x7fc9d415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 -- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d40d0be0 msgr2=0x7fc9d414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d40d0be0 0x7fc9d414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 -- 172.21.15.39:0/1183961184 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d414ffd0 con 0x7fc9d40d1580 2024-04-26T23:27:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d9a00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00c730 tx=0x7fc9cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc003b80 con 0x7fc9d40d1580 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc003d20 con 0x7fc9d40d1580 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d41502b0 con 0x7fc9d40d1580 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00aa30 con 0x7fc9d40d1580 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d4151520 con 0x7fc9d40d1580 2024-04-26T23:27:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.120+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d4050740 con 0x7fc9d40d1580 2024-04-26T23:27:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.124+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9cc00abd0 con 0x7fc9d40d1580 2024-04-26T23:27:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.124+0000 7fc9d1600640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 0x7fc9b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.124+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc9cc0865c0 con 0x7fc9d40d1580 2024-04-26T23:27:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.124+0000 7fc9d9000640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 0x7fc9b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.124+0000 7fc9d9000640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 0x7fc9b006a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40a1010 tx=0x7fc9c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.128+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc9cc0566a0 con 0x7fc9d40d1580 2024-04-26T23:27:10.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.292+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9d4150480 con 0x7fc9d40d1580 2024-04-26T23:27:10.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.292+0000 7fc9d1600640 1 -- 172.21.15.39:0/1183961184 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16622 (secure 0 0 0) 0x7fc9cc05a9a0 con 0x7fc9d40d1580 2024-04-26T23:27:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:10.299 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:09.296961+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:10.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 msgr2=0x7fc9b006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 0x7fc9b006a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40a1010 tx=0x7fc9c4008040 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 msgr2=0x7fc9d415fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00c730 tx=0x7fc9cc00cbf0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 shutdown_connections 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9b00683d0 0x7fc9b006a890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9d40d1580 0x7fc9d415fcd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d40d0be0 0x7fc9d414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 --2- 172.21.15.39:0/1183961184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9d409b9e0 0x7fc9d415c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 >> 172.21.15.39:0/1183961184 conn(0x7fc9d40b4b00 msgr2=0x7fc9d40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 shutdown_connections 2024-04-26T23:27:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.296+0000 7fc9dba00640 1 -- 172.21.15.39:0/1183961184 wait complete. 2024-04-26T23:27:10.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:10.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 Processor -- start 2024-04-26T23:27:10.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 -- start start 2024-04-26T23:27:10.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 0x7f43e80cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e8160060 con 0x7f43e80cf2a0 2024-04-26T23:27:10.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e8160340 con 0x7f43e8145820 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43ee600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80cd5c0 con 0x7f43e806fc80 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43dfe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f43e80cf2a0 0x7f43e806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39924/0 (socket says 172.21.15.39:39924) 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43dfe00640 1 -- 172.21.15.39:0/74144188 learned_addr learned my addr 172.21.15.39:0/74144188 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e7e00640 1 --2- 172.21.15.39:0/74144188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 0x7f43e80cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374572314 0 0) 0x7f43e8160060 con 0x7f43e80cf2a0 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43cc003530 con 0x7f43e80cf2a0 2024-04-26T23:27:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480578663 0 0) 0x7f43e8160340 con 0x7f43e8145820 2024-04-26T23:27:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e8160060 con 0x7f43e8145820 2024-04-26T23:27:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3973712944 0 0) 0x7f43cc003530 con 0x7f43e80cf2a0 2024-04-26T23:27:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e7e00640 1 -- 172.21.15.39:0/74144188 >> v1:172.21.15.71:6789/0 conn(0x7f43e8145820 legacy=0x7f43e80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e7e00640 1 -- 172.21.15.39:0/74144188 >> v1:172.21.15.39:6789/0 conn(0x7f43e80cf2a0 legacy=0x7f43e806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.456+0000 7f43e7e00640 1 -- 172.21.15.39:0/74144188 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e8160620 con 0x7f43e806fc80 2024-04-26T23:27:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43e7e00640 1 --2- 172.21.15.39:0/74144188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 0x7f43e80cda50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009dc0 tx=0x7f43e001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497491f0626192f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00b2070 con 0x7f43e806fc80 2024-04-26T23:27:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e00a5510 con 0x7f43e806fc80 2024-04-26T23:27:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43e6a00640 1 -- 172.21.15.39:0/74144188 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00016a0 con 0x7f43e806fc80 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 -- 172.21.15.39:0/74144188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 msgr2=0x7f43e80cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 --2- 172.21.15.39:0/74144188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 0x7f43e80cda50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009dc0 tx=0x7f43e001c8b0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 -- 172.21.15.39:0/74144188 shutdown_connections 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 --2- 172.21.15.39:0/74144188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e806fc80 0x7f43e80cda50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 -- 172.21.15.39:0/74144188 >> 172.21.15.39:0/74144188 conn(0x7f43e80b2af0 msgr2=0x7f43e80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 -- 172.21.15.39:0/74144188 shutdown_connections 2024-04-26T23:27:10.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.460+0000 7f43ee600640 1 -- 172.21.15.39:0/74144188 wait complete. 2024-04-26T23:27:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 Processor -- start 2024-04-26T23:27:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 -- start start 2024-04-26T23:27:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 0x7f43e8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e80cf2a0 0x7f43e8073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43e815fdb0 con 0x7f43e8145820 2024-04-26T23:27:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43e815fc30 con 0x7f43e806fc80 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43ee600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f43e806e460 con 0x7f43e80cf2a0 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33090/0 (socket says 172.21.15.39:33090) 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 -- 172.21.15.39:0/893403397 learned_addr learned my addr 172.21.15.39:0/893403397 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7400640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 0x7f43e8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43dfe00640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e80cf2a0 0x7f43e8073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 -- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e80cf2a0 msgr2=0x7f43e8073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e80cf2a0 0x7f43e8073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 -- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 msgr2=0x7f43e8152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 0x7f43e8152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 -- 172.21.15.39:0/893403397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e8144160 con 0x7f43e8145820 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7400640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 0x7f43e8152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43e7e00640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b0040 tx=0x7f43e0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00b2040 con 0x7f43e8145820 2024-04-26T23:27:10.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e00bd070 con 0x7f43e8145820 2024-04-26T23:27:10.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.464+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00a5ac0 con 0x7f43e8145820 2024-04-26T23:27:10.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e8144440 con 0x7f43e8145820 2024-04-26T23:27:10.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e8144a00 con 0x7f43e8145820 2024-04-26T23:27:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e8050740 con 0x7f43e8145820 2024-04-26T23:27:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43e00a5c60 con 0x7f43e8145820 2024-04-26T23:27:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43df400640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 0x7f43c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f43e0120f00 con 0x7f43e8145820 2024-04-26T23:27:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43e7400640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 0x7f43c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.468+0000 7f43e7400640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 0x7f43c406a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f43d8001b10 tx=0x7f43d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.472+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f43e00164a0 con 0x7f43e8145820 2024-04-26T23:27:10.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.636+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43e80b04a0 con 0x7f43e8145820 2024-04-26T23:27:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.636+0000 7f43df400640 1 -- 172.21.15.39:0/893403397 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16622 (secure 0 0 0) 0x7f43e00f0ef0 con 0x7f43e8145820 2024-04-26T23:27:10.644 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:10.644 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:09.296961+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 msgr2=0x7f43c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 0x7f43c406a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f43d8001b10 tx=0x7f43d8009040 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 msgr2=0x7f43e8073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b0040 tx=0x7f43e0019650 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 shutdown_connections 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43c40683b0 0x7f43c406a870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8145820 0x7f43e8073850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43e80cf2a0 0x7f43e8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 --2- 172.21.15.39:0/893403397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43e806fc80 0x7f43e8152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 >> 172.21.15.39:0/893403397 conn(0x7f43e80b2af0 msgr2=0x7f43e80d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:10.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 shutdown_connections 2024-04-26T23:27:10.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.640+0000 7f43ee600640 1 -- 172.21.15.39:0/893403397 wait complete. 2024-04-26T23:27:10.665 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:27:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 Processor -- start 2024-04-26T23:27:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 -- start start 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3a40cf940 0x7fa3a406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a41492a0 con 0x7fa3a41488f0 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a406d740 con 0x7fa3a40cf940 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3ac600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a4070840 con 0x7fa3a406d2f0 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3a9c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa3a41488f0 0x7fa3a40cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39936/0 (socket says 172.21.15.39:39936) 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3a9c00640 1 -- 172.21.15.39:0/4274321447 learned_addr learned my addr 172.21.15.39:0/4274321447 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3aa600640 1 --2- 172.21.15.39:0/4274321447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3a9200640 1 --2- 172.21.15.39:0/4274321447 >> v2:172.21.15.71:3300/0 conn(0x7fa3a40cf940 0x7fa3a406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3a3e00640 1 -- 172.21.15.39:0/4274321447 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484773823 0 0) 0x7fa3a41492a0 con 0x7fa3a41488f0 2024-04-26T23:27:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3a3e00640 1 -- 172.21.15.39:0/4274321447 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c003530 con 0x7fa3a41488f0 2024-04-26T23:27:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3aa600640 1 -- 172.21.15.39:0/4274321447 >> v2:172.21.15.71:3300/0 conn(0x7fa3a40cf940 msgr2=0x7fa3a406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3aa600640 1 --2- 172.21.15.39:0/4274321447 >> v2:172.21.15.71:3300/0 conn(0x7fa3a40cf940 0x7fa3a406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3aa600640 1 -- 172.21.15.39:0/4274321447 >> v1:172.21.15.39:6789/0 conn(0x7fa3a41488f0 legacy=0x7fa3a40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.804+0000 7fa3aa600640 1 -- 172.21.15.39:0/4274321447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a406d9c0 con 0x7fa3a406d2f0 2024-04-26T23:27:10.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3aa600640 1 --2- 172.21.15.39:0/4274321447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a406f590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad307d0be029fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3a3e00640 1 -- 172.21.15.39:0/4274321447 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0b2070 con 0x7fa3a406d2f0 2024-04-26T23:27:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3a3e00640 1 -- 172.21.15.39:0/4274321447 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c0a5a00 con 0x7fa3a406d2f0 2024-04-26T23:27:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3a3e00640 1 -- 172.21.15.39:0/4274321447 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0a5dd0 con 0x7fa3a406d2f0 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 -- 172.21.15.39:0/4274321447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 msgr2=0x7fa3a406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 --2- 172.21.15.39:0/4274321447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a406f590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c01c940 comp rx=0 tx=0).stop 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 -- 172.21.15.39:0/4274321447 shutdown_connections 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 --2- 172.21.15.39:0/4274321447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a406f590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 --2- 172.21.15.39:0/4274321447 >> v2:172.21.15.71:3300/0 conn(0x7fa3a40cf940 0x7fa3a406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 -- 172.21.15.39:0/4274321447 >> 172.21.15.39:0/4274321447 conn(0x7fa3a40ce0e0 msgr2=0x7fa3a40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 -- 172.21.15.39:0/4274321447 shutdown_connections 2024-04-26T23:27:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.808+0000 7fa3ac600640 1 -- 172.21.15.39:0/4274321447 wait complete. 2024-04-26T23:27:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 Processor -- start 2024-04-26T23:27:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 -- start start 2024-04-26T23:27:10.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3a41488f0 0x7fa3a40c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4148cd0 con 0x7fa3a40cf940 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a406f070 con 0x7fa3a41488f0 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a40702e0 con 0x7fa3a406d2f0 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33092/0 (socket says 172.21.15.39:33092) 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 -- 172.21.15.39:0/3991656006 learned_addr learned my addr 172.21.15.39:0/3991656006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3aa600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3a41488f0 0x7fa3a40c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9c00640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 -- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 msgr2=0x7fa3a415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 -- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3a41488f0 msgr2=0x7fa3a40c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3a41488f0 0x7fa3a40c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 -- 172.21.15.39:0/3991656006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a40c59f0 con 0x7fa3a40cf940 2024-04-26T23:27:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a9200640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e930 tx=0x7fa39000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390017070 con 0x7fa3a40cf940 2024-04-26T23:27:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39000ca00 con 0x7fa3a40cf940 2024-04-26T23:27:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a40c5cd0 con 0x7fa3a40cf940 2024-04-26T23:27:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.812+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39000cdb0 con 0x7fa3a40cf940 2024-04-26T23:27:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a415d5b0 con 0x7fa3a40cf940 2024-04-26T23:27:10.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a406a720 con 0x7fa3a40cf940 2024-04-26T23:27:10.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa39001a070 con 0x7fa3a40cf940 2024-04-26T23:27:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3a1600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 0x7fa38406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa390086930 con 0x7fa3a40cf940 2024-04-26T23:27:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3a9c00640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 0x7fa38406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.816+0000 7fa3a9c00640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 0x7fa38406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa398007fd0 tx=0x7fa398009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:10.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:10.820+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa390056950 con 0x7fa3a40cf940 2024-04-26T23:27:11.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.028+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa3a4149130 con 0x7fa3a40cf940 2024-04-26T23:27:11.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.924+0000 7fa3a1600640 1 -- 172.21.15.39:0/3991656006 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fa39005ac50 con 0x7fa3a40cf940 2024-04-26T23:27:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 msgr2=0x7fa38406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 0x7fa38406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa398007fd0 tx=0x7fa398009040 comp rx=0 tx=0).stop 2024-04-26T23:27:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 msgr2=0x7fa3a40c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e930 tx=0x7fa39000edf0 comp rx=0 tx=0).stop 2024-04-26T23:27:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 shutdown_connections 2024-04-26T23:27:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa3840683b0 0x7fa38406a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3a41488f0 0x7fa3a40c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3a40cf940 0x7fa3a40c71f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 --2- 172.21.15.39:0/3991656006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa3a406d2f0 0x7fa3a415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 >> 172.21.15.39:0/3991656006 conn(0x7fa3a40ce0e0 msgr2=0x7fa3a40b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 shutdown_connections 2024-04-26T23:27:11.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:11.928+0000 7fa3ac600640 1 -- 172.21.15.39:0/3991656006 wait complete. 2024-04-26T23:27:11.953 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:27:11.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:27:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 Processor -- start 2024-04-26T23:27:12.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 -- start start 2024-04-26T23:27:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f51680cf940 0x7f516806cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51681492a0 con 0x7f51681488f0 2024-04-26T23:27:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5168070840 con 0x7f516806d2f0 2024-04-26T23:27:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516f800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f516806d700 con 0x7f51680cf940 2024-04-26T23:27:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516ce00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f51681488f0 0x7f51680cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39950/0 (socket says 172.21.15.39:39950) 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f516ce00640 1 -- 172.21.15.39:0/143777284 learned_addr learned my addr 172.21.15.39:0/143777284 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167e00640 1 --2- 172.21.15.39:0/143777284 >> v2:172.21.15.39:3300/0 conn(0x7f51680cf940 0x7f516806cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167400640 1 -- 172.21.15.39:0/143777284 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026644588 0 0) 0x7f51681492a0 con 0x7f51681488f0 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167400640 1 -- 172.21.15.39:0/143777284 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150003530 con 0x7f51681488f0 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167e00640 1 -- 172.21.15.39:0/143777284 >> v1:172.21.15.71:6789/0 conn(0x7f516806d2f0 legacy=0x7f516806f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167e00640 1 -- 172.21.15.39:0/143777284 >> v1:172.21.15.39:6789/0 conn(0x7f51681488f0 legacy=0x7f51680cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.092+0000 7f5167e00640 1 -- 172.21.15.39:0/143777284 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516806d9c0 con 0x7f51680cf940 2024-04-26T23:27:12.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f5167e00640 1 --2- 172.21.15.39:0/143777284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51680cf940 0x7f516806cdb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51540097c0 tx=0x7f515401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7c031f8773bc1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:12.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f5167400640 1 -- 172.21.15.39:0/143777284 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540a7070 con 0x7f51680cf940 2024-04-26T23:27:12.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f5167400640 1 -- 172.21.15.39:0/143777284 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51540b0070 con 0x7f51680cf940 2024-04-26T23:27:12.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f5167400640 1 -- 172.21.15.39:0/143777284 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540ab890 con 0x7f51680cf940 2024-04-26T23:27:12.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 -- 172.21.15.39:0/143777284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51680cf940 msgr2=0x7f516806cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 --2- 172.21.15.39:0/143777284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51680cf940 0x7f516806cdb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51540097c0 tx=0x7f515401c470 comp rx=0 tx=0).stop 2024-04-26T23:27:12.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 -- 172.21.15.39:0/143777284 shutdown_connections 2024-04-26T23:27:12.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 --2- 172.21.15.39:0/143777284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51680cf940 0x7f516806cdb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 -- 172.21.15.39:0/143777284 >> 172.21.15.39:0/143777284 conn(0x7f51680ce0e0 msgr2=0x7f51680ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:12.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 -- 172.21.15.39:0/143777284 shutdown_connections 2024-04-26T23:27:12.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.096+0000 7f516f800640 1 -- 172.21.15.39:0/143777284 wait complete. 2024-04-26T23:27:12.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 Processor -- start 2024-04-26T23:27:12.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- start start 2024-04-26T23:27:12.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516806d2f0 0x7f5168158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51680cf940 0x7f516815db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5168148cd0 con 0x7f51681488f0 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f516806f070 con 0x7f516806d2f0 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f516816d3f0 con 0x7f51680cf940 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:12.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33116/0 (socket says 172.21.15.39:33116) 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 -- 172.21.15.39:0/1579406991 learned_addr learned my addr 172.21.15.39:0/1579406991 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f5167e00640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51680cf940 0x7f516815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516ce00640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516806d2f0 0x7f5168158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 -- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51680cf940 msgr2=0x7f516815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51680cf940 0x7f516815db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 -- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516806d2f0 msgr2=0x7f5168158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516806d2f0 0x7f5168158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 -- 172.21.15.39:0/1579406991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51680afbc0 con 0x7f51681488f0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516d800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f516000c760 tx=0x7f516000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160003b80 con 0x7f51681488f0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5160003d20 con 0x7f51681488f0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5168157490 con 0x7f51681488f0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000aa30 con 0x7f51681488f0 2024-04-26T23:27:12.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5168157a50 con 0x7f51681488f0 2024-04-26T23:27:12.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.100+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516806a720 con 0x7f51681488f0 2024-04-26T23:27:12.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.104+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f516000abd0 con 0x7f51681488f0 2024-04-26T23:27:12.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.104+0000 7f5164c00640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 0x7f514806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:12.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.104+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5160086760 con 0x7f51681488f0 2024-04-26T23:27:12.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.104+0000 7f516ce00640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 0x7f514806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:12.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.104+0000 7f516ce00640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 0x7f514806a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f515c0011f0 tx=0x7f515c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:12.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.108+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5160056630 con 0x7f51681488f0 2024-04-26T23:27:12.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.308+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f516815d340 con 0x7f51681488f0 2024-04-26T23:27:12.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.928+0000 7f5164c00640 1 -- 172.21.15.39:0/1579406991 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f516005a930 con 0x7f51681488f0 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 msgr2=0x7f514806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 0x7f514806a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f515c0011f0 tx=0x7f515c007d40 comp rx=0 tx=0).stop 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 msgr2=0x7f516815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f516000c760 tx=0x7f516000cc20 comp rx=0 tx=0).stop 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 shutdown_connections 2024-04-26T23:27:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51480683b0 0x7f514806a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51681488f0 0x7f516815e0b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51680cf940 0x7f516815db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 --2- 172.21.15.39:0/1579406991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516806d2f0 0x7f5168158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 >> 172.21.15.39:0/1579406991 conn(0x7f51680ce0e0 msgr2=0x7f51680b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 shutdown_connections 2024-04-26T23:27:12.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:12.932+0000 7f516f800640 1 -- 172.21.15.39:0/1579406991 wait complete. 2024-04-26T23:27:12.959 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:27:12.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 Processor -- start 2024-04-26T23:27:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 -- start start 2024-04-26T23:27:13.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd01815f340 0x7fd0180d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd01809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 0x7fd01809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd0180d26a0 con 0x7fd01815f340 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd0180ce140 con 0x7fd01815f720 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ee00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0180cd810 con 0x7fd0180b5710 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd01815f340 0x7fd0180d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd01815f340 0x7fd0180d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33120/0 (socket says 172.21.15.39:33120) 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 -- 172.21.15.39:0/266006087 learned_addr learned my addr 172.21.15.39:0/266006087 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ce00640 1 --2- 172.21.15.39:0/266006087 >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 0x7fd01809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 -- 172.21.15.39:0/266006087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 msgr2=0x7fd01809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 --2- 172.21.15.39:0/266006087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd01809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 -- 172.21.15.39:0/266006087 >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 msgr2=0x7fd01809bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 --2- 172.21.15.39:0/266006087 >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 0x7fd01809bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd017e00640 1 -- 172.21.15.39:0/266006087 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0180cdaf0 con 0x7fd01815f340 2024-04-26T23:27:13.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.096+0000 7fd01ce00640 1 --2- 172.21.15.39:0/266006087 >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 0x7fd01809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:13.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd017e00640 1 --2- 172.21.15.39:0/266006087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180d1de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0180737d0 tx=0x7fd00801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9a8e8931a00bd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd017400640 1 -- 172.21.15.39:0/266006087 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0080ab640 con 0x7fd01815f340 2024-04-26T23:27:13.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd017400640 1 -- 172.21.15.39:0/266006087 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0080b0070 con 0x7fd01815f340 2024-04-26T23:27:13.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd017400640 1 -- 172.21.15.39:0/266006087 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0080aba00 con 0x7fd01815f340 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 -- 172.21.15.39:0/266006087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 msgr2=0x7fd0180d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 --2- 172.21.15.39:0/266006087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180d1de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0180737d0 tx=0x7fd00801c460 comp rx=0 tx=0).stop 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 -- 172.21.15.39:0/266006087 shutdown_connections 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 --2- 172.21.15.39:0/266006087 >> v2:172.21.15.71:3300/0 conn(0x7fd01815f720 0x7fd01809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 --2- 172.21.15.39:0/266006087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd01809b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 --2- 172.21.15.39:0/266006087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180d1de0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 -- 172.21.15.39:0/266006087 >> 172.21.15.39:0/266006087 conn(0x7fd0180b4b80 msgr2=0x7fd0180b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 -- 172.21.15.39:0/266006087 shutdown_connections 2024-04-26T23:27:13.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 -- 172.21.15.39:0/266006087 wait complete. 2024-04-26T23:27:13.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.100+0000 7fd01ee00640 1 Processor -- start 2024-04-26T23:27:13.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- start start 2024-04-26T23:27:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd0180c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 0x7fd0180c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd0180b8ab0 con 0x7fd01815f340 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0180b8c30 con 0x7fd01815f720 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0180b8db0 con 0x7fd0180b5710 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33134/0 (socket says 172.21.15.39:33134) 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 -- 172.21.15.39:0/586321319 learned_addr learned my addr 172.21.15.39:0/586321319 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd017e00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd0180c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ce00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 0x7fd0180c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 -- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 msgr2=0x7fd0180c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd0180c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 -- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 msgr2=0x7fd0180c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 0x7fd0180c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 -- 172.21.15.39:0/586321319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd018160690 con 0x7fd01815f340 2024-04-26T23:27:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd017e00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd0180c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ce00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 0x7fd0180c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd00fe00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b3f0 tx=0x7fd00000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000015020 con 0x7fd01815f340 2024-04-26T23:27:13.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd000011830 con 0x7fd01815f340 2024-04-26T23:27:13.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000011c20 con 0x7fd01815f340 2024-04-26T23:27:13.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd018160970 con 0x7fd01815f340 2024-04-26T23:27:13.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd018160f30 con 0x7fd01815f340 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.104+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd018050740 con 0x7fd01815f340 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.108+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd000018020 con 0x7fd01815f340 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.108+0000 7fd014c00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 0x7fcff406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.108+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd0000869b0 con 0x7fd01815f340 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.108+0000 7fd017e00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 0x7fcff406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.108+0000 7fd017e00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 0x7fcff406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0080af000 tx=0x7fd008008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.112+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd00001f020 con 0x7fd01815f340 2024-04-26T23:27:13.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.308+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0180c7040 con 0x7fd01815f340 2024-04-26T23:27:13.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.308+0000 7fd014c00640 1 -- 172.21.15.39:0/586321319 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7fd0000172c0 con 0x7fd01815f340 2024-04-26T23:27:13.316 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:13.316 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/427434532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":427434532},{"type":"v1","addr":"172.21.15.39:6834","nonce":427434532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:13.316 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 17 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 msgr2=0x7fcff406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 0x7fcff406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0080af000 tx=0x7fd008008040 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 msgr2=0x7fd0180c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b3f0 tx=0x7fd00000b8b0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 shutdown_connections 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcff4068380 0x7fcff406a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd01815f720 0x7fd0180c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd01815f340 0x7fd0180c97c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 --2- 172.21.15.39:0/586321319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0180b5710 0x7fd0180c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 >> 172.21.15.39:0/586321319 conn(0x7fd0180b4b80 msgr2=0x7fd0180d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:13.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 shutdown_connections 2024-04-26T23:27:13.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.312+0000 7fd01ee00640 1 -- 172.21.15.39:0/586321319 wait complete. 2024-04-26T23:27:13.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:13.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 Processor -- start 2024-04-26T23:27:13.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 -- start start 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ad40cd750 0x7f0ad40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4160070 con 0x7f0ad406fd70 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4160340 con 0x7f0ad415d000 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0adbe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad406f4a0 con 0x7f0ad40cd750 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0ad8a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0ad406fd70 0x7f0ad415f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39958/0 (socket says 172.21.15.39:39958) 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.472+0000 7f0ad8a00640 1 -- 172.21.15.39:0/1184358721 learned_addr learned my addr 172.21.15.39:0/1184358721 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:13.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad9e00640 1 --2- 172.21.15.39:0/1184358721 >> v2:172.21.15.71:3300/0 conn(0x7f0ad40cd750 0x7f0ad40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad3e00640 1 -- 172.21.15.39:0/1184358721 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027109047 0 0) 0x7f0ad4160070 con 0x7f0ad406fd70 2024-04-26T23:27:13.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad3e00640 1 -- 172.21.15.39:0/1184358721 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0abc003530 con 0x7f0ad406fd70 2024-04-26T23:27:13.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1184358721 >> v1:172.21.15.71:6789/0 conn(0x7f0ad415d000 legacy=0x7f0ad406ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1184358721 >> v1:172.21.15.39:6789/0 conn(0x7f0ad406fd70 legacy=0x7f0ad415f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1184358721 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4160620 con 0x7f0ad40cd750 2024-04-26T23:27:13.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.476+0000 7f0ad9e00640 1 --2- 172.21.15.39:0/1184358721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad40cdb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184af674e1c97764 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad3e00640 1 -- 172.21.15.39:0/1184358721 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0b2070 con 0x7f0ad40cd750 2024-04-26T23:27:13.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad3e00640 1 -- 172.21.15.39:0/1184358721 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0a5710 con 0x7f0ad40cd750 2024-04-26T23:27:13.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad3e00640 1 -- 172.21.15.39:0/1184358721 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0a5ac0 con 0x7f0ad40cd750 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- 172.21.15.39:0/1184358721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 msgr2=0x7f0ad40cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1184358721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad40cdb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc01c850 comp rx=0 tx=0).stop 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- 172.21.15.39:0/1184358721 shutdown_connections 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1184358721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad40cdb80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- 172.21.15.39:0/1184358721 >> 172.21.15.39:0/1184358721 conn(0x7f0ad40b2af0 msgr2=0x7f0ad40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- 172.21.15.39:0/1184358721 shutdown_connections 2024-04-26T23:27:13.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- 172.21.15.39:0/1184358721 wait complete. 2024-04-26T23:27:13.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 Processor -- start 2024-04-26T23:27:13.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- start start 2024-04-26T23:27:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad406fd70 0x7f0ad4150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad4154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40ce0c0 con 0x7f0ad415d000 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40cf740 con 0x7f0ad40cd750 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0adbe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad416d300 con 0x7f0ad406fd70 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33138/0 (socket says 172.21.15.39:33138) 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1377874116 learned_addr learned my addr 172.21.15.39:0/1377874116 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad8a00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad4154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9400640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad406fd70 0x7f0ad4150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad406fd70 msgr2=0x7f0ad4150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad406fd70 0x7f0ad4150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 msgr2=0x7f0ad4154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad4154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.480+0000 7f0ad9e00640 1 -- 172.21.15.39:0/1377874116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4155230 con 0x7f0ad415d000 2024-04-26T23:27:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad9e00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0bd030 con 0x7f0ad415d000 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0a5510 con 0x7f0ad415d000 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0b2040 con 0x7f0ad415d000 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad4155510 con 0x7f0ad415d000 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4155ad0 con 0x7f0ad415d000 2024-04-26T23:27:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4050740 con 0x7f0ad415d000 2024-04-26T23:27:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0acc0c0070 con 0x7f0ad415d000 2024-04-26T23:27:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 0x7f0ab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0acc121460 con 0x7f0ad415d000 2024-04-26T23:27:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.484+0000 7f0ad9400640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 0x7f0ab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.488+0000 7f0ad9400640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 0x7f0ab406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80015b0 tx=0x7f0ac8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.492+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0acc0c7070 con 0x7f0ad415d000 2024-04-26T23:27:13.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.656+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ad40b1990 con 0x7f0ad415d000 2024-04-26T23:27:13.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.656+0000 7f0ad1600640 1 -- 172.21.15.39:0/1377874116 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16609 (secure 0 0 0) 0x7f0acc016560 con 0x7f0ad415d000 2024-04-26T23:27:13.663 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:13.663 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:10.907179+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:13.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 msgr2=0x7f0ab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 0x7f0ab406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80015b0 tx=0x7f0ac8009040 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 msgr2=0x7f0ad41584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc0195f0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 shutdown_connections 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0ab4068380 0x7f0ab406a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ad415d000 0x7f0ad41584d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ad40cd750 0x7f0ad4154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 --2- 172.21.15.39:0/1377874116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ad406fd70 0x7f0ad4150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 >> 172.21.15.39:0/1377874116 conn(0x7f0ad40b2af0 msgr2=0x7f0ad40b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 shutdown_connections 2024-04-26T23:27:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.660+0000 7f0adbe00640 1 -- 172.21.15.39:0/1377874116 wait complete. 2024-04-26T23:27:13.686 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:27:13.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.820+0000 7f294e400640 1 Processor -- start 2024-04-26T23:27:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.820+0000 7f294e400640 1 -- start start 2024-04-26T23:27:13.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f294e400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f29480cd810 0x7f29480742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f294e400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f29480cdbf0 0x7f294806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f294e400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29480d0550 con 0x7f29480cfe00 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f294e400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f29480d0b10 con 0x7f29480cd810 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f294e400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f294806e970 con 0x7f29480cdbf0 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f29480cd810 0x7f29480742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f29480cd810 0x7f29480742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33142/0 (socket says 172.21.15.39:33142) 2024-04-26T23:27:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 -- 172.21.15.39:0/4280104242 learned_addr learned my addr 172.21.15.39:0/4280104242 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 -- 172.21.15.39:0/4280104242 >> v2:172.21.15.71:3300/0 conn(0x7f29480cdbf0 msgr2=0x7f294806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 --2- 172.21.15.39:0/4280104242 >> v2:172.21.15.71:3300/0 conn(0x7f29480cdbf0 0x7f294806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 -- 172.21.15.39:0/4280104242 >> v1:172.21.15.71:6789/0 conn(0x7f29480cfe00 legacy=0x7f2948144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.824+0000 7f2947400640 1 -- 172.21.15.39:0/4280104242 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29480d0830 con 0x7f29480cd810 2024-04-26T23:27:13.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f2947400640 1 --2- 172.21.15.39:0/4280104242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cd810 0x7f29480742f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f29480719c0 tx=0x7f293801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4388ee8717a553e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f2946a00640 1 -- 172.21.15.39:0/4280104242 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29380b0070 con 0x7f29480cd810 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f2946a00640 1 -- 172.21.15.39:0/4280104242 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29380ab600 con 0x7f29480cd810 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f2946a00640 1 -- 172.21.15.39:0/4280104242 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29380ab9d0 con 0x7f29480cd810 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- 172.21.15.39:0/4280104242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cd810 msgr2=0x7f29480742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- 172.21.15.39:0/4280104242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cd810 0x7f29480742f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f29480719c0 tx=0x7f293801c390 comp rx=0 tx=0).stop 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- 172.21.15.39:0/4280104242 shutdown_connections 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- 172.21.15.39:0/4280104242 >> v2:172.21.15.71:3300/0 conn(0x7f29480cdbf0 0x7f294806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- 172.21.15.39:0/4280104242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cd810 0x7f29480742f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- 172.21.15.39:0/4280104242 >> 172.21.15.39:0/4280104242 conn(0x7f29480b2af0 msgr2=0x7f29480b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:13.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- 172.21.15.39:0/4280104242 shutdown_connections 2024-04-26T23:27:13.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- 172.21.15.39:0/4280104242 wait complete. 2024-04-26T23:27:13.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 Processor -- start 2024-04-26T23:27:13.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- start start 2024-04-26T23:27:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29480cdbf0 0x7f2948167920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 0x7f29481407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2948143d30 con 0x7f29480cfe00 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2948143bb0 con 0x7f29480cd810 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f294e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2948169ef0 con 0x7f29480cdbf0 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.828+0000 7f2947e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 0x7f29481407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:45820/0 (socket says 172.21.15.39:45820) 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947400640 1 -- 172.21.15.39:0/3827497001 learned_addr learned my addr 172.21.15.39:0/3827497001 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f293ea00640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29480cdbf0 0x7f2948167920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 -- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29480cdbf0 msgr2=0x7f2948167920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29480cdbf0 0x7f2948167920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 -- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 msgr2=0x7f2948155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 -- 172.21.15.39:0/3827497001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948154b80 con 0x7f29480cfe00 2024-04-26T23:27:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:13.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f2947e00640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 0x7f29481407f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f294000b410 tx=0x7f2940009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940015020 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2940011830 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2948154e00 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940011c00 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481553c0 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2948050740 con 0x7f29480cfe00 2024-04-26T23:27:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.832+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2940018020 con 0x7f29480cfe00 2024-04-26T23:27:13.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.836+0000 7f293fe00640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 0x7f292406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:13.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.836+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f29400867b0 con 0x7f29480cfe00 2024-04-26T23:27:13.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.836+0000 7f2947400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 0x7f292406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:13.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.836+0000 7f2947400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 0x7f292406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f293801c3d0 tx=0x7f29380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:13.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:13.840+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f294001f020 con 0x7f29480cfe00 2024-04-26T23:27:13.881 INFO:tasks.ceph.mds.a.smithi039.stderr:2024-04-26T23:27:13.876+0000 7f818f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:27:14.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.004+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29480d1140 con 0x7f2924068380 2024-04-26T23:27:14.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.012+0000 7f293fe00640 1 -- 172.21.15.39:0/3827497001 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f29480d1140 con 0x7f2924068380 2024-04-26T23:27:14.020 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:14.021 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 msgr2=0x7f292406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 0x7f292406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f293801c3d0 tx=0x7f29380a6000 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 msgr2=0x7f29481407f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 0x7f29481407f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f294000b410 tx=0x7f2940009f90 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 shutdown_connections 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2924068380 0x7f292406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29480cfe00 0x7f29481407f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29480cdbf0 0x7f2948167920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 --2- 172.21.15.39:0/3827497001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29480cd810 0x7f2948155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 >> 172.21.15.39:0/3827497001 conn(0x7f29480b2af0 msgr2=0x7f29480d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 shutdown_connections 2024-04-26T23:27:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.016+0000 7f294e400640 1 -- 172.21.15.39:0/3827497001 wait complete. 2024-04-26T23:27:14.041 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-26T23:27:13.670712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232756,"kb_used_data":4076,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741964,"statfs":{"total":773094113280,"available":772855771136,"internally_reserved":0,"allocated":4173824,"data_stored":2326920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.780336"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942206+0000","last_change":"2024-04-26T23:27:09.936466+0000","last_active":"2024-04-26T23:27:09.942206+0000","last_peered":"2024-04-26T23:27:09.942206+0000","last_clean":"2024-04-26T23:27:09.942206+0000","last_became_active":"2024-04-26T23:27:09.935836+0000","last_became_peered":"2024-04-26T23:27:09.935836+0000","last_unstale":"2024-04-26T23:27:09.942206+0000","last_undegraded":"2024-04-26T23:27:09.942206+0000","last_fullsized":"2024-04-26T23:27:09.942206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:51.302988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141037+0000","last_change":"2024-04-26T23:27:09.924323+0000","last_active":"2024-04-26T23:27:11.141037+0000","last_peered":"2024-04-26T23:27:11.141037+0000","last_clean":"2024-04-26T23:27:11.141037+0000","last_became_active":"2024-04-26T23:27:09.924015+0000","last_became_peered":"2024-04-26T23:27:09.924015+0000","last_unstale":"2024-04-26T23:27:11.141037+0000","last_undegraded":"2024-04-26T23:27:11.141037+0000","last_fullsized":"2024-04-26T23:27:11.141037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:46.127801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913320+0000","last_change":"2024-04-26T23:27:09.937863+0000","last_active":"2024-04-26T23:27:10.913320+0000","last_peered":"2024-04-26T23:27:10.913320+0000","last_clean":"2024-04-26T23:27:10.913320+0000","last_became_active":"2024-04-26T23:27:09.937606+0000","last_became_peered":"2024-04-26T23:27:09.937606+0000","last_unstale":"2024-04-26T23:27:10.913320+0000","last_undegraded":"2024-04-26T23:27:10.913320+0000","last_fullsized":"2024-04-26T23:27:10.913320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:38.309597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933381+0000","last_change":"2024-04-26T23:27:09.939708+0000","last_active":"2024-04-26T23:27:10.933381+0000","last_peered":"2024-04-26T23:27:10.933381+0000","last_clean":"2024-04-26T23:27:10.933381+0000","last_became_active":"2024-04-26T23:27:09.939340+0000","last_became_peered":"2024-04-26T23:27:09.939340+0000","last_unstale":"2024-04-26T23:27:10.933381+0000","last_undegraded":"2024-04-26T23:27:10.933381+0000","last_fullsized":"2024-04-26T23:27:10.933381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:29.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942801+0000","last_change":"2024-04-26T23:27:09.940113+0000","last_active":"2024-04-26T23:27:09.942801+0000","last_peered":"2024-04-26T23:27:09.942801+0000","last_clean":"2024-04-26T23:27:09.942801+0000","last_became_active":"2024-04-26T23:27:09.939816+0000","last_became_peered":"2024-04-26T23:27:09.939816+0000","last_unstale":"2024-04-26T23:27:09.942801+0000","last_undegraded":"2024-04-26T23:27:09.942801+0000","last_fullsized":"2024-04-26T23:27:09.942801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:00.415436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141143+0000","last_change":"2024-04-26T23:27:09.916316+0000","last_active":"2024-04-26T23:27:11.141143+0000","last_peered":"2024-04-26T23:27:11.141143+0000","last_clean":"2024-04-26T23:27:11.141143+0000","last_became_active":"2024-04-26T23:27:09.916014+0000","last_became_peered":"2024-04-26T23:27:09.916014+0000","last_unstale":"2024-04-26T23:27:11.141143+0000","last_undegraded":"2024-04-26T23:27:11.141143+0000","last_fullsized":"2024-04-26T23:27:11.141143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.073031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942802+0000","last_change":"2024-04-26T23:27:09.937279+0000","last_active":"2024-04-26T23:27:09.942802+0000","last_peered":"2024-04-26T23:27:09.942802+0000","last_clean":"2024-04-26T23:27:09.942802+0000","last_became_active":"2024-04-26T23:27:09.936906+0000","last_became_peered":"2024-04-26T23:27:09.936906+0000","last_unstale":"2024-04-26T23:27:09.942802+0000","last_undegraded":"2024-04-26T23:27:09.942802+0000","last_fullsized":"2024-04-26T23:27:09.942802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939229+0000","last_change":"2024-04-26T23:27:09.933657+0000","last_active":"2024-04-26T23:27:09.939229+0000","last_peered":"2024-04-26T23:27:09.939229+0000","last_clean":"2024-04-26T23:27:09.939229+0000","last_became_active":"2024-04-26T23:27:09.933371+0000","last_became_peered":"2024-04-26T23:27:09.933371+0000","last_unstale":"2024-04-26T23:27:09.939229+0000","last_undegraded":"2024-04-26T23:27:09.939229+0000","last_fullsized":"2024-04-26T23:27:09.939229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:52.198195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913861+0000","last_change":"2024-04-26T23:27:09.931196+0000","last_active":"2024-04-26T23:27:10.913861+0000","last_peered":"2024-04-26T23:27:10.913861+0000","last_clean":"2024-04-26T23:27:10.913861+0000","last_became_active":"2024-04-26T23:27:09.930946+0000","last_became_peered":"2024-04-26T23:27:09.930946+0000","last_unstale":"2024-04-26T23:27:10.913861+0000","last_undegraded":"2024-04-26T23:27:10.913861+0000","last_fullsized":"2024-04-26T23:27:10.913861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933452+0000","last_change":"2024-04-26T23:27:09.937649+0000","last_active":"2024-04-26T23:27:10.933452+0000","last_peered":"2024-04-26T23:27:10.933452+0000","last_clean":"2024-04-26T23:27:10.933452+0000","last_became_active":"2024-04-26T23:27:09.936365+0000","last_became_peered":"2024-04-26T23:27:09.936365+0000","last_unstale":"2024-04-26T23:27:10.933452+0000","last_undegraded":"2024-04-26T23:27:10.933452+0000","last_fullsized":"2024-04-26T23:27:10.933452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:36.302202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.945248+0000","last_change":"2024-04-26T23:27:09.942890+0000","last_active":"2024-04-26T23:27:09.945248+0000","last_peered":"2024-04-26T23:27:09.945248+0000","last_clean":"2024-04-26T23:27:09.945248+0000","last_became_active":"2024-04-26T23:27:09.942583+0000","last_became_peered":"2024-04-26T23:27:09.942583+0000","last_unstale":"2024-04-26T23:27:09.945248+0000","last_undegraded":"2024-04-26T23:27:09.945248+0000","last_fullsized":"2024-04-26T23:27:09.945248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912689+0000","last_change":"2024-04-26T23:27:09.924165+0000","last_active":"2024-04-26T23:27:10.912689+0000","last_peered":"2024-04-26T23:27:10.912689+0000","last_clean":"2024-04-26T23:27:10.912689+0000","last_became_active":"2024-04-26T23:27:09.923908+0000","last_became_peered":"2024-04-26T23:27:09.923908+0000","last_unstale":"2024-04-26T23:27:10.912689+0000","last_undegraded":"2024-04-26T23:27:10.912689+0000","last_fullsized":"2024-04-26T23:27:10.912689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:20.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942050+0000","last_change":"2024-04-26T23:27:09.931378+0000","last_active":"2024-04-26T23:27:09.942050+0000","last_peered":"2024-04-26T23:27:09.942050+0000","last_clean":"2024-04-26T23:27:09.942050+0000","last_became_active":"2024-04-26T23:27:09.931067+0000","last_became_peered":"2024-04-26T23:27:09.931067+0000","last_unstale":"2024-04-26T23:27:09.942050+0000","last_undegraded":"2024-04-26T23:27:09.942050+0000","last_fullsized":"2024-04-26T23:27:09.942050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:59.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140878+0000","last_change":"2024-04-26T23:27:09.933771+0000","last_active":"2024-04-26T23:27:11.140878+0000","last_peered":"2024-04-26T23:27:11.140878+0000","last_clean":"2024-04-26T23:27:11.140878+0000","last_became_active":"2024-04-26T23:27:09.933477+0000","last_became_peered":"2024-04-26T23:27:09.933477+0000","last_unstale":"2024-04-26T23:27:11.140878+0000","last_undegraded":"2024-04-26T23:27:11.140878+0000","last_fullsized":"2024-04-26T23:27:11.140878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:12.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912634+0000","last_change":"2024-04-26T23:27:09.931262+0000","last_active":"2024-04-26T23:27:10.912634+0000","last_peered":"2024-04-26T23:27:10.912634+0000","last_clean":"2024-04-26T23:27:10.912634+0000","last_became_active":"2024-04-26T23:27:09.930949+0000","last_became_peered":"2024-04-26T23:27:09.930949+0000","last_unstale":"2024-04-26T23:27:10.912634+0000","last_undegraded":"2024-04-26T23:27:10.912634+0000","last_fullsized":"2024-04-26T23:27:10.912634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:20.969719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942704+0000","last_change":"2024-04-26T23:27:09.937103+0000","last_active":"2024-04-26T23:27:09.942704+0000","last_peered":"2024-04-26T23:27:09.942704+0000","last_clean":"2024-04-26T23:27:09.942704+0000","last_became_active":"2024-04-26T23:27:09.936731+0000","last_became_peered":"2024-04-26T23:27:09.936731+0000","last_unstale":"2024-04-26T23:27:09.942704+0000","last_undegraded":"2024-04-26T23:27:09.942704+0000","last_fullsized":"2024-04-26T23:27:09.942704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942700+0000","last_change":"2024-04-26T23:27:09.941120+0000","last_active":"2024-04-26T23:27:09.942700+0000","last_peered":"2024-04-26T23:27:09.942700+0000","last_clean":"2024-04-26T23:27:09.942700+0000","last_became_active":"2024-04-26T23:27:09.940157+0000","last_became_peered":"2024-04-26T23:27:09.940157+0000","last_unstale":"2024-04-26T23:27:09.942700+0000","last_undegraded":"2024-04-26T23:27:09.942700+0000","last_fullsized":"2024-04-26T23:27:09.942700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:36.302202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141104+0000","last_change":"2024-04-26T23:27:09.931625+0000","last_active":"2024-04-26T23:27:11.141104+0000","last_peered":"2024-04-26T23:27:11.141104+0000","last_clean":"2024-04-26T23:27:11.141104+0000","last_became_active":"2024-04-26T23:27:09.930728+0000","last_became_peered":"2024-04-26T23:27:09.930728+0000","last_unstale":"2024-04-26T23:27:11.141104+0000","last_undegraded":"2024-04-26T23:27:11.141104+0000","last_fullsized":"2024-04-26T23:27:11.141104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:30.807586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140893+0000","last_change":"2024-04-26T23:27:09.931156+0000","last_active":"2024-04-26T23:27:11.140893+0000","last_peered":"2024-04-26T23:27:11.140893+0000","last_clean":"2024-04-26T23:27:11.140893+0000","last_became_active":"2024-04-26T23:27:09.930837+0000","last_became_peered":"2024-04-26T23:27:09.930837+0000","last_unstale":"2024-04-26T23:27:11.140893+0000","last_undegraded":"2024-04-26T23:27:11.140893+0000","last_fullsized":"2024-04-26T23:27:11.140893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:58.263273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.938628+0000","last_change":"2024-04-26T23:27:09.929278+0000","last_active":"2024-04-26T23:27:09.938628+0000","last_peered":"2024-04-26T23:27:09.938628+0000","last_clean":"2024-04-26T23:27:09.938628+0000","last_became_active":"2024-04-26T23:27:09.929075+0000","last_became_peered":"2024-04-26T23:27:09.929075+0000","last_unstale":"2024-04-26T23:27:09.938628+0000","last_undegraded":"2024-04-26T23:27:09.938628+0000","last_fullsized":"2024-04-26T23:27:09.938628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:47.741840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913491+0000","last_change":"2024-04-26T23:27:09.929290+0000","last_active":"2024-04-26T23:27:10.913491+0000","last_peered":"2024-04-26T23:27:10.913491+0000","last_clean":"2024-04-26T23:27:10.913491+0000","last_became_active":"2024-04-26T23:27:09.928953+0000","last_became_peered":"2024-04-26T23:27:09.928953+0000","last_unstale":"2024-04-26T23:27:10.913491+0000","last_undegraded":"2024-04-26T23:27:10.913491+0000","last_fullsized":"2024-04-26T23:27:10.913491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:58.994759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913594+0000","last_change":"2024-04-26T23:27:09.935027+0000","last_active":"2024-04-26T23:27:10.913594+0000","last_peered":"2024-04-26T23:27:10.913594+0000","last_clean":"2024-04-26T23:27:10.913594+0000","last_became_active":"2024-04-26T23:27:09.934637+0000","last_became_peered":"2024-04-26T23:27:09.934637+0000","last_unstale":"2024-04-26T23:27:10.913594+0000","last_undegraded":"2024-04-26T23:27:10.913594+0000","last_fullsized":"2024-04-26T23:27:10.913594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911457+0000","last_change":"2024-04-26T23:27:09.927064+0000","last_active":"2024-04-26T23:27:10.911457+0000","last_peered":"2024-04-26T23:27:10.911457+0000","last_clean":"2024-04-26T23:27:10.911457+0000","last_became_active":"2024-04-26T23:27:09.926741+0000","last_became_peered":"2024-04-26T23:27:09.926741+0000","last_unstale":"2024-04-26T23:27:10.911457+0000","last_undegraded":"2024-04-26T23:27:10.911457+0000","last_fullsized":"2024-04-26T23:27:10.911457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912574+0000","last_change":"2024-04-26T23:27:09.932933+0000","last_active":"2024-04-26T23:27:10.912574+0000","last_peered":"2024-04-26T23:27:10.912574+0000","last_clean":"2024-04-26T23:27:10.912574+0000","last_became_active":"2024-04-26T23:27:09.932635+0000","last_became_peered":"2024-04-26T23:27:09.932635+0000","last_unstale":"2024-04-26T23:27:10.912574+0000","last_undegraded":"2024-04-26T23:27:10.912574+0000","last_fullsized":"2024-04-26T23:27:10.912574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933578+0000","last_change":"2024-04-26T23:27:09.927946+0000","last_active":"2024-04-26T23:27:10.933578+0000","last_peered":"2024-04-26T23:27:10.933578+0000","last_clean":"2024-04-26T23:27:10.933578+0000","last_became_active":"2024-04-26T23:27:09.927695+0000","last_became_peered":"2024-04-26T23:27:09.927695+0000","last_unstale":"2024-04-26T23:27:10.933578+0000","last_undegraded":"2024-04-26T23:27:10.933578+0000","last_fullsized":"2024-04-26T23:27:10.933578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:20.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141202+0000","last_change":"2024-04-26T23:27:09.921815+0000","last_active":"2024-04-26T23:27:11.141202+0000","last_peered":"2024-04-26T23:27:11.141202+0000","last_clean":"2024-04-26T23:27:11.141202+0000","last_became_active":"2024-04-26T23:27:09.921434+0000","last_became_peered":"2024-04-26T23:27:09.921434+0000","last_unstale":"2024-04-26T23:27:11.141202+0000","last_undegraded":"2024-04-26T23:27:11.141202+0000","last_fullsized":"2024-04-26T23:27:11.141202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:21:52.490755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933488+0000","last_change":"2024-04-26T23:27:09.936245+0000","last_active":"2024-04-26T23:27:10.933488+0000","last_peered":"2024-04-26T23:27:10.933488+0000","last_clean":"2024-04-26T23:27:10.933488+0000","last_became_active":"2024-04-26T23:27:09.935599+0000","last_became_peered":"2024-04-26T23:27:09.935599+0000","last_unstale":"2024-04-26T23:27:10.933488+0000","last_undegraded":"2024-04-26T23:27:10.933488+0000","last_fullsized":"2024-04-26T23:27:10.933488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:20.969719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912871+0000","last_change":"2024-04-26T23:27:09.925591+0000","last_active":"2024-04-26T23:27:10.912871+0000","last_peered":"2024-04-26T23:27:10.912871+0000","last_clean":"2024-04-26T23:27:10.912871+0000","last_became_active":"2024-04-26T23:27:09.925242+0000","last_became_peered":"2024-04-26T23:27:09.925242+0000","last_unstale":"2024-04-26T23:27:10.912871+0000","last_undegraded":"2024-04-26T23:27:10.912871+0000","last_fullsized":"2024-04-26T23:27:10.912871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.665028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913557+0000","last_change":"2024-04-26T23:27:09.936138+0000","last_active":"2024-04-26T23:27:10.913557+0000","last_peered":"2024-04-26T23:27:10.913557+0000","last_clean":"2024-04-26T23:27:10.913557+0000","last_became_active":"2024-04-26T23:27:09.935129+0000","last_became_peered":"2024-04-26T23:27:09.935129+0000","last_unstale":"2024-04-26T23:27:10.913557+0000","last_undegraded":"2024-04-26T23:27:10.913557+0000","last_fullsized":"2024-04-26T23:27:10.913557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.943689+0000","last_change":"2024-04-26T23:27:09.937104+0000","last_active":"2024-04-26T23:27:09.943689+0000","last_peered":"2024-04-26T23:27:09.943689+0000","last_clean":"2024-04-26T23:27:09.943689+0000","last_became_active":"2024-04-26T23:27:09.936828+0000","last_became_peered":"2024-04-26T23:27:09.936828+0000","last_unstale":"2024-04-26T23:27:09.943689+0000","last_undegraded":"2024-04-26T23:27:09.943689+0000","last_fullsized":"2024-04-26T23:27:09.943689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.948066+0000","last_change":"2024-04-26T23:27:09.943377+0000","last_active":"2024-04-26T23:27:09.948066+0000","last_peered":"2024-04-26T23:27:09.948066+0000","last_clean":"2024-04-26T23:27:09.948066+0000","last_became_active":"2024-04-26T23:27:09.943004+0000","last_became_peered":"2024-04-26T23:27:09.943004+0000","last_unstale":"2024-04-26T23:27:09.948066+0000","last_undegraded":"2024-04-26T23:27:09.948066+0000","last_fullsized":"2024-04-26T23:27:09.948066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:55.183221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939243+0000","last_change":"2024-04-26T23:27:09.934983+0000","last_active":"2024-04-26T23:27:09.939243+0000","last_peered":"2024-04-26T23:27:09.939243+0000","last_clean":"2024-04-26T23:27:09.939243+0000","last_became_active":"2024-04-26T23:27:09.934696+0000","last_became_peered":"2024-04-26T23:27:09.934696+0000","last_unstale":"2024-04-26T23:27:09.939243+0000","last_undegraded":"2024-04-26T23:27:09.939243+0000","last_fullsized":"2024-04-26T23:27:09.939243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:58.994759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911680+0000","last_change":"2024-04-26T23:27:09.920896+0000","last_active":"2024-04-26T23:27:10.911680+0000","last_peered":"2024-04-26T23:27:10.911680+0000","last_clean":"2024-04-26T23:27:10.911680+0000","last_became_active":"2024-04-26T23:27:09.920543+0000","last_became_peered":"2024-04-26T23:27:09.920543+0000","last_unstale":"2024-04-26T23:27:10.911680+0000","last_undegraded":"2024-04-26T23:27:10.911680+0000","last_fullsized":"2024-04-26T23:27:10.911680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.949721+0000","last_change":"2024-04-26T23:27:08.915333+0000","last_active":"2024-04-26T23:27:09.949721+0000","last_peered":"2024-04-26T23:27:09.949721+0000","last_clean":"2024-04-26T23:27:09.949721+0000","last_became_active":"2024-04-26T23:27:08.914443+0000","last_became_peered":"2024-04-26T23:27:08.914443+0000","last_unstale":"2024-04-26T23:27:09.949721+0000","last_undegraded":"2024-04-26T23:27:09.949721+0000","last_fullsized":"2024-04-26T23:27:09.949721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:40.423793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942337+0000","last_change":"2024-04-26T23:27:09.936794+0000","last_active":"2024-04-26T23:27:09.942337+0000","last_peered":"2024-04-26T23:27:09.942337+0000","last_clean":"2024-04-26T23:27:09.942337+0000","last_became_active":"2024-04-26T23:27:09.936191+0000","last_became_peered":"2024-04-26T23:27:09.936191+0000","last_unstale":"2024-04-26T23:27:09.942337+0000","last_undegraded":"2024-04-26T23:27:09.942337+0000","last_fullsized":"2024-04-26T23:27:09.942337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:40.728829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911698+0000","last_change":"2024-04-26T23:27:08.922048+0000","last_active":"2024-04-26T23:27:10.911698+0000","last_peered":"2024-04-26T23:27:10.911698+0000","last_clean":"2024-04-26T23:27:10.911698+0000","last_became_active":"2024-04-26T23:27:08.921468+0000","last_became_peered":"2024-04-26T23:27:08.921468+0000","last_unstale":"2024-04-26T23:27:10.911698+0000","last_undegraded":"2024-04-26T23:27:10.911698+0000","last_fullsized":"2024-04-26T23:27:10.911698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:50.292659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913721+0000","last_change":"2024-04-26T23:27:09.934860+0000","last_active":"2024-04-26T23:27:10.913721+0000","last_peered":"2024-04-26T23:27:10.913721+0000","last_clean":"2024-04-26T23:27:10.913721+0000","last_became_active":"2024-04-26T23:27:09.934169+0000","last_became_peered":"2024-04-26T23:27:09.934169+0000","last_unstale":"2024-04-26T23:27:10.913721+0000","last_undegraded":"2024-04-26T23:27:10.913721+0000","last_fullsized":"2024-04-26T23:27:10.913721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141029+0000","last_change":"2024-04-26T23:27:08.923947+0000","last_active":"2024-04-26T23:27:11.141029+0000","last_peered":"2024-04-26T23:27:11.141029+0000","last_clean":"2024-04-26T23:27:11.141029+0000","last_became_active":"2024-04-26T23:27:08.923649+0000","last_became_peered":"2024-04-26T23:27:08.923649+0000","last_unstale":"2024-04-26T23:27:11.141029+0000","last_undegraded":"2024-04-26T23:27:11.141029+0000","last_fullsized":"2024-04-26T23:27:11.141029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:51.187866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933607+0000","last_change":"2024-04-26T23:27:09.935958+0000","last_active":"2024-04-26T23:27:10.933607+0000","last_peered":"2024-04-26T23:27:10.933607+0000","last_clean":"2024-04-26T23:27:10.933607+0000","last_became_active":"2024-04-26T23:27:09.935274+0000","last_became_peered":"2024-04-26T23:27:09.935274+0000","last_unstale":"2024-04-26T23:27:10.933607+0000","last_undegraded":"2024-04-26T23:27:10.933607+0000","last_fullsized":"2024-04-26T23:27:10.933607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.665028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.954544+0000","last_change":"2024-04-26T23:27:08.930957+0000","last_active":"2024-04-26T23:27:09.954544+0000","last_peered":"2024-04-26T23:27:09.954544+0000","last_clean":"2024-04-26T23:27:09.954544+0000","last_became_active":"2024-04-26T23:27:08.930665+0000","last_became_peered":"2024-04-26T23:27:08.930665+0000","last_unstale":"2024-04-26T23:27:09.954544+0000","last_undegraded":"2024-04-26T23:27:09.954544+0000","last_fullsized":"2024-04-26T23:27:09.954544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:46.298782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.943708+0000","last_change":"2024-04-26T23:27:09.937452+0000","last_active":"2024-04-26T23:27:09.943708+0000","last_peered":"2024-04-26T23:27:09.943708+0000","last_clean":"2024-04-26T23:27:09.943708+0000","last_became_active":"2024-04-26T23:27:09.936476+0000","last_became_peered":"2024-04-26T23:27:09.936476+0000","last_unstale":"2024-04-26T23:27:09.943708+0000","last_undegraded":"2024-04-26T23:27:09.943708+0000","last_fullsized":"2024-04-26T23:27:09.943708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913925+0000","last_change":"2024-04-26T23:27:08.912847+0000","last_active":"2024-04-26T23:27:10.913925+0000","last_peered":"2024-04-26T23:27:10.913925+0000","last_clean":"2024-04-26T23:27:10.913925+0000","last_became_active":"2024-04-26T23:27:08.912595+0000","last_became_peered":"2024-04-26T23:27:08.912595+0000","last_unstale":"2024-04-26T23:27:10.913925+0000","last_undegraded":"2024-04-26T23:27:10.913925+0000","last_fullsized":"2024-04-26T23:27:10.913925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:18:30.778764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912881+0000","last_change":"2024-04-26T23:27:09.925166+0000","last_active":"2024-04-26T23:27:10.912881+0000","last_peered":"2024-04-26T23:27:10.912881+0000","last_clean":"2024-04-26T23:27:10.912881+0000","last_became_active":"2024-04-26T23:27:09.924864+0000","last_became_peered":"2024-04-26T23:27:09.924864+0000","last_unstale":"2024-04-26T23:27:10.912881+0000","last_undegraded":"2024-04-26T23:27:10.912881+0000","last_fullsized":"2024-04-26T23:27:10.912881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:35.363989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913319+0000","last_change":"2024-04-26T23:27:08.912474+0000","last_active":"2024-04-26T23:27:10.913319+0000","last_peered":"2024-04-26T23:27:10.913319+0000","last_clean":"2024-04-26T23:27:10.913319+0000","last_became_active":"2024-04-26T23:27:08.912150+0000","last_became_peered":"2024-04-26T23:27:08.912150+0000","last_unstale":"2024-04-26T23:27:10.913319+0000","last_undegraded":"2024-04-26T23:27:10.913319+0000","last_fullsized":"2024-04-26T23:27:10.913319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:32.477951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912747+0000","last_change":"2024-04-26T23:27:09.930189+0000","last_active":"2024-04-26T23:27:10.912747+0000","last_peered":"2024-04-26T23:27:10.912747+0000","last_clean":"2024-04-26T23:27:10.912747+0000","last_became_active":"2024-04-26T23:27:09.929926+0000","last_became_peered":"2024-04-26T23:27:09.929926+0000","last_unstale":"2024-04-26T23:27:10.912747+0000","last_undegraded":"2024-04-26T23:27:10.912747+0000","last_fullsized":"2024-04-26T23:27:10.912747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:52.198195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140591+0000","last_change":"2024-04-26T23:27:08.926275+0000","last_active":"2024-04-26T23:27:11.140591+0000","last_peered":"2024-04-26T23:27:11.140591+0000","last_clean":"2024-04-26T23:27:11.140591+0000","last_became_active":"2024-04-26T23:27:08.925985+0000","last_became_peered":"2024-04-26T23:27:08.925985+0000","last_unstale":"2024-04-26T23:27:11.140591+0000","last_undegraded":"2024-04-26T23:27:11.140591+0000","last_fullsized":"2024-04-26T23:27:11.140591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933066+0000","last_change":"2024-04-26T23:27:09.934919+0000","last_active":"2024-04-26T23:27:10.933066+0000","last_peered":"2024-04-26T23:27:10.933066+0000","last_clean":"2024-04-26T23:27:10.933066+0000","last_became_active":"2024-04-26T23:27:09.934624+0000","last_became_peered":"2024-04-26T23:27:09.934624+0000","last_unstale":"2024-04-26T23:27:10.933066+0000","last_undegraded":"2024-04-26T23:27:10.933066+0000","last_fullsized":"2024-04-26T23:27:10.933066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912747+0000","last_change":"2024-04-26T23:27:08.910731+0000","last_active":"2024-04-26T23:27:10.912747+0000","last_peered":"2024-04-26T23:27:10.912747+0000","last_clean":"2024-04-26T23:27:10.912747+0000","last_became_active":"2024-04-26T23:27:08.910428+0000","last_became_peered":"2024-04-26T23:27:08.910428+0000","last_unstale":"2024-04-26T23:27:10.912747+0000","last_undegraded":"2024-04-26T23:27:10.912747+0000","last_fullsized":"2024-04-26T23:27:10.912747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:48.119825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913121+0000","last_change":"2024-04-26T23:27:09.931133+0000","last_active":"2024-04-26T23:27:10.913121+0000","last_peered":"2024-04-26T23:27:10.913121+0000","last_clean":"2024-04-26T23:27:10.913121+0000","last_became_active":"2024-04-26T23:27:09.930858+0000","last_became_peered":"2024-04-26T23:27:09.930858+0000","last_unstale":"2024-04-26T23:27:10.913121+0000","last_undegraded":"2024-04-26T23:27:10.913121+0000","last_fullsized":"2024-04-26T23:27:10.913121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:12.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140938+0000","last_change":"2024-04-26T23:27:08.923251+0000","last_active":"2024-04-26T23:27:11.140938+0000","last_peered":"2024-04-26T23:27:11.140938+0000","last_clean":"2024-04-26T23:27:11.140938+0000","last_became_active":"2024-04-26T23:27:08.923065+0000","last_became_peered":"2024-04-26T23:27:08.923065+0000","last_unstale":"2024-04-26T23:27:11.140938+0000","last_undegraded":"2024-04-26T23:27:11.140938+0000","last_fullsized":"2024-04-26T23:27:11.140938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:05.408179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141115+0000","last_change":"2024-04-26T23:27:09.931040+0000","last_active":"2024-04-26T23:27:11.141115+0000","last_peered":"2024-04-26T23:27:11.141115+0000","last_clean":"2024-04-26T23:27:11.141115+0000","last_became_active":"2024-04-26T23:27:09.930616+0000","last_became_peered":"2024-04-26T23:27:09.930616+0000","last_unstale":"2024-04-26T23:27:11.141115+0000","last_undegraded":"2024-04-26T23:27:11.141115+0000","last_fullsized":"2024-04-26T23:27:11.141115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:04.982183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911735+0000","last_change":"2024-04-26T23:27:08.918607+0000","last_active":"2024-04-26T23:27:10.911735+0000","last_peered":"2024-04-26T23:27:10.911735+0000","last_clean":"2024-04-26T23:27:10.911735+0000","last_became_active":"2024-04-26T23:27:08.917255+0000","last_became_peered":"2024-04-26T23:27:08.917255+0000","last_unstale":"2024-04-26T23:27:10.911735+0000","last_undegraded":"2024-04-26T23:27:10.911735+0000","last_fullsized":"2024-04-26T23:27:10.911735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:39.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140989+0000","last_change":"2024-04-26T23:27:09.921054+0000","last_active":"2024-04-26T23:27:11.140989+0000","last_peered":"2024-04-26T23:27:11.140989+0000","last_clean":"2024-04-26T23:27:11.140989+0000","last_became_active":"2024-04-26T23:27:09.920764+0000","last_became_peered":"2024-04-26T23:27:09.920764+0000","last_unstale":"2024-04-26T23:27:11.140989+0000","last_undegraded":"2024-04-26T23:27:11.140989+0000","last_fullsized":"2024-04-26T23:27:11.140989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:38.309597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913290+0000","last_change":"2024-04-26T23:27:08.921533+0000","last_active":"2024-04-26T23:27:10.913290+0000","last_peered":"2024-04-26T23:27:10.913290+0000","last_clean":"2024-04-26T23:27:10.913290+0000","last_became_active":"2024-04-26T23:27:08.920943+0000","last_became_peered":"2024-04-26T23:27:08.920943+0000","last_unstale":"2024-04-26T23:27:10.913290+0000","last_undegraded":"2024-04-26T23:27:10.913290+0000","last_fullsized":"2024-04-26T23:27:10.913290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:23.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913183+0000","last_change":"2024-04-26T23:27:09.934940+0000","last_active":"2024-04-26T23:27:10.913183+0000","last_peered":"2024-04-26T23:27:10.913183+0000","last_clean":"2024-04-26T23:27:10.913183+0000","last_became_active":"2024-04-26T23:27:09.934250+0000","last_became_peered":"2024-04-26T23:27:09.934250+0000","last_unstale":"2024-04-26T23:27:10.913183+0000","last_undegraded":"2024-04-26T23:27:10.913183+0000","last_fullsized":"2024-04-26T23:27:10.913183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:43.263519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141128+0000","last_change":"2024-04-26T23:27:08.923041+0000","last_active":"2024-04-26T23:27:11.141128+0000","last_peered":"2024-04-26T23:27:11.141128+0000","last_clean":"2024-04-26T23:27:11.141128+0000","last_became_active":"2024-04-26T23:27:08.922694+0000","last_became_peered":"2024-04-26T23:27:08.922694+0000","last_unstale":"2024-04-26T23:27:11.141128+0000","last_undegraded":"2024-04-26T23:27:11.141128+0000","last_fullsized":"2024-04-26T23:27:11.141128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:57.984430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933124+0000","last_change":"2024-04-26T23:27:09.934437+0000","last_active":"2024-04-26T23:27:10.933124+0000","last_peered":"2024-04-26T23:27:10.933124+0000","last_clean":"2024-04-26T23:27:10.933124+0000","last_became_active":"2024-04-26T23:27:09.934149+0000","last_became_peered":"2024-04-26T23:27:09.934149+0000","last_unstale":"2024-04-26T23:27:10.933124+0000","last_undegraded":"2024-04-26T23:27:10.933124+0000","last_fullsized":"2024-04-26T23:27:10.933124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:25.213145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913933+0000","last_change":"2024-04-26T23:27:08.913734+0000","last_active":"2024-04-26T23:27:10.913933+0000","last_peered":"2024-04-26T23:27:10.913933+0000","last_clean":"2024-04-26T23:27:10.913933+0000","last_became_active":"2024-04-26T23:27:08.910315+0000","last_became_peered":"2024-04-26T23:27:08.910315+0000","last_unstale":"2024-04-26T23:27:10.913933+0000","last_undegraded":"2024-04-26T23:27:10.913933+0000","last_fullsized":"2024-04-26T23:27:10.913933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:25:10.743763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140873+0000","last_change":"2024-04-26T23:27:09.923892+0000","last_active":"2024-04-26T23:27:11.140873+0000","last_peered":"2024-04-26T23:27:11.140873+0000","last_clean":"2024-04-26T23:27:11.140873+0000","last_became_active":"2024-04-26T23:27:09.923571+0000","last_became_peered":"2024-04-26T23:27:09.923571+0000","last_unstale":"2024-04-26T23:27:11.140873+0000","last_undegraded":"2024-04-26T23:27:11.140873+0000","last_fullsized":"2024-04-26T23:27:11.140873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:43.263519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933132+0000","last_change":"2024-04-26T23:27:08.918002+0000","last_active":"2024-04-26T23:27:10.933132+0000","last_peered":"2024-04-26T23:27:10.933132+0000","last_clean":"2024-04-26T23:27:10.933132+0000","last_became_active":"2024-04-26T23:27:08.917718+0000","last_became_peered":"2024-04-26T23:27:08.917718+0000","last_unstale":"2024-04-26T23:27:10.933132+0000","last_undegraded":"2024-04-26T23:27:10.933132+0000","last_fullsized":"2024-04-26T23:27:10.933132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:39.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942517+0000","last_change":"2024-04-26T23:27:09.936384+0000","last_active":"2024-04-26T23:27:09.942517+0000","last_peered":"2024-04-26T23:27:09.942517+0000","last_clean":"2024-04-26T23:27:09.942517+0000","last_became_active":"2024-04-26T23:27:09.936114+0000","last_became_peered":"2024-04-26T23:27:09.936114+0000","last_unstale":"2024-04-26T23:27:09.942517+0000","last_undegraded":"2024-04-26T23:27:09.942517+0000","last_fullsized":"2024-04-26T23:27:09.942517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140876+0000","last_change":"2024-04-26T23:27:08.920104+0000","last_active":"2024-04-26T23:27:11.140876+0000","last_peered":"2024-04-26T23:27:11.140876+0000","last_clean":"2024-04-26T23:27:11.140876+0000","last_became_active":"2024-04-26T23:27:08.919735+0000","last_became_peered":"2024-04-26T23:27:08.919735+0000","last_unstale":"2024-04-26T23:27:11.140876+0000","last_undegraded":"2024-04-26T23:27:11.140876+0000","last_fullsized":"2024-04-26T23:27:11.140876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:25.283660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939504+0000","last_change":"2024-04-26T23:27:09.935666+0000","last_active":"2024-04-26T23:27:09.939504+0000","last_peered":"2024-04-26T23:27:09.939504+0000","last_clean":"2024-04-26T23:27:09.939504+0000","last_became_active":"2024-04-26T23:27:09.935331+0000","last_became_peered":"2024-04-26T23:27:09.935331+0000","last_unstale":"2024-04-26T23:27:09.939504+0000","last_undegraded":"2024-04-26T23:27:09.939504+0000","last_fullsized":"2024-04-26T23:27:09.939504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:30.572938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140663+0000","last_change":"2024-04-26T23:27:08.922845+0000","last_active":"2024-04-26T23:27:11.140663+0000","last_peered":"2024-04-26T23:27:11.140663+0000","last_clean":"2024-04-26T23:27:11.140663+0000","last_became_active":"2024-04-26T23:27:08.922539+0000","last_became_peered":"2024-04-26T23:27:08.922539+0000","last_unstale":"2024-04-26T23:27:11.140663+0000","last_undegraded":"2024-04-26T23:27:11.140663+0000","last_fullsized":"2024-04-26T23:27:11.140663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913843+0000","last_change":"2024-04-26T23:27:09.924470+0000","last_active":"2024-04-26T23:27:10.913843+0000","last_peered":"2024-04-26T23:27:10.913843+0000","last_clean":"2024-04-26T23:27:10.913843+0000","last_became_active":"2024-04-26T23:27:09.924144+0000","last_became_peered":"2024-04-26T23:27:09.924144+0000","last_unstale":"2024-04-26T23:27:10.913843+0000","last_undegraded":"2024-04-26T23:27:10.913843+0000","last_fullsized":"2024-04-26T23:27:10.913843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933749+0000","last_change":"2024-04-26T23:27:08.924793+0000","last_active":"2024-04-26T23:27:10.933749+0000","last_peered":"2024-04-26T23:27:10.933749+0000","last_clean":"2024-04-26T23:27:10.933749+0000","last_became_active":"2024-04-26T23:27:08.924509+0000","last_became_peered":"2024-04-26T23:27:08.924509+0000","last_unstale":"2024-04-26T23:27:10.933749+0000","last_undegraded":"2024-04-26T23:27:10.933749+0000","last_fullsized":"2024-04-26T23:27:10.933749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913310+0000","last_change":"2024-04-26T23:27:09.931233+0000","last_active":"2024-04-26T23:27:10.913310+0000","last_peered":"2024-04-26T23:27:10.913310+0000","last_clean":"2024-04-26T23:27:10.913310+0000","last_became_active":"2024-04-26T23:27:09.930524+0000","last_became_peered":"2024-04-26T23:27:09.930524+0000","last_unstale":"2024-04-26T23:27:10.913310+0000","last_undegraded":"2024-04-26T23:27:10.913310+0000","last_fullsized":"2024-04-26T23:27:10.913310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:58.263273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913865+0000","last_change":"2024-04-26T23:27:08.906935+0000","last_active":"2024-04-26T23:27:10.913865+0000","last_peered":"2024-04-26T23:27:10.913865+0000","last_clean":"2024-04-26T23:27:10.913865+0000","last_became_active":"2024-04-26T23:27:08.906351+0000","last_became_peered":"2024-04-26T23:27:08.906351+0000","last_unstale":"2024-04-26T23:27:10.913865+0000","last_undegraded":"2024-04-26T23:27:10.913865+0000","last_fullsized":"2024-04-26T23:27:10.913865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:33.671788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933467+0000","last_change":"2024-04-26T23:27:09.939514+0000","last_active":"2024-04-26T23:27:10.933467+0000","last_peered":"2024-04-26T23:27:10.933467+0000","last_clean":"2024-04-26T23:27:10.933467+0000","last_became_active":"2024-04-26T23:27:09.939101+0000","last_became_peered":"2024-04-26T23:27:09.939101+0000","last_unstale":"2024-04-26T23:27:10.933467+0000","last_undegraded":"2024-04-26T23:27:10.933467+0000","last_fullsized":"2024-04-26T23:27:10.933467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913851+0000","last_change":"2024-04-26T23:27:08.926551+0000","last_active":"2024-04-26T23:27:10.913851+0000","last_peered":"2024-04-26T23:27:10.913851+0000","last_clean":"2024-04-26T23:27:10.913851+0000","last_became_active":"2024-04-26T23:27:08.926242+0000","last_became_peered":"2024-04-26T23:27:08.926242+0000","last_unstale":"2024-04-26T23:27:10.913851+0000","last_undegraded":"2024-04-26T23:27:10.913851+0000","last_fullsized":"2024-04-26T23:27:10.913851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:34.552046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942203+0000","last_change":"2024-04-26T23:27:09.933361+0000","last_active":"2024-04-26T23:27:09.942203+0000","last_peered":"2024-04-26T23:27:09.942203+0000","last_clean":"2024-04-26T23:27:09.942203+0000","last_became_active":"2024-04-26T23:27:09.933032+0000","last_became_peered":"2024-04-26T23:27:09.933032+0000","last_unstale":"2024-04-26T23:27:09.942203+0000","last_undegraded":"2024-04-26T23:27:09.942203+0000","last_fullsized":"2024-04-26T23:27:09.942203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:49.130153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913941+0000","last_change":"2024-04-26T23:27:08.914423+0000","last_active":"2024-04-26T23:27:10.913941+0000","last_peered":"2024-04-26T23:27:10.913941+0000","last_clean":"2024-04-26T23:27:10.913941+0000","last_became_active":"2024-04-26T23:27:08.914097+0000","last_became_peered":"2024-04-26T23:27:08.914097+0000","last_unstale":"2024-04-26T23:27:10.913941+0000","last_undegraded":"2024-04-26T23:27:10.913941+0000","last_fullsized":"2024-04-26T23:27:10.913941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:40.423793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.936990+0000","last_change":"2024-04-26T23:27:09.928823+0000","last_active":"2024-04-26T23:27:09.936990+0000","last_peered":"2024-04-26T23:27:09.936990+0000","last_clean":"2024-04-26T23:27:09.936990+0000","last_became_active":"2024-04-26T23:27:09.928516+0000","last_became_peered":"2024-04-26T23:27:09.928516+0000","last_unstale":"2024-04-26T23:27:09.936990+0000","last_undegraded":"2024-04-26T23:27:09.936990+0000","last_fullsized":"2024-04-26T23:27:09.936990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:41:22.031784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911934+0000","last_change":"2024-04-26T23:27:08.917301+0000","last_active":"2024-04-26T23:27:10.911934+0000","last_peered":"2024-04-26T23:27:10.911934+0000","last_clean":"2024-04-26T23:27:10.911934+0000","last_became_active":"2024-04-26T23:27:08.916264+0000","last_became_peered":"2024-04-26T23:27:08.916264+0000","last_unstale":"2024-04-26T23:27:10.911934+0000","last_undegraded":"2024-04-26T23:27:10.911934+0000","last_fullsized":"2024-04-26T23:27:10.911934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942779+0000","last_change":"2024-04-26T23:27:09.937518+0000","last_active":"2024-04-26T23:27:09.942779+0000","last_peered":"2024-04-26T23:27:09.942779+0000","last_clean":"2024-04-26T23:27:09.942779+0000","last_became_active":"2024-04-26T23:27:09.935464+0000","last_became_peered":"2024-04-26T23:27:09.935464+0000","last_unstale":"2024-04-26T23:27:09.942779+0000","last_undegraded":"2024-04-26T23:27:09.942779+0000","last_fullsized":"2024-04-26T23:27:09.942779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:23.284058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.927248+0000","last_change":"2024-04-26T23:27:08.922642+0000","last_active":"2024-04-26T23:27:09.927248+0000","last_peered":"2024-04-26T23:27:09.927248+0000","last_clean":"2024-04-26T23:27:09.927248+0000","last_became_active":"2024-04-26T23:27:08.922292+0000","last_became_peered":"2024-04-26T23:27:08.922292+0000","last_unstale":"2024-04-26T23:27:09.927248+0000","last_undegraded":"2024-04-26T23:27:09.927248+0000","last_fullsized":"2024-04-26T23:27:09.927248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:34.552046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942108+0000","last_change":"2024-04-26T23:27:09.932305+0000","last_active":"2024-04-26T23:27:09.942108+0000","last_peered":"2024-04-26T23:27:09.942108+0000","last_clean":"2024-04-26T23:27:09.942108+0000","last_became_active":"2024-04-26T23:27:09.931955+0000","last_became_peered":"2024-04-26T23:27:09.931955+0000","last_unstale":"2024-04-26T23:27:09.942108+0000","last_undegraded":"2024-04-26T23:27:09.942108+0000","last_fullsized":"2024-04-26T23:27:09.942108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:53.579228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912689+0000","last_change":"2024-04-26T23:27:08.919985+0000","last_active":"2024-04-26T23:27:10.912689+0000","last_peered":"2024-04-26T23:27:10.912689+0000","last_clean":"2024-04-26T23:27:10.912689+0000","last_became_active":"2024-04-26T23:27:08.919629+0000","last_became_peered":"2024-04-26T23:27:08.919629+0000","last_unstale":"2024-04-26T23:27:10.912689+0000","last_undegraded":"2024-04-26T23:27:10.912689+0000","last_fullsized":"2024-04-26T23:27:10.912689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:22.273730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942813+0000","last_change":"2024-04-26T23:27:09.940421+0000","last_active":"2024-04-26T23:27:09.942813+0000","last_peered":"2024-04-26T23:27:09.942813+0000","last_clean":"2024-04-26T23:27:09.942813+0000","last_became_active":"2024-04-26T23:27:09.940138+0000","last_became_peered":"2024-04-26T23:27:09.940138+0000","last_unstale":"2024-04-26T23:27:09.942813+0000","last_undegraded":"2024-04-26T23:27:09.942813+0000","last_fullsized":"2024-04-26T23:27:09.942813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:25.213145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912956+0000","last_change":"2024-04-26T23:27:08.919314+0000","last_active":"2024-04-26T23:27:10.912956+0000","last_peered":"2024-04-26T23:27:10.912956+0000","last_clean":"2024-04-26T23:27:10.912956+0000","last_became_active":"2024-04-26T23:27:08.918983+0000","last_became_peered":"2024-04-26T23:27:08.918983+0000","last_unstale":"2024-04-26T23:27:10.912956+0000","last_undegraded":"2024-04-26T23:27:10.912956+0000","last_fullsized":"2024-04-26T23:27:10.912956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:25.283660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.937285+0000","last_change":"2024-04-26T23:27:09.930631+0000","last_active":"2024-04-26T23:27:09.937285+0000","last_peered":"2024-04-26T23:27:09.937285+0000","last_clean":"2024-04-26T23:27:09.937285+0000","last_became_active":"2024-04-26T23:27:09.930167+0000","last_became_peered":"2024-04-26T23:27:09.930167+0000","last_unstale":"2024-04-26T23:27:09.937285+0000","last_undegraded":"2024-04-26T23:27:09.937285+0000","last_fullsized":"2024-04-26T23:27:09.937285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:22.101308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933844+0000","last_change":"2024-04-26T23:27:08.919002+0000","last_active":"2024-04-26T23:27:10.933844+0000","last_peered":"2024-04-26T23:27:10.933844+0000","last_clean":"2024-04-26T23:27:10.933844+0000","last_became_active":"2024-04-26T23:27:08.915778+0000","last_became_peered":"2024-04-26T23:27:08.915778+0000","last_unstale":"2024-04-26T23:27:10.933844+0000","last_undegraded":"2024-04-26T23:27:10.933844+0000","last_fullsized":"2024-04-26T23:27:10.933844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913465+0000","last_change":"2024-04-26T23:27:09.935344+0000","last_active":"2024-04-26T23:27:10.913465+0000","last_peered":"2024-04-26T23:27:10.913465+0000","last_clean":"2024-04-26T23:27:10.913465+0000","last_became_active":"2024-04-26T23:27:09.935082+0000","last_became_peered":"2024-04-26T23:27:09.935082+0000","last_unstale":"2024-04-26T23:27:10.913465+0000","last_undegraded":"2024-04-26T23:27:10.913465+0000","last_fullsized":"2024-04-26T23:27:10.913465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:46.127801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.932306+0000","last_change":"2024-04-26T23:27:08.916906+0000","last_active":"2024-04-26T23:27:10.932306+0000","last_peered":"2024-04-26T23:27:10.932306+0000","last_clean":"2024-04-26T23:27:10.932306+0000","last_became_active":"2024-04-26T23:27:08.916623+0000","last_became_peered":"2024-04-26T23:27:08.916623+0000","last_unstale":"2024-04-26T23:27:10.932306+0000","last_undegraded":"2024-04-26T23:27:10.932306+0000","last_fullsized":"2024-04-26T23:27:10.932306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:58.142207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911569+0000","last_change":"2024-04-26T23:27:09.929104+0000","last_active":"2024-04-26T23:27:10.911569+0000","last_peered":"2024-04-26T23:27:10.911569+0000","last_clean":"2024-04-26T23:27:10.911569+0000","last_became_active":"2024-04-26T23:27:09.928804+0000","last_became_peered":"2024-04-26T23:27:09.928804+0000","last_unstale":"2024-04-26T23:27:10.911569+0000","last_undegraded":"2024-04-26T23:27:10.911569+0000","last_fullsized":"2024-04-26T23:27:10.911569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933520+0000","last_change":"2024-04-26T23:27:08.932021+0000","last_active":"2024-04-26T23:27:10.933520+0000","last_peered":"2024-04-26T23:27:10.933520+0000","last_clean":"2024-04-26T23:27:10.933520+0000","last_became_active":"2024-04-26T23:27:08.931692+0000","last_became_peered":"2024-04-26T23:27:08.931692+0000","last_unstale":"2024-04-26T23:27:10.933520+0000","last_undegraded":"2024-04-26T23:27:10.933520+0000","last_fullsized":"2024-04-26T23:27:10.933520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:50.292659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942228+0000","last_change":"2024-04-26T23:27:09.936856+0000","last_active":"2024-04-26T23:27:09.942228+0000","last_peered":"2024-04-26T23:27:09.942228+0000","last_clean":"2024-04-26T23:27:09.942228+0000","last_became_active":"2024-04-26T23:27:09.932210+0000","last_became_peered":"2024-04-26T23:27:09.932210+0000","last_unstale":"2024-04-26T23:27:09.942228+0000","last_undegraded":"2024-04-26T23:27:09.942228+0000","last_fullsized":"2024-04-26T23:27:09.942228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:59.152536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912049+0000","last_change":"2024-04-26T23:27:08.906719+0000","last_active":"2024-04-26T23:27:10.912049+0000","last_peered":"2024-04-26T23:27:10.912049+0000","last_clean":"2024-04-26T23:27:10.912049+0000","last_became_active":"2024-04-26T23:27:08.906421+0000","last_became_peered":"2024-04-26T23:27:08.906421+0000","last_unstale":"2024-04-26T23:27:10.912049+0000","last_undegraded":"2024-04-26T23:27:10.912049+0000","last_fullsized":"2024-04-26T23:27:10.912049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911974+0000","last_change":"2024-04-26T23:27:09.928066+0000","last_active":"2024-04-26T23:27:10.911974+0000","last_peered":"2024-04-26T23:27:10.911974+0000","last_clean":"2024-04-26T23:27:10.911974+0000","last_became_active":"2024-04-26T23:27:09.927709+0000","last_became_peered":"2024-04-26T23:27:09.927709+0000","last_unstale":"2024-04-26T23:27:10.911974+0000","last_undegraded":"2024-04-26T23:27:10.911974+0000","last_fullsized":"2024-04-26T23:27:10.911974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933229+0000","last_change":"2024-04-26T23:27:08.921793+0000","last_active":"2024-04-26T23:27:10.933229+0000","last_peered":"2024-04-26T23:27:10.933229+0000","last_clean":"2024-04-26T23:27:10.933229+0000","last_became_active":"2024-04-26T23:27:08.921004+0000","last_became_peered":"2024-04-26T23:27:08.921004+0000","last_unstale":"2024-04-26T23:27:10.933229+0000","last_undegraded":"2024-04-26T23:27:10.933229+0000","last_fullsized":"2024-04-26T23:27:10.933229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:58.142207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140666+0000","last_change":"2024-04-26T23:27:09.933602+0000","last_active":"2024-04-26T23:27:11.140666+0000","last_peered":"2024-04-26T23:27:11.140666+0000","last_clean":"2024-04-26T23:27:11.140666+0000","last_became_active":"2024-04-26T23:27:09.932021+0000","last_became_peered":"2024-04-26T23:27:09.932021+0000","last_unstale":"2024-04-26T23:27:11.140666+0000","last_undegraded":"2024-04-26T23:27:11.140666+0000","last_fullsized":"2024-04-26T23:27:11.140666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:35.363989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912805+0000","last_change":"2024-04-26T23:27:08.912662+0000","last_active":"2024-04-26T23:27:10.912805+0000","last_peered":"2024-04-26T23:27:10.912805+0000","last_clean":"2024-04-26T23:27:10.912805+0000","last_became_active":"2024-04-26T23:27:08.912371+0000","last_became_peered":"2024-04-26T23:27:08.912371+0000","last_unstale":"2024-04-26T23:27:10.912805+0000","last_undegraded":"2024-04-26T23:27:10.912805+0000","last_fullsized":"2024-04-26T23:27:10.912805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:59.405108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912566+0000","last_change":"2024-04-26T23:27:09.935477+0000","last_active":"2024-04-26T23:27:10.912566+0000","last_peered":"2024-04-26T23:27:10.912566+0000","last_clean":"2024-04-26T23:27:10.912566+0000","last_became_active":"2024-04-26T23:27:09.935144+0000","last_became_peered":"2024-04-26T23:27:09.935144+0000","last_unstale":"2024-04-26T23:27:10.912566+0000","last_undegraded":"2024-04-26T23:27:10.912566+0000","last_fullsized":"2024-04-26T23:27:10.912566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:24.851596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140789+0000","last_change":"2024-04-26T23:27:08.919022+0000","last_active":"2024-04-26T23:27:11.140789+0000","last_peered":"2024-04-26T23:27:11.140789+0000","last_clean":"2024-04-26T23:27:11.140789+0000","last_became_active":"2024-04-26T23:27:08.918759+0000","last_became_peered":"2024-04-26T23:27:08.918759+0000","last_unstale":"2024-04-26T23:27:11.140789+0000","last_undegraded":"2024-04-26T23:27:11.140789+0000","last_fullsized":"2024-04-26T23:27:11.140789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:23.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.944406+0000","last_change":"2024-04-26T23:27:09.940774+0000","last_active":"2024-04-26T23:27:09.944406+0000","last_peered":"2024-04-26T23:27:09.944406+0000","last_clean":"2024-04-26T23:27:09.944406+0000","last_became_active":"2024-04-26T23:27:09.940387+0000","last_became_peered":"2024-04-26T23:27:09.940387+0000","last_unstale":"2024-04-26T23:27:09.944406+0000","last_undegraded":"2024-04-26T23:27:09.944406+0000","last_fullsized":"2024-04-26T23:27:09.944406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:29.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.927451+0000","last_change":"2024-04-26T23:27:08.917192+0000","last_active":"2024-04-26T23:27:09.927451+0000","last_peered":"2024-04-26T23:27:09.927451+0000","last_clean":"2024-04-26T23:27:09.927451+0000","last_became_active":"2024-04-26T23:27:08.916853+0000","last_became_peered":"2024-04-26T23:27:08.916853+0000","last_unstale":"2024-04-26T23:27:09.927451+0000","last_undegraded":"2024-04-26T23:27:09.927451+0000","last_fullsized":"2024-04-26T23:27:09.927451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:47.824670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.921608+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:09.921608+0000","last_peered":"2024-04-26T23:27:09.921608+0000","last_clean":"2024-04-26T23:27:09.921608+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:09.921608+0000","last_undegraded":"2024-04-26T23:27:09.921608+0000","last_fullsized":"2024-04-26T23:27:09.921608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":141942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":140378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:14.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:14.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 Processor -- start 2024-04-26T23:27:14.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 -- start start 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21040b09f0 0x7f210406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f21040cc0d0 0x7f210406f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21040b0e80 con 0x7f2104157940 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2104068140 con 0x7f21040cc0d0 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f210b600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2104068390 con 0x7f21040b09f0 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2109600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f21040cc0d0 0x7f210406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2108c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2104157940 0x7f21040cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39974/0 (socket says 172.21.15.39:39974) 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2108c00640 1 -- 172.21.15.39:0/1500395361 learned_addr learned my addr 172.21.15.39:0/1500395361 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2103e00640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21040b09f0 0x7f210406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2109600640 1 -- 172.21.15.39:0/1500395361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21040b09f0 msgr2=0x7f210406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2109600640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21040b09f0 0x7f210406c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2109600640 1 -- 172.21.15.39:0/1500395361 >> v1:172.21.15.39:6789/0 conn(0x7f2104157940 legacy=0x7f21040cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.224+0000 7f2109600640 1 -- 172.21.15.39:0/1500395361 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2104068670 con 0x7f21040cc0d0 2024-04-26T23:27:14.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f2109600640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210406f420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21040682c0 tx=0x7f20fc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c31df538bb39d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f2103400640 1 -- 172.21.15.39:0/1500395361 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0b2070 con 0x7f21040cc0d0 2024-04-26T23:27:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f2103400640 1 -- 172.21.15.39:0/1500395361 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc0a5780 con 0x7f21040cc0d0 2024-04-26T23:27:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f2103400640 1 -- 172.21.15.39:0/1500395361 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0a5b50 con 0x7f21040cc0d0 2024-04-26T23:27:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 -- 172.21.15.39:0/1500395361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 msgr2=0x7f210406f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210406f420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21040682c0 tx=0x7f20fc01c8c0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 -- 172.21.15.39:0/1500395361 shutdown_connections 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210406f420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 --2- 172.21.15.39:0/1500395361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21040b09f0 0x7f210406c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 -- 172.21.15.39:0/1500395361 >> 172.21.15.39:0/1500395361 conn(0x7f21040ce070 msgr2=0x7f21040ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 -- 172.21.15.39:0/1500395361 shutdown_connections 2024-04-26T23:27:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 -- 172.21.15.39:0/1500395361 wait complete. 2024-04-26T23:27:14.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.228+0000 7f210b600640 1 Processor -- start 2024-04-26T23:27:14.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- start start 2024-04-26T23:27:14.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2104157940 0x7f210415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2104148280 0x7f2104157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f210416a400 con 0x7f21040cc0d0 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f210416a280 con 0x7f2104157940 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f210416a580 con 0x7f2104148280 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33160/0 (socket says 172.21.15.39:33160) 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 -- 172.21.15.39:0/4083487889 learned_addr learned my addr 172.21.15.39:0/4083487889 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2109600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2104148280 0x7f2104157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2103e00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2104157940 0x7f210415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 -- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2104148280 msgr2=0x7f2104157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2104148280 0x7f2104157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 -- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2104157940 msgr2=0x7f210415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2104157940 0x7f210415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 -- 172.21.15.39:0/4083487889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210414f6e0 con 0x7f21040cc0d0 2024-04-26T23:27:14.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2108c00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c3a0 tx=0x7f20f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8017070 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8005cf0 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80072f0 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21041586d0 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21040b4e90 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.232+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2104050740 con 0x7f21040cc0d0 2024-04-26T23:27:14.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.236+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20f801a070 con 0x7f21040cc0d0 2024-04-26T23:27:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.236+0000 7f2100c00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 0x7f20e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.236+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f20f8085d70 con 0x7f21040cc0d0 2024-04-26T23:27:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.236+0000 7f2103e00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 0x7f20e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.236+0000 7f2103e00640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 0x7f20e406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2104069d80 tx=0x7f20f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.240+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f20f8056310 con 0x7f21040cc0d0 2024-04-26T23:27:14.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.400+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21040cba90 con 0x7f20e40683b0 2024-04-26T23:27:14.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.404+0000 7f2100c00640 1 -- 172.21.15.39:0/4083487889 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f21040cba90 con 0x7f20e40683b0 2024-04-26T23:27:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:14.416 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 msgr2=0x7f20e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 0x7f20e406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2104069d80 tx=0x7f20f0008040 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 msgr2=0x7f210414f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c3a0 tx=0x7f20f800c860 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 shutdown_connections 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f20e40683b0 0x7f20e406a870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2104148280 0x7f2104157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2104157940 0x7f210415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 --2- 172.21.15.39:0/4083487889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21040cc0d0 0x7f210414f1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 >> 172.21.15.39:0/4083487889 conn(0x7f21040ce070 msgr2=0x7f2104149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:14.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 shutdown_connections 2024-04-26T23:27:14.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.408+0000 7f210b600640 1 -- 172.21.15.39:0/4083487889 wait complete. 2024-04-26T23:27:14.435 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-26T23:27:13.670712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232756,"kb_used_data":4076,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741964,"statfs":{"total":773094113280,"available":772855771136,"internally_reserved":0,"allocated":4173824,"data_stored":2326920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.780336"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942206+0000","last_change":"2024-04-26T23:27:09.936466+0000","last_active":"2024-04-26T23:27:09.942206+0000","last_peered":"2024-04-26T23:27:09.942206+0000","last_clean":"2024-04-26T23:27:09.942206+0000","last_became_active":"2024-04-26T23:27:09.935836+0000","last_became_peered":"2024-04-26T23:27:09.935836+0000","last_unstale":"2024-04-26T23:27:09.942206+0000","last_undegraded":"2024-04-26T23:27:09.942206+0000","last_fullsized":"2024-04-26T23:27:09.942206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:51.302988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141037+0000","last_change":"2024-04-26T23:27:09.924323+0000","last_active":"2024-04-26T23:27:11.141037+0000","last_peered":"2024-04-26T23:27:11.141037+0000","last_clean":"2024-04-26T23:27:11.141037+0000","last_became_active":"2024-04-26T23:27:09.924015+0000","last_became_peered":"2024-04-26T23:27:09.924015+0000","last_unstale":"2024-04-26T23:27:11.141037+0000","last_undegraded":"2024-04-26T23:27:11.141037+0000","last_fullsized":"2024-04-26T23:27:11.141037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:46.127801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913320+0000","last_change":"2024-04-26T23:27:09.937863+0000","last_active":"2024-04-26T23:27:10.913320+0000","last_peered":"2024-04-26T23:27:10.913320+0000","last_clean":"2024-04-26T23:27:10.913320+0000","last_became_active":"2024-04-26T23:27:09.937606+0000","last_became_peered":"2024-04-26T23:27:09.937606+0000","last_unstale":"2024-04-26T23:27:10.913320+0000","last_undegraded":"2024-04-26T23:27:10.913320+0000","last_fullsized":"2024-04-26T23:27:10.913320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:38.309597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933381+0000","last_change":"2024-04-26T23:27:09.939708+0000","last_active":"2024-04-26T23:27:10.933381+0000","last_peered":"2024-04-26T23:27:10.933381+0000","last_clean":"2024-04-26T23:27:10.933381+0000","last_became_active":"2024-04-26T23:27:09.939340+0000","last_became_peered":"2024-04-26T23:27:09.939340+0000","last_unstale":"2024-04-26T23:27:10.933381+0000","last_undegraded":"2024-04-26T23:27:10.933381+0000","last_fullsized":"2024-04-26T23:27:10.933381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:29.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942801+0000","last_change":"2024-04-26T23:27:09.940113+0000","last_active":"2024-04-26T23:27:09.942801+0000","last_peered":"2024-04-26T23:27:09.942801+0000","last_clean":"2024-04-26T23:27:09.942801+0000","last_became_active":"2024-04-26T23:27:09.939816+0000","last_became_peered":"2024-04-26T23:27:09.939816+0000","last_unstale":"2024-04-26T23:27:09.942801+0000","last_undegraded":"2024-04-26T23:27:09.942801+0000","last_fullsized":"2024-04-26T23:27:09.942801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:00.415436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141143+0000","last_change":"2024-04-26T23:27:09.916316+0000","last_active":"2024-04-26T23:27:11.141143+0000","last_peered":"2024-04-26T23:27:11.141143+0000","last_clean":"2024-04-26T23:27:11.141143+0000","last_became_active":"2024-04-26T23:27:09.916014+0000","last_became_peered":"2024-04-26T23:27:09.916014+0000","last_unstale":"2024-04-26T23:27:11.141143+0000","last_undegraded":"2024-04-26T23:27:11.141143+0000","last_fullsized":"2024-04-26T23:27:11.141143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.073031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942802+0000","last_change":"2024-04-26T23:27:09.937279+0000","last_active":"2024-04-26T23:27:09.942802+0000","last_peered":"2024-04-26T23:27:09.942802+0000","last_clean":"2024-04-26T23:27:09.942802+0000","last_became_active":"2024-04-26T23:27:09.936906+0000","last_became_peered":"2024-04-26T23:27:09.936906+0000","last_unstale":"2024-04-26T23:27:09.942802+0000","last_undegraded":"2024-04-26T23:27:09.942802+0000","last_fullsized":"2024-04-26T23:27:09.942802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939229+0000","last_change":"2024-04-26T23:27:09.933657+0000","last_active":"2024-04-26T23:27:09.939229+0000","last_peered":"2024-04-26T23:27:09.939229+0000","last_clean":"2024-04-26T23:27:09.939229+0000","last_became_active":"2024-04-26T23:27:09.933371+0000","last_became_peered":"2024-04-26T23:27:09.933371+0000","last_unstale":"2024-04-26T23:27:09.939229+0000","last_undegraded":"2024-04-26T23:27:09.939229+0000","last_fullsized":"2024-04-26T23:27:09.939229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:52.198195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913861+0000","last_change":"2024-04-26T23:27:09.931196+0000","last_active":"2024-04-26T23:27:10.913861+0000","last_peered":"2024-04-26T23:27:10.913861+0000","last_clean":"2024-04-26T23:27:10.913861+0000","last_became_active":"2024-04-26T23:27:09.930946+0000","last_became_peered":"2024-04-26T23:27:09.930946+0000","last_unstale":"2024-04-26T23:27:10.913861+0000","last_undegraded":"2024-04-26T23:27:10.913861+0000","last_fullsized":"2024-04-26T23:27:10.913861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933452+0000","last_change":"2024-04-26T23:27:09.937649+0000","last_active":"2024-04-26T23:27:10.933452+0000","last_peered":"2024-04-26T23:27:10.933452+0000","last_clean":"2024-04-26T23:27:10.933452+0000","last_became_active":"2024-04-26T23:27:09.936365+0000","last_became_peered":"2024-04-26T23:27:09.936365+0000","last_unstale":"2024-04-26T23:27:10.933452+0000","last_undegraded":"2024-04-26T23:27:10.933452+0000","last_fullsized":"2024-04-26T23:27:10.933452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:36.302202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.945248+0000","last_change":"2024-04-26T23:27:09.942890+0000","last_active":"2024-04-26T23:27:09.945248+0000","last_peered":"2024-04-26T23:27:09.945248+0000","last_clean":"2024-04-26T23:27:09.945248+0000","last_became_active":"2024-04-26T23:27:09.942583+0000","last_became_peered":"2024-04-26T23:27:09.942583+0000","last_unstale":"2024-04-26T23:27:09.945248+0000","last_undegraded":"2024-04-26T23:27:09.945248+0000","last_fullsized":"2024-04-26T23:27:09.945248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912689+0000","last_change":"2024-04-26T23:27:09.924165+0000","last_active":"2024-04-26T23:27:10.912689+0000","last_peered":"2024-04-26T23:27:10.912689+0000","last_clean":"2024-04-26T23:27:10.912689+0000","last_became_active":"2024-04-26T23:27:09.923908+0000","last_became_peered":"2024-04-26T23:27:09.923908+0000","last_unstale":"2024-04-26T23:27:10.912689+0000","last_undegraded":"2024-04-26T23:27:10.912689+0000","last_fullsized":"2024-04-26T23:27:10.912689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:20.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942050+0000","last_change":"2024-04-26T23:27:09.931378+0000","last_active":"2024-04-26T23:27:09.942050+0000","last_peered":"2024-04-26T23:27:09.942050+0000","last_clean":"2024-04-26T23:27:09.942050+0000","last_became_active":"2024-04-26T23:27:09.931067+0000","last_became_peered":"2024-04-26T23:27:09.931067+0000","last_unstale":"2024-04-26T23:27:09.942050+0000","last_undegraded":"2024-04-26T23:27:09.942050+0000","last_fullsized":"2024-04-26T23:27:09.942050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:59.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140878+0000","last_change":"2024-04-26T23:27:09.933771+0000","last_active":"2024-04-26T23:27:11.140878+0000","last_peered":"2024-04-26T23:27:11.140878+0000","last_clean":"2024-04-26T23:27:11.140878+0000","last_became_active":"2024-04-26T23:27:09.933477+0000","last_became_peered":"2024-04-26T23:27:09.933477+0000","last_unstale":"2024-04-26T23:27:11.140878+0000","last_undegraded":"2024-04-26T23:27:11.140878+0000","last_fullsized":"2024-04-26T23:27:11.140878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:12.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912634+0000","last_change":"2024-04-26T23:27:09.931262+0000","last_active":"2024-04-26T23:27:10.912634+0000","last_peered":"2024-04-26T23:27:10.912634+0000","last_clean":"2024-04-26T23:27:10.912634+0000","last_became_active":"2024-04-26T23:27:09.930949+0000","last_became_peered":"2024-04-26T23:27:09.930949+0000","last_unstale":"2024-04-26T23:27:10.912634+0000","last_undegraded":"2024-04-26T23:27:10.912634+0000","last_fullsized":"2024-04-26T23:27:10.912634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:20.969719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942704+0000","last_change":"2024-04-26T23:27:09.937103+0000","last_active":"2024-04-26T23:27:09.942704+0000","last_peered":"2024-04-26T23:27:09.942704+0000","last_clean":"2024-04-26T23:27:09.942704+0000","last_became_active":"2024-04-26T23:27:09.936731+0000","last_became_peered":"2024-04-26T23:27:09.936731+0000","last_unstale":"2024-04-26T23:27:09.942704+0000","last_undegraded":"2024-04-26T23:27:09.942704+0000","last_fullsized":"2024-04-26T23:27:09.942704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942700+0000","last_change":"2024-04-26T23:27:09.941120+0000","last_active":"2024-04-26T23:27:09.942700+0000","last_peered":"2024-04-26T23:27:09.942700+0000","last_clean":"2024-04-26T23:27:09.942700+0000","last_became_active":"2024-04-26T23:27:09.940157+0000","last_became_peered":"2024-04-26T23:27:09.940157+0000","last_unstale":"2024-04-26T23:27:09.942700+0000","last_undegraded":"2024-04-26T23:27:09.942700+0000","last_fullsized":"2024-04-26T23:27:09.942700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:36.302202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141104+0000","last_change":"2024-04-26T23:27:09.931625+0000","last_active":"2024-04-26T23:27:11.141104+0000","last_peered":"2024-04-26T23:27:11.141104+0000","last_clean":"2024-04-26T23:27:11.141104+0000","last_became_active":"2024-04-26T23:27:09.930728+0000","last_became_peered":"2024-04-26T23:27:09.930728+0000","last_unstale":"2024-04-26T23:27:11.141104+0000","last_undegraded":"2024-04-26T23:27:11.141104+0000","last_fullsized":"2024-04-26T23:27:11.141104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:30.807586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140893+0000","last_change":"2024-04-26T23:27:09.931156+0000","last_active":"2024-04-26T23:27:11.140893+0000","last_peered":"2024-04-26T23:27:11.140893+0000","last_clean":"2024-04-26T23:27:11.140893+0000","last_became_active":"2024-04-26T23:27:09.930837+0000","last_became_peered":"2024-04-26T23:27:09.930837+0000","last_unstale":"2024-04-26T23:27:11.140893+0000","last_undegraded":"2024-04-26T23:27:11.140893+0000","last_fullsized":"2024-04-26T23:27:11.140893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:58.263273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.938628+0000","last_change":"2024-04-26T23:27:09.929278+0000","last_active":"2024-04-26T23:27:09.938628+0000","last_peered":"2024-04-26T23:27:09.938628+0000","last_clean":"2024-04-26T23:27:09.938628+0000","last_became_active":"2024-04-26T23:27:09.929075+0000","last_became_peered":"2024-04-26T23:27:09.929075+0000","last_unstale":"2024-04-26T23:27:09.938628+0000","last_undegraded":"2024-04-26T23:27:09.938628+0000","last_fullsized":"2024-04-26T23:27:09.938628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:47.741840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913491+0000","last_change":"2024-04-26T23:27:09.929290+0000","last_active":"2024-04-26T23:27:10.913491+0000","last_peered":"2024-04-26T23:27:10.913491+0000","last_clean":"2024-04-26T23:27:10.913491+0000","last_became_active":"2024-04-26T23:27:09.928953+0000","last_became_peered":"2024-04-26T23:27:09.928953+0000","last_unstale":"2024-04-26T23:27:10.913491+0000","last_undegraded":"2024-04-26T23:27:10.913491+0000","last_fullsized":"2024-04-26T23:27:10.913491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:58.994759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913594+0000","last_change":"2024-04-26T23:27:09.935027+0000","last_active":"2024-04-26T23:27:10.913594+0000","last_peered":"2024-04-26T23:27:10.913594+0000","last_clean":"2024-04-26T23:27:10.913594+0000","last_became_active":"2024-04-26T23:27:09.934637+0000","last_became_peered":"2024-04-26T23:27:09.934637+0000","last_unstale":"2024-04-26T23:27:10.913594+0000","last_undegraded":"2024-04-26T23:27:10.913594+0000","last_fullsized":"2024-04-26T23:27:10.913594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911457+0000","last_change":"2024-04-26T23:27:09.927064+0000","last_active":"2024-04-26T23:27:10.911457+0000","last_peered":"2024-04-26T23:27:10.911457+0000","last_clean":"2024-04-26T23:27:10.911457+0000","last_became_active":"2024-04-26T23:27:09.926741+0000","last_became_peered":"2024-04-26T23:27:09.926741+0000","last_unstale":"2024-04-26T23:27:10.911457+0000","last_undegraded":"2024-04-26T23:27:10.911457+0000","last_fullsized":"2024-04-26T23:27:10.911457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912574+0000","last_change":"2024-04-26T23:27:09.932933+0000","last_active":"2024-04-26T23:27:10.912574+0000","last_peered":"2024-04-26T23:27:10.912574+0000","last_clean":"2024-04-26T23:27:10.912574+0000","last_became_active":"2024-04-26T23:27:09.932635+0000","last_became_peered":"2024-04-26T23:27:09.932635+0000","last_unstale":"2024-04-26T23:27:10.912574+0000","last_undegraded":"2024-04-26T23:27:10.912574+0000","last_fullsized":"2024-04-26T23:27:10.912574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933578+0000","last_change":"2024-04-26T23:27:09.927946+0000","last_active":"2024-04-26T23:27:10.933578+0000","last_peered":"2024-04-26T23:27:10.933578+0000","last_clean":"2024-04-26T23:27:10.933578+0000","last_became_active":"2024-04-26T23:27:09.927695+0000","last_became_peered":"2024-04-26T23:27:09.927695+0000","last_unstale":"2024-04-26T23:27:10.933578+0000","last_undegraded":"2024-04-26T23:27:10.933578+0000","last_fullsized":"2024-04-26T23:27:10.933578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:20.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141202+0000","last_change":"2024-04-26T23:27:09.921815+0000","last_active":"2024-04-26T23:27:11.141202+0000","last_peered":"2024-04-26T23:27:11.141202+0000","last_clean":"2024-04-26T23:27:11.141202+0000","last_became_active":"2024-04-26T23:27:09.921434+0000","last_became_peered":"2024-04-26T23:27:09.921434+0000","last_unstale":"2024-04-26T23:27:11.141202+0000","last_undegraded":"2024-04-26T23:27:11.141202+0000","last_fullsized":"2024-04-26T23:27:11.141202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:21:52.490755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933488+0000","last_change":"2024-04-26T23:27:09.936245+0000","last_active":"2024-04-26T23:27:10.933488+0000","last_peered":"2024-04-26T23:27:10.933488+0000","last_clean":"2024-04-26T23:27:10.933488+0000","last_became_active":"2024-04-26T23:27:09.935599+0000","last_became_peered":"2024-04-26T23:27:09.935599+0000","last_unstale":"2024-04-26T23:27:10.933488+0000","last_undegraded":"2024-04-26T23:27:10.933488+0000","last_fullsized":"2024-04-26T23:27:10.933488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:20.969719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912871+0000","last_change":"2024-04-26T23:27:09.925591+0000","last_active":"2024-04-26T23:27:10.912871+0000","last_peered":"2024-04-26T23:27:10.912871+0000","last_clean":"2024-04-26T23:27:10.912871+0000","last_became_active":"2024-04-26T23:27:09.925242+0000","last_became_peered":"2024-04-26T23:27:09.925242+0000","last_unstale":"2024-04-26T23:27:10.912871+0000","last_undegraded":"2024-04-26T23:27:10.912871+0000","last_fullsized":"2024-04-26T23:27:10.912871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.665028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913557+0000","last_change":"2024-04-26T23:27:09.936138+0000","last_active":"2024-04-26T23:27:10.913557+0000","last_peered":"2024-04-26T23:27:10.913557+0000","last_clean":"2024-04-26T23:27:10.913557+0000","last_became_active":"2024-04-26T23:27:09.935129+0000","last_became_peered":"2024-04-26T23:27:09.935129+0000","last_unstale":"2024-04-26T23:27:10.913557+0000","last_undegraded":"2024-04-26T23:27:10.913557+0000","last_fullsized":"2024-04-26T23:27:10.913557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.943689+0000","last_change":"2024-04-26T23:27:09.937104+0000","last_active":"2024-04-26T23:27:09.943689+0000","last_peered":"2024-04-26T23:27:09.943689+0000","last_clean":"2024-04-26T23:27:09.943689+0000","last_became_active":"2024-04-26T23:27:09.936828+0000","last_became_peered":"2024-04-26T23:27:09.936828+0000","last_unstale":"2024-04-26T23:27:09.943689+0000","last_undegraded":"2024-04-26T23:27:09.943689+0000","last_fullsized":"2024-04-26T23:27:09.943689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.948066+0000","last_change":"2024-04-26T23:27:09.943377+0000","last_active":"2024-04-26T23:27:09.948066+0000","last_peered":"2024-04-26T23:27:09.948066+0000","last_clean":"2024-04-26T23:27:09.948066+0000","last_became_active":"2024-04-26T23:27:09.943004+0000","last_became_peered":"2024-04-26T23:27:09.943004+0000","last_unstale":"2024-04-26T23:27:09.948066+0000","last_undegraded":"2024-04-26T23:27:09.948066+0000","last_fullsized":"2024-04-26T23:27:09.948066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:55.183221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939243+0000","last_change":"2024-04-26T23:27:09.934983+0000","last_active":"2024-04-26T23:27:09.939243+0000","last_peered":"2024-04-26T23:27:09.939243+0000","last_clean":"2024-04-26T23:27:09.939243+0000","last_became_active":"2024-04-26T23:27:09.934696+0000","last_became_peered":"2024-04-26T23:27:09.934696+0000","last_unstale":"2024-04-26T23:27:09.939243+0000","last_undegraded":"2024-04-26T23:27:09.939243+0000","last_fullsized":"2024-04-26T23:27:09.939243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:58.994759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911680+0000","last_change":"2024-04-26T23:27:09.920896+0000","last_active":"2024-04-26T23:27:10.911680+0000","last_peered":"2024-04-26T23:27:10.911680+0000","last_clean":"2024-04-26T23:27:10.911680+0000","last_became_active":"2024-04-26T23:27:09.920543+0000","last_became_peered":"2024-04-26T23:27:09.920543+0000","last_unstale":"2024-04-26T23:27:10.911680+0000","last_undegraded":"2024-04-26T23:27:10.911680+0000","last_fullsized":"2024-04-26T23:27:10.911680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.949721+0000","last_change":"2024-04-26T23:27:08.915333+0000","last_active":"2024-04-26T23:27:09.949721+0000","last_peered":"2024-04-26T23:27:09.949721+0000","last_clean":"2024-04-26T23:27:09.949721+0000","last_became_active":"2024-04-26T23:27:08.914443+0000","last_became_peered":"2024-04-26T23:27:08.914443+0000","last_unstale":"2024-04-26T23:27:09.949721+0000","last_undegraded":"2024-04-26T23:27:09.949721+0000","last_fullsized":"2024-04-26T23:27:09.949721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:40.423793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942337+0000","last_change":"2024-04-26T23:27:09.936794+0000","last_active":"2024-04-26T23:27:09.942337+0000","last_peered":"2024-04-26T23:27:09.942337+0000","last_clean":"2024-04-26T23:27:09.942337+0000","last_became_active":"2024-04-26T23:27:09.936191+0000","last_became_peered":"2024-04-26T23:27:09.936191+0000","last_unstale":"2024-04-26T23:27:09.942337+0000","last_undegraded":"2024-04-26T23:27:09.942337+0000","last_fullsized":"2024-04-26T23:27:09.942337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:40.728829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911698+0000","last_change":"2024-04-26T23:27:08.922048+0000","last_active":"2024-04-26T23:27:10.911698+0000","last_peered":"2024-04-26T23:27:10.911698+0000","last_clean":"2024-04-26T23:27:10.911698+0000","last_became_active":"2024-04-26T23:27:08.921468+0000","last_became_peered":"2024-04-26T23:27:08.921468+0000","last_unstale":"2024-04-26T23:27:10.911698+0000","last_undegraded":"2024-04-26T23:27:10.911698+0000","last_fullsized":"2024-04-26T23:27:10.911698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:50.292659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913721+0000","last_change":"2024-04-26T23:27:09.934860+0000","last_active":"2024-04-26T23:27:10.913721+0000","last_peered":"2024-04-26T23:27:10.913721+0000","last_clean":"2024-04-26T23:27:10.913721+0000","last_became_active":"2024-04-26T23:27:09.934169+0000","last_became_peered":"2024-04-26T23:27:09.934169+0000","last_unstale":"2024-04-26T23:27:10.913721+0000","last_undegraded":"2024-04-26T23:27:10.913721+0000","last_fullsized":"2024-04-26T23:27:10.913721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:46.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141029+0000","last_change":"2024-04-26T23:27:08.923947+0000","last_active":"2024-04-26T23:27:11.141029+0000","last_peered":"2024-04-26T23:27:11.141029+0000","last_clean":"2024-04-26T23:27:11.141029+0000","last_became_active":"2024-04-26T23:27:08.923649+0000","last_became_peered":"2024-04-26T23:27:08.923649+0000","last_unstale":"2024-04-26T23:27:11.141029+0000","last_undegraded":"2024-04-26T23:27:11.141029+0000","last_fullsized":"2024-04-26T23:27:11.141029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:51.187866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933607+0000","last_change":"2024-04-26T23:27:09.935958+0000","last_active":"2024-04-26T23:27:10.933607+0000","last_peered":"2024-04-26T23:27:10.933607+0000","last_clean":"2024-04-26T23:27:10.933607+0000","last_became_active":"2024-04-26T23:27:09.935274+0000","last_became_peered":"2024-04-26T23:27:09.935274+0000","last_unstale":"2024-04-26T23:27:10.933607+0000","last_undegraded":"2024-04-26T23:27:10.933607+0000","last_fullsized":"2024-04-26T23:27:10.933607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.665028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.954544+0000","last_change":"2024-04-26T23:27:08.930957+0000","last_active":"2024-04-26T23:27:09.954544+0000","last_peered":"2024-04-26T23:27:09.954544+0000","last_clean":"2024-04-26T23:27:09.954544+0000","last_became_active":"2024-04-26T23:27:08.930665+0000","last_became_peered":"2024-04-26T23:27:08.930665+0000","last_unstale":"2024-04-26T23:27:09.954544+0000","last_undegraded":"2024-04-26T23:27:09.954544+0000","last_fullsized":"2024-04-26T23:27:09.954544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:46.298782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.943708+0000","last_change":"2024-04-26T23:27:09.937452+0000","last_active":"2024-04-26T23:27:09.943708+0000","last_peered":"2024-04-26T23:27:09.943708+0000","last_clean":"2024-04-26T23:27:09.943708+0000","last_became_active":"2024-04-26T23:27:09.936476+0000","last_became_peered":"2024-04-26T23:27:09.936476+0000","last_unstale":"2024-04-26T23:27:09.943708+0000","last_undegraded":"2024-04-26T23:27:09.943708+0000","last_fullsized":"2024-04-26T23:27:09.943708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913925+0000","last_change":"2024-04-26T23:27:08.912847+0000","last_active":"2024-04-26T23:27:10.913925+0000","last_peered":"2024-04-26T23:27:10.913925+0000","last_clean":"2024-04-26T23:27:10.913925+0000","last_became_active":"2024-04-26T23:27:08.912595+0000","last_became_peered":"2024-04-26T23:27:08.912595+0000","last_unstale":"2024-04-26T23:27:10.913925+0000","last_undegraded":"2024-04-26T23:27:10.913925+0000","last_fullsized":"2024-04-26T23:27:10.913925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:18:30.778764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912881+0000","last_change":"2024-04-26T23:27:09.925166+0000","last_active":"2024-04-26T23:27:10.912881+0000","last_peered":"2024-04-26T23:27:10.912881+0000","last_clean":"2024-04-26T23:27:10.912881+0000","last_became_active":"2024-04-26T23:27:09.924864+0000","last_became_peered":"2024-04-26T23:27:09.924864+0000","last_unstale":"2024-04-26T23:27:10.912881+0000","last_undegraded":"2024-04-26T23:27:10.912881+0000","last_fullsized":"2024-04-26T23:27:10.912881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:35.363989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913319+0000","last_change":"2024-04-26T23:27:08.912474+0000","last_active":"2024-04-26T23:27:10.913319+0000","last_peered":"2024-04-26T23:27:10.913319+0000","last_clean":"2024-04-26T23:27:10.913319+0000","last_became_active":"2024-04-26T23:27:08.912150+0000","last_became_peered":"2024-04-26T23:27:08.912150+0000","last_unstale":"2024-04-26T23:27:10.913319+0000","last_undegraded":"2024-04-26T23:27:10.913319+0000","last_fullsized":"2024-04-26T23:27:10.913319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:32.477951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912747+0000","last_change":"2024-04-26T23:27:09.930189+0000","last_active":"2024-04-26T23:27:10.912747+0000","last_peered":"2024-04-26T23:27:10.912747+0000","last_clean":"2024-04-26T23:27:10.912747+0000","last_became_active":"2024-04-26T23:27:09.929926+0000","last_became_peered":"2024-04-26T23:27:09.929926+0000","last_unstale":"2024-04-26T23:27:10.912747+0000","last_undegraded":"2024-04-26T23:27:10.912747+0000","last_fullsized":"2024-04-26T23:27:10.912747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:52.198195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140591+0000","last_change":"2024-04-26T23:27:08.926275+0000","last_active":"2024-04-26T23:27:11.140591+0000","last_peered":"2024-04-26T23:27:11.140591+0000","last_clean":"2024-04-26T23:27:11.140591+0000","last_became_active":"2024-04-26T23:27:08.925985+0000","last_became_peered":"2024-04-26T23:27:08.925985+0000","last_unstale":"2024-04-26T23:27:11.140591+0000","last_undegraded":"2024-04-26T23:27:11.140591+0000","last_fullsized":"2024-04-26T23:27:11.140591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933066+0000","last_change":"2024-04-26T23:27:09.934919+0000","last_active":"2024-04-26T23:27:10.933066+0000","last_peered":"2024-04-26T23:27:10.933066+0000","last_clean":"2024-04-26T23:27:10.933066+0000","last_became_active":"2024-04-26T23:27:09.934624+0000","last_became_peered":"2024-04-26T23:27:09.934624+0000","last_unstale":"2024-04-26T23:27:10.933066+0000","last_undegraded":"2024-04-26T23:27:10.933066+0000","last_fullsized":"2024-04-26T23:27:10.933066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:57.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912747+0000","last_change":"2024-04-26T23:27:08.910731+0000","last_active":"2024-04-26T23:27:10.912747+0000","last_peered":"2024-04-26T23:27:10.912747+0000","last_clean":"2024-04-26T23:27:10.912747+0000","last_became_active":"2024-04-26T23:27:08.910428+0000","last_became_peered":"2024-04-26T23:27:08.910428+0000","last_unstale":"2024-04-26T23:27:10.912747+0000","last_undegraded":"2024-04-26T23:27:10.912747+0000","last_fullsized":"2024-04-26T23:27:10.912747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:48.119825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913121+0000","last_change":"2024-04-26T23:27:09.931133+0000","last_active":"2024-04-26T23:27:10.913121+0000","last_peered":"2024-04-26T23:27:10.913121+0000","last_clean":"2024-04-26T23:27:10.913121+0000","last_became_active":"2024-04-26T23:27:09.930858+0000","last_became_peered":"2024-04-26T23:27:09.930858+0000","last_unstale":"2024-04-26T23:27:10.913121+0000","last_undegraded":"2024-04-26T23:27:10.913121+0000","last_fullsized":"2024-04-26T23:27:10.913121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:12.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140938+0000","last_change":"2024-04-26T23:27:08.923251+0000","last_active":"2024-04-26T23:27:11.140938+0000","last_peered":"2024-04-26T23:27:11.140938+0000","last_clean":"2024-04-26T23:27:11.140938+0000","last_became_active":"2024-04-26T23:27:08.923065+0000","last_became_peered":"2024-04-26T23:27:08.923065+0000","last_unstale":"2024-04-26T23:27:11.140938+0000","last_undegraded":"2024-04-26T23:27:11.140938+0000","last_fullsized":"2024-04-26T23:27:11.140938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:05.408179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141115+0000","last_change":"2024-04-26T23:27:09.931040+0000","last_active":"2024-04-26T23:27:11.141115+0000","last_peered":"2024-04-26T23:27:11.141115+0000","last_clean":"2024-04-26T23:27:11.141115+0000","last_became_active":"2024-04-26T23:27:09.930616+0000","last_became_peered":"2024-04-26T23:27:09.930616+0000","last_unstale":"2024-04-26T23:27:11.141115+0000","last_undegraded":"2024-04-26T23:27:11.141115+0000","last_fullsized":"2024-04-26T23:27:11.141115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:04.982183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911735+0000","last_change":"2024-04-26T23:27:08.918607+0000","last_active":"2024-04-26T23:27:10.911735+0000","last_peered":"2024-04-26T23:27:10.911735+0000","last_clean":"2024-04-26T23:27:10.911735+0000","last_became_active":"2024-04-26T23:27:08.917255+0000","last_became_peered":"2024-04-26T23:27:08.917255+0000","last_unstale":"2024-04-26T23:27:10.911735+0000","last_undegraded":"2024-04-26T23:27:10.911735+0000","last_fullsized":"2024-04-26T23:27:10.911735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:39.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140989+0000","last_change":"2024-04-26T23:27:09.921054+0000","last_active":"2024-04-26T23:27:11.140989+0000","last_peered":"2024-04-26T23:27:11.140989+0000","last_clean":"2024-04-26T23:27:11.140989+0000","last_became_active":"2024-04-26T23:27:09.920764+0000","last_became_peered":"2024-04-26T23:27:09.920764+0000","last_unstale":"2024-04-26T23:27:11.140989+0000","last_undegraded":"2024-04-26T23:27:11.140989+0000","last_fullsized":"2024-04-26T23:27:11.140989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:38.309597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913290+0000","last_change":"2024-04-26T23:27:08.921533+0000","last_active":"2024-04-26T23:27:10.913290+0000","last_peered":"2024-04-26T23:27:10.913290+0000","last_clean":"2024-04-26T23:27:10.913290+0000","last_became_active":"2024-04-26T23:27:08.920943+0000","last_became_peered":"2024-04-26T23:27:08.920943+0000","last_unstale":"2024-04-26T23:27:10.913290+0000","last_undegraded":"2024-04-26T23:27:10.913290+0000","last_fullsized":"2024-04-26T23:27:10.913290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:23.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913183+0000","last_change":"2024-04-26T23:27:09.934940+0000","last_active":"2024-04-26T23:27:10.913183+0000","last_peered":"2024-04-26T23:27:10.913183+0000","last_clean":"2024-04-26T23:27:10.913183+0000","last_became_active":"2024-04-26T23:27:09.934250+0000","last_became_peered":"2024-04-26T23:27:09.934250+0000","last_unstale":"2024-04-26T23:27:10.913183+0000","last_undegraded":"2024-04-26T23:27:10.913183+0000","last_fullsized":"2024-04-26T23:27:10.913183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:43.263519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.141128+0000","last_change":"2024-04-26T23:27:08.923041+0000","last_active":"2024-04-26T23:27:11.141128+0000","last_peered":"2024-04-26T23:27:11.141128+0000","last_clean":"2024-04-26T23:27:11.141128+0000","last_became_active":"2024-04-26T23:27:08.922694+0000","last_became_peered":"2024-04-26T23:27:08.922694+0000","last_unstale":"2024-04-26T23:27:11.141128+0000","last_undegraded":"2024-04-26T23:27:11.141128+0000","last_fullsized":"2024-04-26T23:27:11.141128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:57.984430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933124+0000","last_change":"2024-04-26T23:27:09.934437+0000","last_active":"2024-04-26T23:27:10.933124+0000","last_peered":"2024-04-26T23:27:10.933124+0000","last_clean":"2024-04-26T23:27:10.933124+0000","last_became_active":"2024-04-26T23:27:09.934149+0000","last_became_peered":"2024-04-26T23:27:09.934149+0000","last_unstale":"2024-04-26T23:27:10.933124+0000","last_undegraded":"2024-04-26T23:27:10.933124+0000","last_fullsized":"2024-04-26T23:27:10.933124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:25.213145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913933+0000","last_change":"2024-04-26T23:27:08.913734+0000","last_active":"2024-04-26T23:27:10.913933+0000","last_peered":"2024-04-26T23:27:10.913933+0000","last_clean":"2024-04-26T23:27:10.913933+0000","last_became_active":"2024-04-26T23:27:08.910315+0000","last_became_peered":"2024-04-26T23:27:08.910315+0000","last_unstale":"2024-04-26T23:27:10.913933+0000","last_undegraded":"2024-04-26T23:27:10.913933+0000","last_fullsized":"2024-04-26T23:27:10.913933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:25:10.743763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140873+0000","last_change":"2024-04-26T23:27:09.923892+0000","last_active":"2024-04-26T23:27:11.140873+0000","last_peered":"2024-04-26T23:27:11.140873+0000","last_clean":"2024-04-26T23:27:11.140873+0000","last_became_active":"2024-04-26T23:27:09.923571+0000","last_became_peered":"2024-04-26T23:27:09.923571+0000","last_unstale":"2024-04-26T23:27:11.140873+0000","last_undegraded":"2024-04-26T23:27:11.140873+0000","last_fullsized":"2024-04-26T23:27:11.140873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:43.263519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933132+0000","last_change":"2024-04-26T23:27:08.918002+0000","last_active":"2024-04-26T23:27:10.933132+0000","last_peered":"2024-04-26T23:27:10.933132+0000","last_clean":"2024-04-26T23:27:10.933132+0000","last_became_active":"2024-04-26T23:27:08.917718+0000","last_became_peered":"2024-04-26T23:27:08.917718+0000","last_unstale":"2024-04-26T23:27:10.933132+0000","last_undegraded":"2024-04-26T23:27:10.933132+0000","last_fullsized":"2024-04-26T23:27:10.933132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:39.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942517+0000","last_change":"2024-04-26T23:27:09.936384+0000","last_active":"2024-04-26T23:27:09.942517+0000","last_peered":"2024-04-26T23:27:09.942517+0000","last_clean":"2024-04-26T23:27:09.942517+0000","last_became_active":"2024-04-26T23:27:09.936114+0000","last_became_peered":"2024-04-26T23:27:09.936114+0000","last_unstale":"2024-04-26T23:27:09.942517+0000","last_undegraded":"2024-04-26T23:27:09.942517+0000","last_fullsized":"2024-04-26T23:27:09.942517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:06.418507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140876+0000","last_change":"2024-04-26T23:27:08.920104+0000","last_active":"2024-04-26T23:27:11.140876+0000","last_peered":"2024-04-26T23:27:11.140876+0000","last_clean":"2024-04-26T23:27:11.140876+0000","last_became_active":"2024-04-26T23:27:08.919735+0000","last_became_peered":"2024-04-26T23:27:08.919735+0000","last_unstale":"2024-04-26T23:27:11.140876+0000","last_undegraded":"2024-04-26T23:27:11.140876+0000","last_fullsized":"2024-04-26T23:27:11.140876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:25.283660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.939504+0000","last_change":"2024-04-26T23:27:09.935666+0000","last_active":"2024-04-26T23:27:09.939504+0000","last_peered":"2024-04-26T23:27:09.939504+0000","last_clean":"2024-04-26T23:27:09.939504+0000","last_became_active":"2024-04-26T23:27:09.935331+0000","last_became_peered":"2024-04-26T23:27:09.935331+0000","last_unstale":"2024-04-26T23:27:09.939504+0000","last_undegraded":"2024-04-26T23:27:09.939504+0000","last_fullsized":"2024-04-26T23:27:09.939504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:30.572938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140663+0000","last_change":"2024-04-26T23:27:08.922845+0000","last_active":"2024-04-26T23:27:11.140663+0000","last_peered":"2024-04-26T23:27:11.140663+0000","last_clean":"2024-04-26T23:27:11.140663+0000","last_became_active":"2024-04-26T23:27:08.922539+0000","last_became_peered":"2024-04-26T23:27:08.922539+0000","last_unstale":"2024-04-26T23:27:11.140663+0000","last_undegraded":"2024-04-26T23:27:11.140663+0000","last_fullsized":"2024-04-26T23:27:11.140663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913843+0000","last_change":"2024-04-26T23:27:09.924470+0000","last_active":"2024-04-26T23:27:10.913843+0000","last_peered":"2024-04-26T23:27:10.913843+0000","last_clean":"2024-04-26T23:27:10.913843+0000","last_became_active":"2024-04-26T23:27:09.924144+0000","last_became_peered":"2024-04-26T23:27:09.924144+0000","last_unstale":"2024-04-26T23:27:10.913843+0000","last_undegraded":"2024-04-26T23:27:10.913843+0000","last_fullsized":"2024-04-26T23:27:10.913843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933749+0000","last_change":"2024-04-26T23:27:08.924793+0000","last_active":"2024-04-26T23:27:10.933749+0000","last_peered":"2024-04-26T23:27:10.933749+0000","last_clean":"2024-04-26T23:27:10.933749+0000","last_became_active":"2024-04-26T23:27:08.924509+0000","last_became_peered":"2024-04-26T23:27:08.924509+0000","last_unstale":"2024-04-26T23:27:10.933749+0000","last_undegraded":"2024-04-26T23:27:10.933749+0000","last_fullsized":"2024-04-26T23:27:10.933749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913310+0000","last_change":"2024-04-26T23:27:09.931233+0000","last_active":"2024-04-26T23:27:10.913310+0000","last_peered":"2024-04-26T23:27:10.913310+0000","last_clean":"2024-04-26T23:27:10.913310+0000","last_became_active":"2024-04-26T23:27:09.930524+0000","last_became_peered":"2024-04-26T23:27:09.930524+0000","last_unstale":"2024-04-26T23:27:10.913310+0000","last_undegraded":"2024-04-26T23:27:10.913310+0000","last_fullsized":"2024-04-26T23:27:10.913310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:58.263273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913865+0000","last_change":"2024-04-26T23:27:08.906935+0000","last_active":"2024-04-26T23:27:10.913865+0000","last_peered":"2024-04-26T23:27:10.913865+0000","last_clean":"2024-04-26T23:27:10.913865+0000","last_became_active":"2024-04-26T23:27:08.906351+0000","last_became_peered":"2024-04-26T23:27:08.906351+0000","last_unstale":"2024-04-26T23:27:10.913865+0000","last_undegraded":"2024-04-26T23:27:10.913865+0000","last_fullsized":"2024-04-26T23:27:10.913865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:33.671788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933467+0000","last_change":"2024-04-26T23:27:09.939514+0000","last_active":"2024-04-26T23:27:10.933467+0000","last_peered":"2024-04-26T23:27:10.933467+0000","last_clean":"2024-04-26T23:27:10.933467+0000","last_became_active":"2024-04-26T23:27:09.939101+0000","last_became_peered":"2024-04-26T23:27:09.939101+0000","last_unstale":"2024-04-26T23:27:10.933467+0000","last_undegraded":"2024-04-26T23:27:10.933467+0000","last_fullsized":"2024-04-26T23:27:10.933467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:38.424664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913851+0000","last_change":"2024-04-26T23:27:08.926551+0000","last_active":"2024-04-26T23:27:10.913851+0000","last_peered":"2024-04-26T23:27:10.913851+0000","last_clean":"2024-04-26T23:27:10.913851+0000","last_became_active":"2024-04-26T23:27:08.926242+0000","last_became_peered":"2024-04-26T23:27:08.926242+0000","last_unstale":"2024-04-26T23:27:10.913851+0000","last_undegraded":"2024-04-26T23:27:10.913851+0000","last_fullsized":"2024-04-26T23:27:10.913851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:34.552046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942203+0000","last_change":"2024-04-26T23:27:09.933361+0000","last_active":"2024-04-26T23:27:09.942203+0000","last_peered":"2024-04-26T23:27:09.942203+0000","last_clean":"2024-04-26T23:27:09.942203+0000","last_became_active":"2024-04-26T23:27:09.933032+0000","last_became_peered":"2024-04-26T23:27:09.933032+0000","last_unstale":"2024-04-26T23:27:09.942203+0000","last_undegraded":"2024-04-26T23:27:09.942203+0000","last_fullsized":"2024-04-26T23:27:09.942203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:49.130153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913941+0000","last_change":"2024-04-26T23:27:08.914423+0000","last_active":"2024-04-26T23:27:10.913941+0000","last_peered":"2024-04-26T23:27:10.913941+0000","last_clean":"2024-04-26T23:27:10.913941+0000","last_became_active":"2024-04-26T23:27:08.914097+0000","last_became_peered":"2024-04-26T23:27:08.914097+0000","last_unstale":"2024-04-26T23:27:10.913941+0000","last_undegraded":"2024-04-26T23:27:10.913941+0000","last_fullsized":"2024-04-26T23:27:10.913941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:40.423793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.936990+0000","last_change":"2024-04-26T23:27:09.928823+0000","last_active":"2024-04-26T23:27:09.936990+0000","last_peered":"2024-04-26T23:27:09.936990+0000","last_clean":"2024-04-26T23:27:09.936990+0000","last_became_active":"2024-04-26T23:27:09.928516+0000","last_became_peered":"2024-04-26T23:27:09.928516+0000","last_unstale":"2024-04-26T23:27:09.936990+0000","last_undegraded":"2024-04-26T23:27:09.936990+0000","last_fullsized":"2024-04-26T23:27:09.936990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:41:22.031784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911934+0000","last_change":"2024-04-26T23:27:08.917301+0000","last_active":"2024-04-26T23:27:10.911934+0000","last_peered":"2024-04-26T23:27:10.911934+0000","last_clean":"2024-04-26T23:27:10.911934+0000","last_became_active":"2024-04-26T23:27:08.916264+0000","last_became_peered":"2024-04-26T23:27:08.916264+0000","last_unstale":"2024-04-26T23:27:10.911934+0000","last_undegraded":"2024-04-26T23:27:10.911934+0000","last_fullsized":"2024-04-26T23:27:10.911934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:54.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942779+0000","last_change":"2024-04-26T23:27:09.937518+0000","last_active":"2024-04-26T23:27:09.942779+0000","last_peered":"2024-04-26T23:27:09.942779+0000","last_clean":"2024-04-26T23:27:09.942779+0000","last_became_active":"2024-04-26T23:27:09.935464+0000","last_became_peered":"2024-04-26T23:27:09.935464+0000","last_unstale":"2024-04-26T23:27:09.942779+0000","last_undegraded":"2024-04-26T23:27:09.942779+0000","last_fullsized":"2024-04-26T23:27:09.942779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:23.284058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.927248+0000","last_change":"2024-04-26T23:27:08.922642+0000","last_active":"2024-04-26T23:27:09.927248+0000","last_peered":"2024-04-26T23:27:09.927248+0000","last_clean":"2024-04-26T23:27:09.927248+0000","last_became_active":"2024-04-26T23:27:08.922292+0000","last_became_peered":"2024-04-26T23:27:08.922292+0000","last_unstale":"2024-04-26T23:27:09.927248+0000","last_undegraded":"2024-04-26T23:27:09.927248+0000","last_fullsized":"2024-04-26T23:27:09.927248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:34.552046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942108+0000","last_change":"2024-04-26T23:27:09.932305+0000","last_active":"2024-04-26T23:27:09.942108+0000","last_peered":"2024-04-26T23:27:09.942108+0000","last_clean":"2024-04-26T23:27:09.942108+0000","last_became_active":"2024-04-26T23:27:09.931955+0000","last_became_peered":"2024-04-26T23:27:09.931955+0000","last_unstale":"2024-04-26T23:27:09.942108+0000","last_undegraded":"2024-04-26T23:27:09.942108+0000","last_fullsized":"2024-04-26T23:27:09.942108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:53.579228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912689+0000","last_change":"2024-04-26T23:27:08.919985+0000","last_active":"2024-04-26T23:27:10.912689+0000","last_peered":"2024-04-26T23:27:10.912689+0000","last_clean":"2024-04-26T23:27:10.912689+0000","last_became_active":"2024-04-26T23:27:08.919629+0000","last_became_peered":"2024-04-26T23:27:08.919629+0000","last_unstale":"2024-04-26T23:27:10.912689+0000","last_undegraded":"2024-04-26T23:27:10.912689+0000","last_fullsized":"2024-04-26T23:27:10.912689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:22.273730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942813+0000","last_change":"2024-04-26T23:27:09.940421+0000","last_active":"2024-04-26T23:27:09.942813+0000","last_peered":"2024-04-26T23:27:09.942813+0000","last_clean":"2024-04-26T23:27:09.942813+0000","last_became_active":"2024-04-26T23:27:09.940138+0000","last_became_peered":"2024-04-26T23:27:09.940138+0000","last_unstale":"2024-04-26T23:27:09.942813+0000","last_undegraded":"2024-04-26T23:27:09.942813+0000","last_fullsized":"2024-04-26T23:27:09.942813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:25.213145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912956+0000","last_change":"2024-04-26T23:27:08.919314+0000","last_active":"2024-04-26T23:27:10.912956+0000","last_peered":"2024-04-26T23:27:10.912956+0000","last_clean":"2024-04-26T23:27:10.912956+0000","last_became_active":"2024-04-26T23:27:08.918983+0000","last_became_peered":"2024-04-26T23:27:08.918983+0000","last_unstale":"2024-04-26T23:27:10.912956+0000","last_undegraded":"2024-04-26T23:27:10.912956+0000","last_fullsized":"2024-04-26T23:27:10.912956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:25.283660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.937285+0000","last_change":"2024-04-26T23:27:09.930631+0000","last_active":"2024-04-26T23:27:09.937285+0000","last_peered":"2024-04-26T23:27:09.937285+0000","last_clean":"2024-04-26T23:27:09.937285+0000","last_became_active":"2024-04-26T23:27:09.930167+0000","last_became_peered":"2024-04-26T23:27:09.930167+0000","last_unstale":"2024-04-26T23:27:09.937285+0000","last_undegraded":"2024-04-26T23:27:09.937285+0000","last_fullsized":"2024-04-26T23:27:09.937285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:22.101308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933844+0000","last_change":"2024-04-26T23:27:08.919002+0000","last_active":"2024-04-26T23:27:10.933844+0000","last_peered":"2024-04-26T23:27:10.933844+0000","last_clean":"2024-04-26T23:27:10.933844+0000","last_became_active":"2024-04-26T23:27:08.915778+0000","last_became_peered":"2024-04-26T23:27:08.915778+0000","last_unstale":"2024-04-26T23:27:10.933844+0000","last_undegraded":"2024-04-26T23:27:10.933844+0000","last_fullsized":"2024-04-26T23:27:10.933844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.913465+0000","last_change":"2024-04-26T23:27:09.935344+0000","last_active":"2024-04-26T23:27:10.913465+0000","last_peered":"2024-04-26T23:27:10.913465+0000","last_clean":"2024-04-26T23:27:10.913465+0000","last_became_active":"2024-04-26T23:27:09.935082+0000","last_became_peered":"2024-04-26T23:27:09.935082+0000","last_unstale":"2024-04-26T23:27:10.913465+0000","last_undegraded":"2024-04-26T23:27:10.913465+0000","last_fullsized":"2024-04-26T23:27:10.913465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:46.127801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.932306+0000","last_change":"2024-04-26T23:27:08.916906+0000","last_active":"2024-04-26T23:27:10.932306+0000","last_peered":"2024-04-26T23:27:10.932306+0000","last_clean":"2024-04-26T23:27:10.932306+0000","last_became_active":"2024-04-26T23:27:08.916623+0000","last_became_peered":"2024-04-26T23:27:08.916623+0000","last_unstale":"2024-04-26T23:27:10.932306+0000","last_undegraded":"2024-04-26T23:27:10.932306+0000","last_fullsized":"2024-04-26T23:27:10.932306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:58.142207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911569+0000","last_change":"2024-04-26T23:27:09.929104+0000","last_active":"2024-04-26T23:27:10.911569+0000","last_peered":"2024-04-26T23:27:10.911569+0000","last_clean":"2024-04-26T23:27:10.911569+0000","last_became_active":"2024-04-26T23:27:09.928804+0000","last_became_peered":"2024-04-26T23:27:09.928804+0000","last_unstale":"2024-04-26T23:27:10.911569+0000","last_undegraded":"2024-04-26T23:27:10.911569+0000","last_fullsized":"2024-04-26T23:27:10.911569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:17.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933520+0000","last_change":"2024-04-26T23:27:08.932021+0000","last_active":"2024-04-26T23:27:10.933520+0000","last_peered":"2024-04-26T23:27:10.933520+0000","last_clean":"2024-04-26T23:27:10.933520+0000","last_became_active":"2024-04-26T23:27:08.931692+0000","last_became_peered":"2024-04-26T23:27:08.931692+0000","last_unstale":"2024-04-26T23:27:10.933520+0000","last_undegraded":"2024-04-26T23:27:10.933520+0000","last_fullsized":"2024-04-26T23:27:10.933520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:50.292659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.942228+0000","last_change":"2024-04-26T23:27:09.936856+0000","last_active":"2024-04-26T23:27:09.942228+0000","last_peered":"2024-04-26T23:27:09.942228+0000","last_clean":"2024-04-26T23:27:09.942228+0000","last_became_active":"2024-04-26T23:27:09.932210+0000","last_became_peered":"2024-04-26T23:27:09.932210+0000","last_unstale":"2024-04-26T23:27:09.942228+0000","last_undegraded":"2024-04-26T23:27:09.942228+0000","last_fullsized":"2024-04-26T23:27:09.942228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:59.152536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912049+0000","last_change":"2024-04-26T23:27:08.906719+0000","last_active":"2024-04-26T23:27:10.912049+0000","last_peered":"2024-04-26T23:27:10.912049+0000","last_clean":"2024-04-26T23:27:10.912049+0000","last_became_active":"2024-04-26T23:27:08.906421+0000","last_became_peered":"2024-04-26T23:27:08.906421+0000","last_unstale":"2024-04-26T23:27:10.912049+0000","last_undegraded":"2024-04-26T23:27:10.912049+0000","last_fullsized":"2024-04-26T23:27:10.912049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:47.745887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.911974+0000","last_change":"2024-04-26T23:27:09.928066+0000","last_active":"2024-04-26T23:27:10.911974+0000","last_peered":"2024-04-26T23:27:10.911974+0000","last_clean":"2024-04-26T23:27:10.911974+0000","last_became_active":"2024-04-26T23:27:09.927709+0000","last_became_peered":"2024-04-26T23:27:09.927709+0000","last_unstale":"2024-04-26T23:27:10.911974+0000","last_undegraded":"2024-04-26T23:27:10.911974+0000","last_fullsized":"2024-04-26T23:27:10.911974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:16.726739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.933229+0000","last_change":"2024-04-26T23:27:08.921793+0000","last_active":"2024-04-26T23:27:10.933229+0000","last_peered":"2024-04-26T23:27:10.933229+0000","last_clean":"2024-04-26T23:27:10.933229+0000","last_became_active":"2024-04-26T23:27:08.921004+0000","last_became_peered":"2024-04-26T23:27:08.921004+0000","last_unstale":"2024-04-26T23:27:10.933229+0000","last_undegraded":"2024-04-26T23:27:10.933229+0000","last_fullsized":"2024-04-26T23:27:10.933229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:58.142207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140666+0000","last_change":"2024-04-26T23:27:09.933602+0000","last_active":"2024-04-26T23:27:11.140666+0000","last_peered":"2024-04-26T23:27:11.140666+0000","last_clean":"2024-04-26T23:27:11.140666+0000","last_became_active":"2024-04-26T23:27:09.932021+0000","last_became_peered":"2024-04-26T23:27:09.932021+0000","last_unstale":"2024-04-26T23:27:11.140666+0000","last_undegraded":"2024-04-26T23:27:11.140666+0000","last_fullsized":"2024-04-26T23:27:11.140666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:35.363989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912805+0000","last_change":"2024-04-26T23:27:08.912662+0000","last_active":"2024-04-26T23:27:10.912805+0000","last_peered":"2024-04-26T23:27:10.912805+0000","last_clean":"2024-04-26T23:27:10.912805+0000","last_became_active":"2024-04-26T23:27:08.912371+0000","last_became_peered":"2024-04-26T23:27:08.912371+0000","last_unstale":"2024-04-26T23:27:10.912805+0000","last_undegraded":"2024-04-26T23:27:10.912805+0000","last_fullsized":"2024-04-26T23:27:10.912805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:59.405108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:10.912566+0000","last_change":"2024-04-26T23:27:09.935477+0000","last_active":"2024-04-26T23:27:10.912566+0000","last_peered":"2024-04-26T23:27:10.912566+0000","last_clean":"2024-04-26T23:27:10.912566+0000","last_became_active":"2024-04-26T23:27:09.935144+0000","last_became_peered":"2024-04-26T23:27:09.935144+0000","last_unstale":"2024-04-26T23:27:10.912566+0000","last_undegraded":"2024-04-26T23:27:10.912566+0000","last_fullsized":"2024-04-26T23:27:10.912566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:24.851596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T23:27:11.140789+0000","last_change":"2024-04-26T23:27:08.919022+0000","last_active":"2024-04-26T23:27:11.140789+0000","last_peered":"2024-04-26T23:27:11.140789+0000","last_clean":"2024-04-26T23:27:11.140789+0000","last_became_active":"2024-04-26T23:27:08.918759+0000","last_became_peered":"2024-04-26T23:27:08.918759+0000","last_unstale":"2024-04-26T23:27:11.140789+0000","last_undegraded":"2024-04-26T23:27:11.140789+0000","last_fullsized":"2024-04-26T23:27:11.140789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:23.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.944406+0000","last_change":"2024-04-26T23:27:09.940774+0000","last_active":"2024-04-26T23:27:09.944406+0000","last_peered":"2024-04-26T23:27:09.944406+0000","last_clean":"2024-04-26T23:27:09.944406+0000","last_became_active":"2024-04-26T23:27:09.940387+0000","last_became_peered":"2024-04-26T23:27:09.940387+0000","last_unstale":"2024-04-26T23:27:09.944406+0000","last_undegraded":"2024-04-26T23:27:09.944406+0000","last_fullsized":"2024-04-26T23:27:09.944406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:08.889789+0000","last_clean_scrub_stamp":"2024-04-26T23:27:08.889789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:29.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.927451+0000","last_change":"2024-04-26T23:27:08.917192+0000","last_active":"2024-04-26T23:27:09.927451+0000","last_peered":"2024-04-26T23:27:09.927451+0000","last_clean":"2024-04-26T23:27:09.927451+0000","last_became_active":"2024-04-26T23:27:08.916853+0000","last_became_peered":"2024-04-26T23:27:08.916853+0000","last_unstale":"2024-04-26T23:27:09.927451+0000","last_undegraded":"2024-04-26T23:27:09.927451+0000","last_fullsized":"2024-04-26T23:27:09.927451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:07.879460+0000","last_clean_scrub_stamp":"2024-04-26T23:27:07.879460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:47.824670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:27:09.921608+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:09.921608+0000","last_peered":"2024-04-26T23:27:09.921608+0000","last_clean":"2024-04-26T23:27:09.921608+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:09.921608+0000","last_undegraded":"2024-04-26T23:27:09.921608+0000","last_fullsized":"2024-04-26T23:27:09.921608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":141942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":140378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:14.439 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:27:14.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:27:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.620+0000 7f92ea000640 1 Processor -- start 2024-04-26T23:27:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 -- start start 2024-04-26T23:27:14.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92e40cf8c0 0x7f92e40cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92e406d970 0x7f92e40b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e40d01e0 con 0x7f92e406d4e0 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f92e406dd80 con 0x7f92e406d970 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92ea000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f92e406dfa0 con 0x7f92e40cf8c0 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92e406d970 0x7f92e40b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92e406d970 0x7f92e40b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33172/0 (socket says 172.21.15.39:33172) 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 -- 172.21.15.39:0/3495203734 learned_addr learned my addr 172.21.15.39:0/3495203734 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:14.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3400640 1 --2- 172.21.15.39:0/3495203734 >> v2:172.21.15.71:3300/0 conn(0x7f92e40cf8c0 0x7f92e40cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 -- 172.21.15.39:0/3495203734 >> v2:172.21.15.71:3300/0 conn(0x7f92e40cf8c0 msgr2=0x7f92e40cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:14.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 --2- 172.21.15.39:0/3495203734 >> v2:172.21.15.71:3300/0 conn(0x7f92e40cf8c0 0x7f92e40cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 -- 172.21.15.39:0/3495203734 >> v1:172.21.15.71:6789/0 conn(0x7f92e406d4e0 legacy=0x7f92e40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.624+0000 7f92e3e00640 1 -- 172.21.15.39:0/3495203734 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e406e280 con 0x7f92e406d970 2024-04-26T23:27:14.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92e3e00640 1 --2- 172.21.15.39:0/3495203734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e406d970 0x7f92e40b37f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92e40d3ca0 tx=0x7f92dc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cc000648ff1f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92e2a00640 1 -- 172.21.15.39:0/3495203734 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0a5880 con 0x7f92e406d970 2024-04-26T23:27:14.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92e2a00640 1 -- 172.21.15.39:0/3495203734 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc0a5a20 con 0x7f92e406d970 2024-04-26T23:27:14.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92e2a00640 1 -- 172.21.15.39:0/3495203734 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0a5df0 con 0x7f92e406d970 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- 172.21.15.39:0/3495203734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e406d970 msgr2=0x7f92e40b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 --2- 172.21.15.39:0/3495203734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e406d970 0x7f92e40b37f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92e40d3ca0 tx=0x7f92dc01c9c0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- 172.21.15.39:0/3495203734 shutdown_connections 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 --2- 172.21.15.39:0/3495203734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e406d970 0x7f92e40b37f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 --2- 172.21.15.39:0/3495203734 >> v2:172.21.15.71:3300/0 conn(0x7f92e40cf8c0 0x7f92e40cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- 172.21.15.39:0/3495203734 >> 172.21.15.39:0/3495203734 conn(0x7f92e40d3040 msgr2=0x7f92e40d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:14.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- 172.21.15.39:0/3495203734 shutdown_connections 2024-04-26T23:27:14.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- 172.21.15.39:0/3495203734 wait complete. 2024-04-26T23:27:14.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 Processor -- start 2024-04-26T23:27:14.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.628+0000 7f92ea000640 1 -- start start 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92e406d4e0 0x7f92e40ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 0x7f92e4158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92e40b4730 con 0x7f92e40cf8c0 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92e40b4140 con 0x7f92e406d970 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f92e40d17e0 con 0x7f92e406d4e0 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33188/0 (socket says 172.21.15.39:33188) 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 -- 172.21.15.39:0/118417775 learned_addr learned my addr 172.21.15.39:0/118417775 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3400640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92e406d4e0 0x7f92e40ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92daa00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 0x7f92e4158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 -- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92e406d4e0 msgr2=0x7f92e40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92e406d4e0 0x7f92e40ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 -- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 msgr2=0x7f92e4158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 0x7f92e4158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 -- 172.21.15.39:0/118417775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e40cab30 con 0x7f92e40cf8c0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92daa00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 0x7f92e4158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92e3e00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0195d0 tx=0x7f92dc019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0bc020 con 0x7f92e40cf8c0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc0b8690 con 0x7f92e40cf8c0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0b8a80 con 0x7f92e40cf8c0 2024-04-26T23:27:14.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e4141150 con 0x7f92e40cf8c0 2024-04-26T23:27:14.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e41413f0 con 0x7f92e40cf8c0 2024-04-26T23:27:14.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.632+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e406a720 con 0x7f92e40cf8c0 2024-04-26T23:27:14.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.636+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92dc0bf020 con 0x7f92e40cf8c0 2024-04-26T23:27:14.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.636+0000 7f92dbe00640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:14.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.636+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f92dc121980 con 0x7f92e40cf8c0 2024-04-26T23:27:14.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.636+0000 7f92e3400640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:14.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.636+0000 7f92e3400640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 0x7f92c006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009ac0 tx=0x7f92d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:14.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.640+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f92dc0c6030 con 0x7f92e40cf8c0 2024-04-26T23:27:14.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.864+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f92e40760f0 con 0x7f92e40cf8c0 2024-04-26T23:27:14.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.864+0000 7f92dbe00640 1 -- 172.21.15.39:0/118417775 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f92dc0165e0 con 0x7f92e40cf8c0 2024-04-26T23:27:14.876 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-04-26T23:27:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g== 2024-04-26T23:27:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: caps mds = "allow" 2024-04-26T23:27:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: caps mon = "allow r" 2024-04-26T23:27:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 msgr2=0x7f92c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 0x7f92c006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009ac0 tx=0x7f92d4009190 comp rx=0 tx=0).stop 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 msgr2=0x7f92e4159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0195d0 tx=0x7f92dc019760 comp rx=0 tx=0).stop 2024-04-26T23:27:14.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 shutdown_connections 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92e40cf8c0 0x7f92e4159170 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92e406d970 0x7f92e4158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 --2- 172.21.15.39:0/118417775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92e406d4e0 0x7f92e40ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 >> 172.21.15.39:0/118417775 conn(0x7f92e40d3040 msgr2=0x7f92e40703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 shutdown_connections 2024-04-26T23:27:14.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:14.868+0000 7f92ea000640 1 -- 172.21.15.39:0/118417775 wait complete. 2024-04-26T23:27:14.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:15.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 Processor -- start 2024-04-26T23:27:15.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 -- start start 2024-04-26T23:27:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 0x7f97600b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f976006eab0 con 0x7f976015f5d0 2024-04-26T23:27:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f97600b4d70 con 0x7f976006daf0 2024-04-26T23:27:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.028+0000 7f9766800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f97600aedf0 con 0x7f976015f1f0 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:50892/0 (socket says 172.21.15.39:50892) 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 0x7f97600b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 -- 172.21.15.39:0/3198461069 learned_addr learned my addr 172.21.15.39:0/3198461069 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 -- 172.21.15.39:0/3198461069 >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 msgr2=0x7f97600b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 --2- 172.21.15.39:0/3198461069 >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 0x7f97600b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 -- 172.21.15.39:0/3198461069 >> v1:172.21.15.71:6789/0 conn(0x7f976015f5d0 legacy=0x7f976006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 -- 172.21.15.39:0/3198461069 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97600b4720 con 0x7f976015f1f0 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975fe00640 1 --2- 172.21.15.39:0/3198461069 >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 0x7f97600b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:15.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.032+0000 7f975f400640 1 --2- 172.21.15.39:0/3198461069 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9750009870 tx=0x7f975001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d5a6c48c1b8e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975ea00640 1 -- 172.21.15.39:0/3198461069 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500b5070 con 0x7f976015f1f0 2024-04-26T23:27:15.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975ea00640 1 -- 172.21.15.39:0/3198461069 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97500a8a50 con 0x7f976015f1f0 2024-04-26T23:27:15.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975ea00640 1 -- 172.21.15.39:0/3198461069 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500a8e20 con 0x7f976015f1f0 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- 172.21.15.39:0/3198461069 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 msgr2=0x7f9760073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- 172.21.15.39:0/3198461069 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9750009870 tx=0x7f975001ed50 comp rx=0 tx=0).stop 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- 172.21.15.39:0/3198461069 shutdown_connections 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- 172.21.15.39:0/3198461069 >> v2:172.21.15.71:3300/0 conn(0x7f976006daf0 0x7f97600b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- 172.21.15.39:0/3198461069 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f1f0 0x7f9760073640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- 172.21.15.39:0/3198461069 >> 172.21.15.39:0/3198461069 conn(0x7f97600729d0 msgr2=0x7f9760072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- 172.21.15.39:0/3198461069 shutdown_connections 2024-04-26T23:27:15.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- 172.21.15.39:0/3198461069 wait complete. 2024-04-26T23:27:15.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 Processor -- start 2024-04-26T23:27:15.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- start start 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f976015f1f0 0x7f9760160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f5d0 0x7f97601440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97600ae850 con 0x7f976015f1f0 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9760073b80 con 0x7f976006daf0 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9766800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f97600ae9d0 con 0x7f976015f5d0 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f9756a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f976015f1f0 0x7f9760160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:45876/0 (socket says 172.21.15.39:45876) 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975f400640 1 -- 172.21.15.39:0/221624291 learned_addr learned my addr 172.21.15.39:0/221624291 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.036+0000 7f975fe00640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f5d0 0x7f97601440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 -- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f5d0 msgr2=0x7f97601440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f5d0 0x7f97601440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 -- 172.21.15.39:0/221624291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f976015f1f0 msgr2=0x7f9760160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f976015f1f0 0x7f9760160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 -- 172.21.15.39:0/221624291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760143920 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f975f400640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97500b3040 tx=0x7f975001baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500b5070 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97500b0de0 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500bb650 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97601612b0 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9760161870 con 0x7f976006daf0 2024-04-26T23:27:15.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9760050740 con 0x7f976006daf0 2024-04-26T23:27:15.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97500c2060 con 0x7f976006daf0 2024-04-26T23:27:15.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 0x7f973c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.040+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9750123dc0 con 0x7f976006daf0 2024-04-26T23:27:15.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.044+0000 7f9756a00640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 0x7f973c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.044+0000 7f9756a00640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 0x7f973c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f976015e4b0 tx=0x7f9748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.048+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f97500188b0 con 0x7f976006daf0 2024-04-26T23:27:15.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.244+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97600b5c40 con 0x7f976006daf0 2024-04-26T23:27:15.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.244+0000 7f9757e00640 1 -- 172.21.15.39:0/221624291 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7f97500f42e0 con 0x7f976006daf0 2024-04-26T23:27:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:15.252 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/427434532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":427434532},{"type":"v1","addr":"172.21.15.39:6834","nonce":427434532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:15.252 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 17 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 msgr2=0x7f973c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 0x7f973c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f976015e4b0 tx=0x7f9748009040 comp rx=0 tx=0).stop 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 msgr2=0x7f9760145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97500b3040 tx=0x7f975001baf0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 shutdown_connections 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f973c068380 0x7f973c06a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f976015f5d0 0x7f97601440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f976015f1f0 0x7f9760160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 --2- 172.21.15.39:0/221624291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f976006daf0 0x7f9760145ba0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 >> 172.21.15.39:0/221624291 conn(0x7f97600729d0 msgr2=0x7f97600b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 shutdown_connections 2024-04-26T23:27:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.248+0000 7f9766800640 1 -- 172.21.15.39:0/221624291 wait complete. 2024-04-26T23:27:15.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:27:09.296925+0000', 'modified': '2024-04-26T23:27:12.315061+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5031': {'gid': 5031, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6835/2348843617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6833', 'nonce': 2348843617}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 2348843617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5031, 'qdb_cluster': [5031]} 2024-04-26T23:27:15.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:27:15.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:27:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 Processor -- start 2024-04-26T23:27:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 -- start start 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 0x7efcc8072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8072180 con 0x7efcc8072e50 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80739a0 con 0x7efcc81458d0 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efccd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcc8073c80 con 0x7efcc8073400 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc7400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efcc8072e50 0x7efcc80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39986/0 (socket says 172.21.15.39:39986) 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc7400640 1 -- 172.21.15.39:0/1740869432 learned_addr learned my addr 172.21.15.39:0/1740869432 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcbe000640 1 --2- 172.21.15.39:0/1740869432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 0x7efcc8072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592332957 0 0) 0x7efcc8072180 con 0x7efcc8072e50 2024-04-26T23:27:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcac003530 con 0x7efcc8072e50 2024-04-26T23:27:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707609024 0 0) 0x7efcc80739a0 con 0x7efcc81458d0 2024-04-26T23:27:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc8072180 con 0x7efcc81458d0 2024-04-26T23:27:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcbe000640 1 -- 172.21.15.39:0/1740869432 >> v1:172.21.15.71:6789/0 conn(0x7efcc81458d0 legacy=0x7efcc80b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcbe000640 1 -- 172.21.15.39:0/1740869432 >> v1:172.21.15.39:6789/0 conn(0x7efcc8072e50 legacy=0x7efcc80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1389768708 0 0) 0x7efcac003530 con 0x7efcc8072e50 2024-04-26T23:27:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.816+0000 7efcbe000640 1 -- 172.21.15.39:0/1740869432 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc8145cb0 con 0x7efcc8073400 2024-04-26T23:27:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efcbe000640 1 --2- 172.21.15.39:0/1740869432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 0x7efcc8072910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009820 tx=0x7efcb001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6270108a4cdd131b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b0070 con 0x7efcc8073400 2024-04-26T23:27:15.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00ab600 con 0x7efcc8073400 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efcc6000640 1 -- 172.21.15.39:0/1740869432 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00ab9d0 con 0x7efcc8073400 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 -- 172.21.15.39:0/1740869432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 msgr2=0x7efcc8072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 --2- 172.21.15.39:0/1740869432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 0x7efcc8072910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009820 tx=0x7efcb001c430 comp rx=0 tx=0).stop 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 -- 172.21.15.39:0/1740869432 shutdown_connections 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 --2- 172.21.15.39:0/1740869432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8073400 0x7efcc8072910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 -- 172.21.15.39:0/1740869432 >> 172.21.15.39:0/1740869432 conn(0x7efcc806c7d0 msgr2=0x7efcc806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 -- 172.21.15.39:0/1740869432 shutdown_connections 2024-04-26T23:27:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.820+0000 7efccd800640 1 -- 172.21.15.39:0/1740869432 wait complete. 2024-04-26T23:27:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 Processor -- start 2024-04-26T23:27:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- start start 2024-04-26T23:27:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 0x7efcc815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc8073400 0x7efcc80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcc806f000 con 0x7efcc81458d0 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcc806ee80 con 0x7efcc8073400 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcc806f180 con 0x7efcc8072e50 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33208/0 (socket says 172.21.15.39:33208) 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 -- 172.21.15.39:0/1123543812 learned_addr learned my addr 172.21.15.39:0/1123543812 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc6a00640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 0x7efcc815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcbe000640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc8073400 0x7efcc80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 -- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 msgr2=0x7efcc815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 0x7efcc815adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 -- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc8073400 msgr2=0x7efcc80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc8073400 0x7efcc80b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 -- 172.21.15.39:0/1123543812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80b33c0 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc6a00640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 0x7efcc815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcc7400640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c440 tx=0x7efcc000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcbf400640 1 -- 172.21.15.39:0/1123543812 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0005cf0 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcbf400640 1 -- 172.21.15.39:0/1123543812 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0007070 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efcbf400640 1 -- 172.21.15.39:0/1123543812 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc00074a0 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc80b36a0 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.824+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc80b1950 con 0x7efcc81458d0 2024-04-26T23:27:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcbf400640 1 -- 172.21.15.39:0/1123543812 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcc001b400 con 0x7efcc81458d0 2024-04-26T23:27:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcbf400640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 0x7efca406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcbf400640 1 -- 172.21.15.39:0/1123543812 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efcc0086600 con 0x7efcc81458d0 2024-04-26T23:27:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcc6a00640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 0x7efca406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcd0bde000 1 Processor -- start 2024-04-26T23:27:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcd0bde000 1 -- start start 2024-04-26T23:27:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.828+0000 7efcc6a00640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 0x7efca406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001570 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbc700 0x563135bbcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b73b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563135a2b140 con 0x563135bbd020 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631359c0e00 con 0x563135bbc700 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x563135979a00 con 0x563135b73740 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33216/0 (socket says 172.21.15.39:33216) 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 -- 172.21.15.39:0/4091534816 learned_addr learned my addr 172.21.15.39:0/4091534816 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcc6a00640 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbc700 0x563135bbcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcc7400640 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b73b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 -- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 msgr2=0x563135b73b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b73b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 -- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbc700 msgr2=0x563135bbcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbc700 0x563135bbcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 -- 172.21.15.39:0/4091534816 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313597e0e0 con 0x563135bbd020 2024-04-26T23:27:15.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcbe000640 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efcb001c470 tx=0x7efcb00a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b086597bc966da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcb7400640 1 -- 172.21.15.39:0/4091534816 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b0070 con 0x563135bbd020 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcb7400640 1 -- 172.21.15.39:0/4091534816 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00bc070 con 0x563135bbd020 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcb7400640 1 -- 172.21.15.39:0/4091534816 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b7960 con 0x563135bbd020 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- 172.21.15.39:0/4091534816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 msgr2=0x563135b73200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efcb001c470 tx=0x7efcb00a6000 comp rx=0 tx=0).stop 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- 172.21.15.39:0/4091534816 shutdown_connections 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b73b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbd020 0x563135b73200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 --2- 172.21.15.39:0/4091534816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbc700 0x563135bbcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- 172.21.15.39:0/4091534816 >> 172.21.15.39:0/4091534816 conn(0x563135b6f6f0 msgr2=0x563135b71ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- 172.21.15.39:0/4091534816 shutdown_connections 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- 172.21.15.39:0/4091534816 wait complete. 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 -- start start 2024-04-26T23:27:15.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.832+0000 7efcd0bde000 1 Processor -- start 2024-04-26T23:27:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135b7eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631359ce200 con 0x563135bbc700 2024-04-26T23:27:15.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563135964e80 con 0x563135bbd020 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5631359bbae0 con 0x563135b73740 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 10 client.0 _ll_register_callbacks cb 0x5631359cdda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33220/0 (socket says 172.21.15.39:33220) 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 -- 172.21.15.39:0/2938521576 learned_addr learned my addr 172.21.15.39:0/2938521576 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc7400640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135b7eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc6a00640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 -- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 msgr2=0x563135b7e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b7e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 -- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 msgr2=0x563135b7eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135b7eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 -- 172.21.15.39:0/2938521576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631359604e0 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc7400640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135b7eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc6a00640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcbe000640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097f0 tx=0x7efcb001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d0724f64c00f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b0040 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb00bc070 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efcb00b7900 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efcb00d3050 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 10 client.5196 fetch_fsmap learned FSMap version 17 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x563135946e80 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00bc070 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efcb00d6020 con 0x563135bbc700 2024-04-26T23:27:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 10 client.5196 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 10 client.5196 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 20 client.5196 populate_metadata read hostname 'smithi039' 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135bcc7a0 0x563135bceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 4 client.5196 mds_command: new command op to 5031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 --> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563135959bc0 con 0x563135bcc7a0 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc6a00640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135bcc7a0 0x563135bceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 10 client.5196 ms_handle_connect on v2:172.21.15.39:6833/2348843617 2024-04-26T23:27:15.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcc6a00640 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135bcc7a0 0x563135bceb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a0eed7c6c15e7a server_cookie=2ac9fb39b9f1ba4f in_seq=0 out_seq=0 2024-04-26T23:27:15.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 1 -- 172.21.15.39:0/2938521576 <== mds.0 v2:172.21.15.39:6833/2348843617 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563135959bc0 con 0x563135bcc7a0 2024-04-26T23:27:15.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.836+0000 7efcabe00640 10 client.5196 handle_command_reply: tid=0 2024-04-26T23:27:15.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 client.5196 shutdown 2024-04-26T23:27:15.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 msgr2=0x563135b7e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097f0 tx=0x7efcb001ac70 comp rx=0 tx=0).stop 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 shutdown_connections 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135bcc7a0 0x563135bceb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135b7eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135b7e5e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 --2- 172.21.15.39:0/2938521576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135b7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcabe00640 0 client.5196 ms_handle_reset on v2:172.21.15.39:6833/2348843617 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 >> 172.21.15.39:0/2938521576 conn(0x563135b6f6f0 msgr2=0x563135b72370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 shutdown_connections 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 1 -- 172.21.15.39:0/2938521576 wait complete. 2024-04-26T23:27:15.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.840+0000 7efcd0bde000 20 client.5196 trim_cache size 0 max 16384 2024-04-26T23:27:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 Processor -- start 2024-04-26T23:27:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 -- start start 2024-04-26T23:27:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135b73740 0x563135c27f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135bbd020 0x563135c289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80c6bf0 con 0x563135bbc700 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80c5f50 con 0x563135b73740 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80c65a0 con 0x563135bbd020 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33232/0 (socket says 172.21.15.39:33232) 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcbe000640 1 -- 172.21.15.39:0/3504827130 learned_addr learned my addr 172.21.15.39:0/3504827130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcc6a00640 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135b73740 0x563135c27f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.856+0000 7efcc7400640 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135bbd020 0x563135c289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135bbd020 msgr2=0x563135c289b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135bbd020 0x563135c289b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135b73740 msgr2=0x563135c27f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135b73740 0x563135c27f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3504827130 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563135979c50 con 0x563135bbc700 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efcb001aae0 tx=0x7efcb00c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b540d00e0f361528 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcb6a00640 1 -- 172.21.15.39:0/3504827130 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b7900 con 0x563135bbc700 2024-04-26T23:27:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcb6a00640 1 -- 172.21.15.39:0/3504827130 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00bc070 con 0x563135bbc700 2024-04-26T23:27:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcb6a00640 1 -- 172.21.15.39:0/3504827130 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00cb630 con 0x563135bbc700 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- 172.21.15.39:0/3504827130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 msgr2=0x563135c28470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efcb001aae0 tx=0x7efcb00c2000 comp rx=0 tx=0).stop 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- 172.21.15.39:0/3504827130 shutdown_connections 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135bbd020 0x563135c289b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135c28470 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3504827130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135b73740 0x563135c27f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- 172.21.15.39:0/3504827130 >> 172.21.15.39:0/3504827130 conn(0x563135b6f6f0 msgr2=0x563135b7e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- 172.21.15.39:0/3504827130 shutdown_connections 2024-04-26T23:27:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- 172.21.15.39:0/3504827130 wait complete. 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- start start 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 Processor -- start 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135bd12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135be8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5631359c0110 con 0x563135bbc700 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631359567b0 con 0x563135bbd020 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5631359c5430 con 0x563135b73740 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcd0bde000 10 client.0 _ll_register_callbacks cb 0x7efcb80016c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33234/0 (socket says 172.21.15.39:33234) 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3372288595 learned_addr learned my addr 172.21.15.39:0/3372288595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcc6a00640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135bd12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcc7400640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135be8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 msgr2=0x563135bd12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135bd12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 msgr2=0x563135be8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135be8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 -- 172.21.15.39:0/3372288595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563135a43160 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcc7400640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135be8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcbe000640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009160 tx=0x7efcb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c4f3bd29ab85f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.860+0000 7efcabe00640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00b0070 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efcb00d8aa0 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb00bc070 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efcb00d8ce0 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 10 client.5202 fetch_fsmap learned FSMap version 17 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56313567a0c0 con 0x563135bbc700 2024-04-26T23:27:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00bc070 con 0x563135bbc700 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efcb00d6040 con 0x563135bbc700 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 10 client.5202 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 10 client.5202 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 20 client.5202 populate_metadata read hostname 'smithi039' 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135c31b80 0x563135c33f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 4 client.5202 mds_command: new command op to 5031 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 --> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] -- command(tid 0: {"prefix": "status"}) -- 0x5631359cea10 con 0x563135c31b80 2024-04-26T23:27:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcc6a00640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135c31b80 0x563135c33f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcc6a00640 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135c31b80 0x563135c33f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b82026b5b0aaf6 server_cookie=d426d14fb057db3b in_seq=0 out_seq=0 2024-04-26T23:27:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 10 client.5202 ms_handle_connect on v2:172.21.15.39:6833/2348843617 2024-04-26T23:27:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 1 -- 172.21.15.39:0/3372288595 <== mds.0 v2:172.21.15.39:6833/2348843617 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5631359cea10 con 0x563135c31b80 2024-04-26T23:27:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 10 client.5202 handle_command_reply: tid=0 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 client.5202 shutdown 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 msgr2=0x563135be8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009160 tx=0x7efcb0008040 comp rx=0 tx=0).stop 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 shutdown_connections 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:6833/2348843617,v1:172.21.15.39:6835/2348843617] conn(0x563135c31b80 0x563135c33f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563135bbd020 0x563135be8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563135bbc700 0x563135be8720 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 --2- 172.21.15.39:0/3372288595 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563135b73740 0x563135bd12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcabe00640 0 client.5202 ms_handle_reset on v2:172.21.15.39:6833/2348843617 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 >> 172.21.15.39:0/3372288595 conn(0x563135b6f6f0 msgr2=0x563135b7e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 shutdown_connections 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 1 -- 172.21.15.39:0/3372288595 wait complete. 2024-04-26T23:27:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efcd0bde000 20 client.5202 trim_cache size 0 max 16384 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "65ff9fdb-1208-4558-966c-a36e641138f0", 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5031, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 5.9495422979999999, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 17, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 33, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 33, 2024-04-26T23:27:15.875 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 13.833164696000001 2024-04-26T23:27:15.876 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:27:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 msgr2=0x7efca406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 0x7efca406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001570 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2024-04-26T23:27:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 msgr2=0x7efcc80b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c440 tx=0x7efcc000c900 comp rx=0 tx=0).stop 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 shutdown_connections 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efca4068380 0x7efca406a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc81458d0 0x7efcc80b1e70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc8073400 0x7efcc80b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 --2- 172.21.15.39:0/1123543812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcc8072e50 0x7efcc815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 >> 172.21.15.39:0/1123543812 conn(0x7efcc806c7d0 msgr2=0x7efcc80afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 shutdown_connections 2024-04-26T23:27:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:15.864+0000 7efccd800640 1 -- 172.21.15.39:0/1123543812 wait complete. 2024-04-26T23:27:15.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:27:16.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 Processor -- start 2024-04-26T23:27:16.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 -- start start 2024-04-26T23:27:16.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f11840cdbf0 0x7f118406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1184074750 con 0x7f11840cd810 2024-04-26T23:27:16.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f11840d0b10 con 0x7f11840cdbf0 2024-04-26T23:27:16.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f118b600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f118406e970 con 0x7f11840742f0 2024-04-26T23:27:16.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f1183e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f1183e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:50950/0 (socket says 172.21.15.39:50950) 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f1183e00640 1 -- 172.21.15.39:0/3364153046 learned_addr learned my addr 172.21.15.39:0/3364153046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f1188c00640 1 --1- 172.21.15.39:0/3364153046 >> v1:172.21.15.71:6789/0 conn(0x7f11840cd810 0x7f1184144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:33962/0 (socket says 172.21.15.39:33962) 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.028+0000 7f1189600640 1 --2- 172.21.15.39:0/3364153046 >> v2:172.21.15.71:3300/0 conn(0x7f11840cdbf0 0x7f118406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183400640 1 -- 172.21.15.39:0/3364153046 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283988250 0 0) 0x7f1184074750 con 0x7f11840cd810 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183e00640 1 -- 172.21.15.39:0/3364153046 >> v2:172.21.15.71:3300/0 conn(0x7f11840cdbf0 msgr2=0x7f118406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183e00640 1 --2- 172.21.15.39:0/3364153046 >> v2:172.21.15.71:3300/0 conn(0x7f11840cdbf0 0x7f118406ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183e00640 1 -- 172.21.15.39:0/3364153046 >> v1:172.21.15.71:6789/0 conn(0x7f11840cd810 legacy=0x7f1184144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183e00640 1 -- 172.21.15.39:0/3364153046 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11840d0550 con 0x7f11840742f0 2024-04-26T23:27:16.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183e00640 1 --2- 172.21.15.39:0/3364153046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1170009870 tx=0x7f117001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bcca75d82cdfa2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:16.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183400640 1 -- 172.21.15.39:0/3364153046 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11700b0070 con 0x7f11840742f0 2024-04-26T23:27:16.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183400640 1 -- 172.21.15.39:0/3364153046 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11700ab600 con 0x7f11840742f0 2024-04-26T23:27:16.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.032+0000 7f1183400640 1 -- 172.21.15.39:0/3364153046 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11700ab9d0 con 0x7f11840742f0 2024-04-26T23:27:16.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- 172.21.15.39:0/3364153046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 msgr2=0x7f11840cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- 172.21.15.39:0/3364153046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1170009870 tx=0x7f117001c410 comp rx=0 tx=0).stop 2024-04-26T23:27:16.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- 172.21.15.39:0/3364153046 shutdown_connections 2024-04-26T23:27:16.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- 172.21.15.39:0/3364153046 >> v2:172.21.15.71:3300/0 conn(0x7f11840cdbf0 0x7f118406ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- 172.21.15.39:0/3364153046 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840742f0 0x7f11840cfe00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- 172.21.15.39:0/3364153046 >> 172.21.15.39:0/3364153046 conn(0x7f11840b2af0 msgr2=0x7f11840b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- 172.21.15.39:0/3364153046 shutdown_connections 2024-04-26T23:27:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- 172.21.15.39:0/3364153046 wait complete. 2024-04-26T23:27:16.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 Processor -- start 2024-04-26T23:27:16.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- start start 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11840cd810 0x7f11841fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840cdbf0 0x7f11841fa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1184143d30 con 0x7f11840742f0 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1184143bb0 con 0x7f11840cd810 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f118b600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1184169ef0 con 0x7f11840cdbf0 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33244/0 (socket says 172.21.15.39:33244) 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 -- 172.21.15.39:0/411006604 learned_addr learned my addr 172.21.15.39:0/411006604 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1189600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840cdbf0 0x7f11841fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1183e00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11840cd810 0x7f11841fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 -- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840cdbf0 msgr2=0x7f11841fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840cdbf0 0x7f11841fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 -- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11840cd810 msgr2=0x7f11841fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11840cd810 0x7f11841fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.036+0000 7f1188c00640 1 -- 172.21.15.39:0/411006604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11841f7e00 con 0x7f11840742f0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1188c00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11780011f0 tx=0x7f117800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178018070 con 0x7f11840742f0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11780074e0 con 0x7f11840742f0 2024-04-26T23:27:16.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178004a10 con 0x7f11840742f0 2024-04-26T23:27:16.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841fbe10 con 0x7f11840742f0 2024-04-26T23:27:16.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1184161d70 con 0x7f11840742f0 2024-04-26T23:27:16.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1184050740 con 0x7f11840742f0 2024-04-26T23:27:16.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1178004bb0 con 0x7f11840742f0 2024-04-26T23:27:16.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 0x7f116406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:16.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.040+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1178085c10 con 0x7f11840742f0 2024-04-26T23:27:16.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.044+0000 7f1183e00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 0x7f116406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:16.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.044+0000 7f1183e00640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 0x7f116406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11700ad000 tx=0x7f11700a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:16.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.048+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11841fbe10 con 0x7f11840742f0 2024-04-26T23:27:16.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.244+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f11841faad0 con 0x7f11840742f0 2024-04-26T23:27:16.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.244+0000 7f1180c00640 1 -- 172.21.15.39:0/411006604 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f11841f7e00 con 0x7f11840742f0 2024-04-26T23:27:16.252 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 msgr2=0x7f116406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 0x7f116406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11700ad000 tx=0x7f11700a4f90 comp rx=0 tx=0).stop 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 msgr2=0x7f11841f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11780011f0 tx=0x7f117800c9b0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 shutdown_connections 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1164068380 0x7f116406a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f11840cdbf0 0x7f11841fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11840cd810 0x7f11841fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 --2- 172.21.15.39:0/411006604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11840742f0 0x7f11841f78c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:16.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 >> 172.21.15.39:0/411006604 conn(0x7f11840b2af0 msgr2=0x7f118415cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:16.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 shutdown_connections 2024-04-26T23:27:16.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16.248+0000 7f118b600640 1 -- 172.21.15.39:0/411006604 wait complete. 2024-04-26T23:27:16.273 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:27:16.274 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:16.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.274 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-04-26T23:27:16.283 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:27:16.283 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:27:16.283 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:27:16.283 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.283 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42393sec preferred_lft 42393sec 2024-04-26T23:27:16.284 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:23:a8:f7:18 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:16.286 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:27:16.287 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:16.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.288 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:27:16.350 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-04-26T23:27:16.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.353 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-04-26T23:27:16.405 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-04-26T23:27:16.405 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:27:16.405 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:27:16.405 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:27:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:27:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:27:16.406 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:27:16.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:27:16.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:16.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.548 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:27:16.604 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:27:16.604 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:27:16.605 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:16.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-04-26T23:27:16.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:16.669 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:16.720 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:16.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:16.720 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:16.775 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:27:16.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:16.866 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:16.866 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:16.866 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:16.881 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:16.881 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:16.881 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:16.881 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:16.881 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:27:16.891 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:27:16.895 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:27:16.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:16.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:16.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:27:17.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:27:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:17.027 INFO:teuthology.orchestra.run.smithi039.stdout:client4955 2024-04-26T23:27:17.027 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:17.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:17.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:27:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.212+0000 7fa7d9200640 1 Processor -- start 2024-04-26T23:27:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.212+0000 7fa7d9200640 1 -- start start 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d9200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7d40cfe00 0x7fa7d4144050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d9200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d4144590 con 0x7fa7d40cdbf0 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d9200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40d0b10 con 0x7fa7d40cfe00 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d9200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d406e970 con 0x7fa7d40cd810 2024-04-26T23:27:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7cbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7d40cfe00 0x7fa7d4144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d2800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa7d40cdbf0 0x7fa7d406ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39990/0 (socket says 172.21.15.39:39990) 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d2800640 1 -- 172.21.15.39:0/2927805144 learned_addr learned my addr 172.21.15.39:0/2927805144 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d1e00640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7cbe00640 1 -- 172.21.15.39:0/2927805144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 msgr2=0x7fa7d40742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7cbe00640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d40742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7cbe00640 1 -- 172.21.15.39:0/2927805144 >> v1:172.21.15.39:6789/0 conn(0x7fa7d40cdbf0 legacy=0x7fa7d406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7cbe00640 1 -- 172.21.15.39:0/2927805144 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d40d0550 con 0x7fa7d40cfe00 2024-04-26T23:27:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.216+0000 7fa7d1400640 1 -- 172.21.15.39:0/2927805144 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935816582 0 0) 0x7fa7d4144590 con 0x7fa7d40cdbf0 2024-04-26T23:27:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7cbe00640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d4144050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097c0 tx=0x7fa7bc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2b1845881866a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d1400640 1 -- 172.21.15.39:0/2927805144 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0ab610 con 0x7fa7d40cfe00 2024-04-26T23:27:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d1400640 1 -- 172.21.15.39:0/2927805144 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0b0070 con 0x7fa7d40cfe00 2024-04-26T23:27:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d1400640 1 -- 172.21.15.39:0/2927805144 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0ab9d0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- 172.21.15.39:0/2927805144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 msgr2=0x7fa7d4144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d4144050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097c0 tx=0x7fa7bc01c410 comp rx=0 tx=0).stop 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- 172.21.15.39:0/2927805144 shutdown_connections 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d4144050 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 --2- 172.21.15.39:0/2927805144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- 172.21.15.39:0/2927805144 >> 172.21.15.39:0/2927805144 conn(0x7fa7d40b2af0 msgr2=0x7fa7d40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- 172.21.15.39:0/2927805144 shutdown_connections 2024-04-26T23:27:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- 172.21.15.39:0/2927805144 wait complete. 2024-04-26T23:27:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 Processor -- start 2024-04-26T23:27:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.220+0000 7fa7d9200640 1 -- start start 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d4142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7d40cdbf0 0x7fa7d414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40ce040 con 0x7fa7d40cfe00 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d406f920 con 0x7fa7d40cdbf0 2024-04-26T23:27:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d40ce1c0 con 0x7fa7d40cd810 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33268/0 (socket says 172.21.15.39:33268) 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 -- 172.21.15.39:0/3533007915 learned_addr learned my addr 172.21.15.39:0/3533007915 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d1e00640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7cbe00640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7d40cdbf0 0x7fa7d414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 -- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 msgr2=0x7fa7d4142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d4142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 -- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7d40cdbf0 msgr2=0x7fa7d414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7d40cdbf0 0x7fa7d414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 -- 172.21.15.39:0/3533007915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d40aee10 con 0x7fa7d40cfe00 2024-04-26T23:27:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d2800640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c7d0 tx=0x7fa7cc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc018070 con 0x7fa7d40cfe00 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7cc00a640 con 0x7fa7d40cfe00 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00aa70 con 0x7fa7d40cfe00 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d40af0f0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d40af6b0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d4050740 con 0x7fa7d40cfe00 2024-04-26T23:27:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.224+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7cc00ac10 con 0x7fa7d40cfe00 2024-04-26T23:27:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.228+0000 7fa7ca000640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 0x7fa7b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.228+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa7cc085ff0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.228+0000 7fa7d1e00640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 0x7fa7b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.228+0000 7fa7d1e00640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 0x7fa7b006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40b06d0 tx=0x7fa7c4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.232+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa7cc055ec0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa7d40d1860 con 0x7fa7d40cfe00 2024-04-26T23:27:17.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7ca000640 1 -- 172.21.15.39:0/3533007915 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fa7cc05a1c0 con 0x7fa7d40cfe00 2024-04-26T23:27:17.438 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 msgr2=0x7fa7b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 0x7fa7b006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40b06d0 tx=0x7fa7c4009190 comp rx=0 tx=0).stop 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 msgr2=0x7fa7d41501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c7d0 tx=0x7fa7cc00cc90 comp rx=0 tx=0).stop 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 shutdown_connections 2024-04-26T23:27:17.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa7b0068380 0x7fa7b006a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d40cfe00 0x7fa7d41501f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7d40cdbf0 0x7fa7d414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 --2- 172.21.15.39:0/3533007915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7d40cd810 0x7fa7d4142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 >> 172.21.15.39:0/3533007915 conn(0x7fa7d40b2af0 msgr2=0x7fa7d4158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.432+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 shutdown_connections 2024-04-26T23:27:17.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:17.436+0000 7fa7d9200640 1 -- 172.21.15.39:0/3533007915 wait complete. 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:27:17.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:27:17.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.460 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-26T23:27:17.470 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:27:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:27:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:27:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:27:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 02:42:96:98:d1:ab brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:27:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:17.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.474 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:27:17.535 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:27:17.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.537 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:27:17.592 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:27:17.593 INFO:teuthology.orchestra.run.smithi071.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:17.593 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:17.593 INFO:teuthology.orchestra.run.smithi071.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:17.593 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:27:17.593 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:27:17.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:27:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:27:17.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:17.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.743 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:27:17.751 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:27:17.751 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:27:17.752 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:27:17.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-26T23:27:17.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:17.815 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:17.863 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:27:17.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:17.864 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:17.915 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:27:17.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:17.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:27:18.004 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:27:18.004 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:27:18.004 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:27:18.019 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:27:18.019 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:27:18.019 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:27:18.019 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:18.019 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:27:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:27:18.029 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:27:18.032 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:27:18.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:18.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:18.052 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:27:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:27:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:27:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:18.154 INFO:teuthology.orchestra.run.smithi071.stdout:client4964 2024-04-26T23:27:18.155 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:18.155 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:18.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-26T23:27:18.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.304+0000 7fa775a00640 1 Processor -- start 2024-04-26T23:27:18.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.304+0000 7fa775a00640 1 -- start start 2024-04-26T23:27:18.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa775a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa7700cf1b0 0x7fa77015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa775a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7700d0bd0 0x7fa7700d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa775a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7700cd8a0 con 0x7fa7700d33f0 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa775a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa7700cd650 con 0x7fa7700d0bd0 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa775a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa77015e7d0 con 0x7fa7700cf1b0 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7700d0bd0 0x7fa7700d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76ea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa7700d33f0 0x7fa7701615e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39998/0 (socket says 172.21.15.39:39998) 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76ea00640 1 -- 172.21.15.39:0/537797148 learned_addr learned my addr 172.21.15.39:0/537797148 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:18.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa767e00640 1 --2- 172.21.15.39:0/537797148 >> v2:172.21.15.71:3300/0 conn(0x7fa7700cf1b0 0x7fa77015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 -- 172.21.15.39:0/537797148 >> v2:172.21.15.71:3300/0 conn(0x7fa7700cf1b0 msgr2=0x7fa77015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:18.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 --2- 172.21.15.39:0/537797148 >> v2:172.21.15.71:3300/0 conn(0x7fa7700cf1b0 0x7fa77015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 -- 172.21.15.39:0/537797148 >> v1:172.21.15.39:6789/0 conn(0x7fa7700d33f0 legacy=0x7fa7701615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 -- 172.21.15.39:0/537797148 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7700cdb80 con 0x7fa7700d0bd0 2024-04-26T23:27:18.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76e000640 1 -- 172.21.15.39:0/537797148 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163794850 0 0) 0x7fa7700cd8a0 con 0x7fa7700d33f0 2024-04-26T23:27:18.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.308+0000 7fa76f400640 1 --2- 172.21.15.39:0/537797148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d0bd0 0x7fa7700d1080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa7700c68b0 tx=0x7fa76801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5053d6b01f448cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:18.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa76e000640 1 -- 172.21.15.39:0/537797148 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b2070 con 0x7fa7700d0bd0 2024-04-26T23:27:18.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa76e000640 1 -- 172.21.15.39:0/537797148 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7680a5870 con 0x7fa7700d0bd0 2024-04-26T23:27:18.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa76e000640 1 -- 172.21.15.39:0/537797148 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680a5c40 con 0x7fa7700d0bd0 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- 172.21.15.39:0/537797148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d0bd0 msgr2=0x7fa7700d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- 172.21.15.39:0/537797148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d0bd0 0x7fa7700d1080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa7700c68b0 tx=0x7fa76801c8a0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- 172.21.15.39:0/537797148 shutdown_connections 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- 172.21.15.39:0/537797148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d0bd0 0x7fa7700d1080 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- 172.21.15.39:0/537797148 >> v2:172.21.15.71:3300/0 conn(0x7fa7700cf1b0 0x7fa77015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- 172.21.15.39:0/537797148 >> 172.21.15.39:0/537797148 conn(0x7fa77006cb10 msgr2=0x7fa770068170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- 172.21.15.39:0/537797148 shutdown_connections 2024-04-26T23:27:18.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- 172.21.15.39:0/537797148 wait complete. 2024-04-26T23:27:18.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 Processor -- start 2024-04-26T23:27:18.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- start start 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7700d0bd0 0x7fa770155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa770156b10 0x7fa7701430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700d3950 con 0x7fa7700d33f0 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700d37d0 con 0x7fa770156b10 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa775a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa77016a180 con 0x7fa7700d0bd0 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa767e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa767e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33296/0 (socket says 172.21.15.39:33296) 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa767e00640 1 -- 172.21.15.39:0/793199251 learned_addr learned my addr 172.21.15.39:0/793199251 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa76ea00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7700d0bd0 0x7fa770155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.312+0000 7fa76f400640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa770156b10 0x7fa7701430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 -- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7700d0bd0 msgr2=0x7fa770155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7700d0bd0 0x7fa770155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 -- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa770156b10 msgr2=0x7fa7701430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa770156b10 0x7fa7701430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 -- 172.21.15.39:0/793199251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77006ed00 con 0x7fa7700d33f0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa767e00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e870 tx=0x7fa75800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758017070 con 0x7fa7700d33f0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75800c940 con 0x7fa7700d33f0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75800ccf0 con 0x7fa7700d33f0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa770155a70 con 0x7fa7700d33f0 2024-04-26T23:27:18.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa770156030 con 0x7fa7700d33f0 2024-04-26T23:27:18.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa770050740 con 0x7fa7700d33f0 2024-04-26T23:27:18.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa75801a070 con 0x7fa7700d33f0 2024-04-26T23:27:18.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:18.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.316+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa7580867d0 con 0x7fa7700d33f0 2024-04-26T23:27:18.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.320+0000 7fa76ea00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:18.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.320+0000 7fa76ea00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 0x7fa74c06a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa760007fd0 tx=0x7fa760007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:18.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.320+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa7580566b0 con 0x7fa7700d33f0 2024-04-26T23:27:18.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.524+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa770070fe0 con 0x7fa7700d33f0 2024-04-26T23:27:18.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.964+0000 7fa766a00640 1 -- 172.21.15.39:0/793199251 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7fa75805a9b0 con 0x7fa7700d33f0 2024-04-26T23:27:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 msgr2=0x7fa74c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 0x7fa74c06a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa760007fd0 tx=0x7fa760007d60 comp rx=0 tx=0).stop 2024-04-26T23:27:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 msgr2=0x7fa77006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e870 tx=0x7fa75800ec70 comp rx=0 tx=0).stop 2024-04-26T23:27:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 shutdown_connections 2024-04-26T23:27:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa770156b10 0x7fa7701430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7700d33f0 0x7fa77006e7c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 --2- 172.21.15.39:0/793199251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7700d0bd0 0x7fa770155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 >> 172.21.15.39:0/793199251 conn(0x7fa7700cf1b0 msgr2=0x7fa7700d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 shutdown_connections 2024-04-26T23:27:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:18.968+0000 7fa775a00640 1 -- 172.21.15.39:0/793199251 wait complete. 2024-04-26T23:27:18.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:27:19.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.136+0000 7f16ac800640 1 Processor -- start 2024-04-26T23:27:19.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.136+0000 7f16ac800640 1 -- start start 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.136+0000 7f16ac800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a40cff80 0x7f16a40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.136+0000 7f16ac800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f16a406d780 0x7f16a40afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16ac800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16a40b0200 0x7f16a415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16ac800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f16a40d3ef0 con 0x7f16a40b0200 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16ac800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f16a406de60 con 0x7f16a406d780 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16ac800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40d2510 con 0x7f16a40cff80 2024-04-26T23:27:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16a40b0200 0x7f16a415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16a40b0200 0x7f16a415eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33304/0 (socket says 172.21.15.39:33304) 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 -- 172.21.15.39:0/3794771864 learned_addr learned my addr 172.21.15.39:0/3794771864 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16a9400640 1 --2- 172.21.15.39:0/3794771864 >> v2:172.21.15.71:3300/0 conn(0x7f16a406d780 0x7f16a40afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16a9e00640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a40cff80 0x7f16a40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 -- 172.21.15.39:0/3794771864 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a40cff80 msgr2=0x7f16a40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a40cff80 0x7f16a40b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 -- 172.21.15.39:0/3794771864 >> v2:172.21.15.71:3300/0 conn(0x7f16a406d780 msgr2=0x7f16a40afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 --2- 172.21.15.39:0/3794771864 >> v2:172.21.15.71:3300/0 conn(0x7f16a406d780 0x7f16a40afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 -- 172.21.15.39:0/3794771864 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a406e0b0 con 0x7f16a40b0200 2024-04-26T23:27:19.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16aa800640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a415eca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16a4073fd0 tx=0x7f16a001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cacfe06b005fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16a8a00640 1 -- 172.21.15.39:0/3794771864 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00a5700 con 0x7f16a40b0200 2024-04-26T23:27:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16a8a00640 1 -- 172.21.15.39:0/3794771864 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a00a58a0 con 0x7f16a40b0200 2024-04-26T23:27:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.140+0000 7f16a8a00640 1 -- 172.21.15.39:0/3794771864 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00a5c70 con 0x7f16a40b0200 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- 172.21.15.39:0/3794771864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 msgr2=0x7f16a415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a415eca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16a4073fd0 tx=0x7f16a001c8a0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- 172.21.15.39:0/3794771864 shutdown_connections 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a415eca0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- 172.21.15.39:0/3794771864 >> v2:172.21.15.71:3300/0 conn(0x7f16a406d780 0x7f16a40afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- 172.21.15.39:0/3794771864 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a40cff80 0x7f16a40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- 172.21.15.39:0/3794771864 >> 172.21.15.39:0/3794771864 conn(0x7f16a40d3030 msgr2=0x7f16a40d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- 172.21.15.39:0/3794771864 shutdown_connections 2024-04-26T23:27:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- 172.21.15.39:0/3794771864 wait complete. 2024-04-26T23:27:19.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 Processor -- start 2024-04-26T23:27:19.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- start start 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a406d780 0x7f16a415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16a40cff80 0x7f16a40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40b26f0 con 0x7f16a40b0200 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16a406db60 con 0x7f16a40cff80 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16ac800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40b2870 con 0x7f16a406d780 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33312/0 (socket says 172.21.15.39:33312) 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 -- 172.21.15.39:0/4052522726 learned_addr learned my addr 172.21.15.39:0/4052522726 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9e00640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a406d780 0x7f16a415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16aa800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16a40cff80 0x7f16a40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 -- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a406d780 msgr2=0x7f16a415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a406d780 0x7f16a415fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 -- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16a40cff80 msgr2=0x7f16a40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16a40cff80 0x7f16a40ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.144+0000 7f16a9400640 1 -- 172.21.15.39:0/4052522726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a41612e0 con 0x7f16a40b0200 2024-04-26T23:27:19.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f16a9400640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f169400d800 tx=0x7f169400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169400b6c0 con 0x7f16a40b0200 2024-04-26T23:27:19.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1694019070 con 0x7f16a40b0200 2024-04-26T23:27:19.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a41615c0 con 0x7f16a40b0200 2024-04-26T23:27:19.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169400ba60 con 0x7f16a40b0200 2024-04-26T23:27:19.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a4161b80 con 0x7f16a40b0200 2024-04-26T23:27:19.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a406a720 con 0x7f16a40b0200 2024-04-26T23:27:19.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f169400bc00 con 0x7f16a40b0200 2024-04-26T23:27:19.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 0x7f168806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1694086d20 con 0x7f16a40b0200 2024-04-26T23:27:19.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.148+0000 7f16a9e00640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 0x7f168806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.152+0000 7f16a9e00640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 0x7f168806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1698007940 tx=0x7f1698008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.152+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1694056c80 con 0x7f16a40b0200 2024-04-26T23:27:19.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.344+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f16a40c9ac0 con 0x7f1688068380 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f169e000640 1 -- 172.21.15.39:0/4052522726 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f16a40c9ac0 con 0x7f1688068380 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs" 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:19.352 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:27:19.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 msgr2=0x7f168806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 0x7f168806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1698007940 tx=0x7f1698008040 comp rx=0 tx=0).stop 2024-04-26T23:27:19.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 msgr2=0x7f16a40cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f169400d800 tx=0x7f169400dcc0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 shutdown_connections 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1688068380 0x7f168806a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16a40cff80 0x7f16a40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16a40b0200 0x7f16a40cc570 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 --2- 172.21.15.39:0/4052522726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f16a406d780 0x7f16a415fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 >> 172.21.15.39:0/4052522726 conn(0x7f16a40d3030 msgr2=0x7f16a40b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 shutdown_connections 2024-04-26T23:27:19.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.348+0000 7f16ac800640 1 -- 172.21.15.39:0/4052522726 wait complete. 2024-04-26T23:27:19.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:27:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 Processor -- start 2024-04-26T23:27:19.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 -- start start 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba540b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba54072180 con 0x7fba54073400 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba540739a0 con 0x7fba540ce5e0 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba5c600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba54073c80 con 0x7fba541458d0 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba59200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fba54073400 0x7fba54072910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40006/0 (socket says 172.21.15.39:40006) 2024-04-26T23:27:19.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba59200640 1 -- 172.21.15.39:0/2846747429 learned_addr learned my addr 172.21.15.39:0/2846747429 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba59c00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba540b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370162057 0 0) 0x7fba54072180 con 0x7fba54073400 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c003530 con 0x7fba54073400 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4089250123 0 0) 0x7fba3c003530 con 0x7fba54073400 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 msgr2=0x7fba540b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba540b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 >> v1:172.21.15.71:6789/0 conn(0x7fba540ce5e0 legacy=0x7fba5406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba54145cb0 con 0x7fba54073400 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fba40001680 con 0x7fba54073400 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 >> v1:172.21.15.39:6789/0 conn(0x7fba54073400 legacy=0x7fba54072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073c80 con 0x7fba3c004810 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c00bb00 con 0x7fba3c0039f0 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.512+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c00df10 con 0x7fba541458d0 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59c00640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba5a600640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 -- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 msgr2=0x7fba3c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba3c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 -- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c0039f0 msgr2=0x7fba3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 -- 172.21.15.39:0/2846747429 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c003530 con 0x7fba3c004810 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba5a600640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba541458d0 0x7fba3c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba59200640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c210 tx=0x7fba4001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaadbb2abd029ca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40007d40 con 0x7fba3c004810 2024-04-26T23:27:19.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba400a9070 con 0x7fba3c004810 2024-04-26T23:27:19.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba53e00640 1 -- 172.21.15.39:0/2846747429 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40005d40 con 0x7fba3c004810 2024-04-26T23:27:19.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba5c600640 1 -- 172.21.15.39:0/2846747429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba3c004810 msgr2=0x7fba3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.516+0000 7fba5c600640 1 --2- 172.21.15.39:0/2846747429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c210 tx=0x7fba4001cca0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 -- 172.21.15.39:0/2846747429 reap_dead start 2024-04-26T23:27:19.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- 172.21.15.39:0/2846747429 shutdown_connections 2024-04-26T23:27:19.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- 172.21.15.39:0/2846747429 >> 172.21.15.39:0/2846747429 conn(0x7fba5406c7d0 msgr2=0x7fba5406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:19.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- 172.21.15.39:0/2846747429 shutdown_connections 2024-04-26T23:27:19.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- 172.21.15.39:0/2846747429 wait complete. 2024-04-26T23:27:19.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 Processor -- start 2024-04-26T23:27:19.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- start start 2024-04-26T23:27:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c004810 0x7fba5415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5415e4a0 0x7fba5415e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073230 con 0x7fba541f81b0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba5406fe90 con 0x7fba3c004810 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5c600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba540ce9f0 con 0x7fba5415e4a0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33328/0 (socket says 172.21.15.39:33328) 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 -- 172.21.15.39:0/206990459 learned_addr learned my addr 172.21.15.39:0/206990459 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba59c00640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c004810 0x7fba5415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba59200640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5415e4a0 0x7fba5415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 -- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5415e4a0 msgr2=0x7fba5415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5415e4a0 0x7fba5415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 -- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c004810 msgr2=0x7fba5415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c004810 0x7fba5415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 -- 172.21.15.39:0/206990459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba541f8f80 con 0x7fba541f81b0 2024-04-26T23:27:19.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.520+0000 7fba5a600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000f90 tx=0x7fba4c00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c003b90 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c003d50 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba541f9560 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c006b60 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5415ee60 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5406a720 con 0x7fba541f81b0 2024-04-26T23:27:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba4c01a030 con 0x7fba541f81b0 2024-04-26T23:27:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 0x7fba3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fba4c085bd0 con 0x7fba541f81b0 2024-04-26T23:27:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.524+0000 7fba59c00640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 0x7fba3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.528+0000 7fba59c00640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 0x7fba3406a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba48009be0 tx=0x7fba48009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.528+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba4c021060 con 0x7fba541f81b0 2024-04-26T23:27:19.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.696+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fba540b50b0 con 0x7fba541f81b0 2024-04-26T23:27:19.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.696+0000 7fba51600640 1 -- 172.21.15.39:0/206990459 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fba4c056180 con 0x7fba541f81b0 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 msgr2=0x7fba3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 0x7fba3406a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba48009be0 tx=0x7fba48009190 comp rx=0 tx=0).stop 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 msgr2=0x7fba541f8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000f90 tx=0x7fba4c00ead0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 shutdown_connections 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba340683b0 0x7fba3406a870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba541f81b0 0x7fba541f8630 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5415e4a0 0x7fba5415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 --2- 172.21.15.39:0/206990459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba3c004810 0x7fba5415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 >> 172.21.15.39:0/206990459 conn(0x7fba5406c7d0 msgr2=0x7fba54144710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:19.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 shutdown_connections 2024-04-26T23:27:19.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.700+0000 7fba5c600640 1 -- 172.21.15.39:0/206990459 wait complete. 2024-04-26T23:27:19.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create vol99840 2024-04-26T23:27:19.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 Processor -- start 2024-04-26T23:27:19.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 -- start start 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa5f4165f30 0x7fa5f4168320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f40684f0 con 0x7fa5f406ea10 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f406fe00 con 0x7fa5f4070050 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f9400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f406dd70 con 0x7fa5f4165f30 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f2800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa5f406ea10 0x7fa5f406cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40020/0 (socket says 172.21.15.39:40020) 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f2800640 1 -- 172.21.15.39:0/2390059741 learned_addr learned my addr 172.21.15.39:0/2390059741 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:19.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f3200640 1 --2- 172.21.15.39:0/2390059741 >> v2:172.21.15.39:3300/0 conn(0x7fa5f4165f30 0x7fa5f4168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738261888 0 0) 0x7fa5f40684f0 con 0x7fa5f406ea10 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5d8003530 con 0x7fa5f406ea10 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f3200640 1 -- 172.21.15.39:0/2390059741 >> v1:172.21.15.71:6789/0 conn(0x7fa5f4070050 legacy=0x7fa5f406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257767328 0 0) 0x7fa5f406fe00 con 0x7fa5f4070050 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f3200640 1 -- 172.21.15.39:0/2390059741 >> v1:172.21.15.39:6789/0 conn(0x7fa5f406ea10 legacy=0x7fa5f406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.864+0000 7fa5f3200640 1 -- 172.21.15.39:0/2390059741 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f4068790 con 0x7fa5f4165f30 2024-04-26T23:27:19.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f3200640 1 --2- 172.21.15.39:0/2390059741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f4168320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0097c0 tx=0x7fa5ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb43e1ae5e53ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0aa620 con 0x7fa5f4165f30 2024-04-26T23:27:19.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0af070 con 0x7fa5f4165f30 2024-04-26T23:27:19.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f1e00640 1 -- 172.21.15.39:0/2390059741 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0aa9c0 con 0x7fa5f4165f30 2024-04-26T23:27:19.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- 172.21.15.39:0/2390059741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 msgr2=0x7fa5f4168320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2390059741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f4168320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0097c0 tx=0x7fa5ec01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- 172.21.15.39:0/2390059741 shutdown_connections 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2390059741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f4168320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- 172.21.15.39:0/2390059741 >> 172.21.15.39:0/2390059741 conn(0x7fa5f40ce0e0 msgr2=0x7fa5f40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- 172.21.15.39:0/2390059741 shutdown_connections 2024-04-26T23:27:19.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- 172.21.15.39:0/2390059741 wait complete. 2024-04-26T23:27:19.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 Processor -- start 2024-04-26T23:27:19.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.868+0000 7fa5f9400640 1 -- start start 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5f406ea10 0x7fa5f4145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5f4070050 0x7fa5f40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f40b47c0 con 0x7fa5f4165f30 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f40b4510 con 0x7fa5f406ea10 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f416b490 con 0x7fa5f4070050 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33338/0 (socket says 172.21.15.39:33338) 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 -- 172.21.15.39:0/2378616122 learned_addr learned my addr 172.21.15.39:0/2378616122 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f2800640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5f406ea10 0x7fa5f4145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5e9e00640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5f4070050 0x7fa5f40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 -- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5f4070050 msgr2=0x7fa5f40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5f4070050 0x7fa5f40c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 -- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5f406ea10 msgr2=0x7fa5f4145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:19.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5f406ea10 0x7fa5f4145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:19.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 -- 172.21.15.39:0/2378616122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f4166520 con 0x7fa5f4165f30 2024-04-26T23:27:19.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f3200640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec01a0d0 tx=0x7fa5ec01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0aac10 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0aadb0 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0be610 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f4166800 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f4159ad0 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.872+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f406a720 con 0x7fa5f4165f30 2024-04-26T23:27:19.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.876+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5ec0bc020 con 0x7fa5f4165f30 2024-04-26T23:27:19.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.876+0000 7fa5eb400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 0x7fa5d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:19.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.876+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa5ec1206b0 con 0x7fa5f4165f30 2024-04-26T23:27:19.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.876+0000 7fa5f2800640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 0x7fa5d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:19.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.876+0000 7fa5f2800640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 0x7fa5d006a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4005c10 tx=0x7fa5e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:19.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:19.880+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa5ec0c5030 con 0x7fa5f4165f30 2024-04-26T23:27:20.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:20.068+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "vol99840", "target": ["mon-mgr", ""]}) -- 0x7fa5f40b7590 con 0x7fa5d0068380 2024-04-26T23:27:23.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.008+0000 7fa5eb400640 1 -- 172.21.15.39:0/2378616122 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7fa5f40b7590 con 0x7fa5d0068380 2024-04-26T23:27:23.014 INFO:teuthology.orchestra.run.smithi039.stderr:Volume created successfully (no MDS daemons created) 2024-04-26T23:27:23.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 msgr2=0x7fa5d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 0x7fa5d006a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4005c10 tx=0x7fa5e4009040 comp rx=0 tx=0).stop 2024-04-26T23:27:23.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 msgr2=0x7fa5f40cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec01a0d0 tx=0x7fa5ec01ace0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 shutdown_connections 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa5d0068380 0x7fa5d006a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5f4165f30 0x7fa5f40cb0b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5f4070050 0x7fa5f40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 --2- 172.21.15.39:0/2378616122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5f406ea10 0x7fa5f4145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.012+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 >> 172.21.15.39:0/2378616122 conn(0x7fa5f40ce0e0 msgr2=0x7fa5f40cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.016+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 shutdown_connections 2024-04-26T23:27:23.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.016+0000 7fa5f9400640 1 -- 172.21.15.39:0/2378616122 wait complete. 2024-04-26T23:27:23.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:27:23.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.192+0000 7fbdc6400640 1 Processor -- start 2024-04-26T23:27:23.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.192+0000 7fbdc6400640 1 -- start start 2024-04-26T23:27:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdc6400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbdc0073400 0x7fbdc0072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdc6400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdc0072e50 0x7fbdc00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdc6400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc0072180 con 0x7fbdc01458d0 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdc6400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc00739a0 con 0x7fbdc0073400 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdc6400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc0073c80 con 0x7fbdc0072e50 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbf400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbdc01458d0 0x7fbdc00b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50392/0 (socket says 172.21.15.39:50392) 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbf400640 1 -- 172.21.15.39:0/1669210096 learned_addr learned my addr 172.21.15.39:0/1669210096 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbea00640 1 --2- 172.21.15.39:0/1669210096 >> v2:172.21.15.39:3300/0 conn(0x7fbdc0073400 0x7fbdc0072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbfe00640 1 --2- 172.21.15.39:0/1669210096 >> v2:172.21.15.71:3300/0 conn(0x7fbdc0072e50 0x7fbdc00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbe000640 1 -- 172.21.15.39:0/1669210096 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261845096 0 0) 0x7fbdc0072180 con 0x7fbdc01458d0 2024-04-26T23:27:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbe000640 1 -- 172.21.15.39:0/1669210096 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda4005740 con 0x7fbdc01458d0 2024-04-26T23:27:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbea00640 1 -- 172.21.15.39:0/1669210096 >> v2:172.21.15.71:3300/0 conn(0x7fbdc0072e50 msgr2=0x7fbdc00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbea00640 1 --2- 172.21.15.39:0/1669210096 >> v2:172.21.15.71:3300/0 conn(0x7fbdc0072e50 0x7fbdc00ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbea00640 1 -- 172.21.15.39:0/1669210096 >> v1:172.21.15.39:6789/0 conn(0x7fbdc01458d0 legacy=0x7fbdc00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.196+0000 7fbdbea00640 1 -- 172.21.15.39:0/1669210096 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc0145cb0 con 0x7fbdc0073400 2024-04-26T23:27:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdbea00640 1 --2- 172.21.15.39:0/1669210096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0073400 0x7fbdc0072910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0097c0 tx=0x7fbdac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7081f8db87ebfd99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdbe000640 1 -- 172.21.15.39:0/1669210096 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0b0070 con 0x7fbdc0073400 2024-04-26T23:27:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdbe000640 1 -- 172.21.15.39:0/1669210096 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac0ab600 con 0x7fbdc0073400 2024-04-26T23:27:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdbe000640 1 -- 172.21.15.39:0/1669210096 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0ab9d0 con 0x7fbdc0073400 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- 172.21.15.39:0/1669210096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0073400 msgr2=0x7fbdc0072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 --2- 172.21.15.39:0/1669210096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0073400 0x7fbdc0072910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0097c0 tx=0x7fbdac01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- 172.21.15.39:0/1669210096 shutdown_connections 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 --2- 172.21.15.39:0/1669210096 >> v2:172.21.15.71:3300/0 conn(0x7fbdc0072e50 0x7fbdc00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 --2- 172.21.15.39:0/1669210096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0073400 0x7fbdc0072910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- 172.21.15.39:0/1669210096 >> 172.21.15.39:0/1669210096 conn(0x7fbdc006c7d0 msgr2=0x7fbdc006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- 172.21.15.39:0/1669210096 shutdown_connections 2024-04-26T23:27:23.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- 172.21.15.39:0/1669210096 wait complete. 2024-04-26T23:27:23.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 Processor -- start 2024-04-26T23:27:23.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.200+0000 7fbdc6400640 1 -- start start 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 0x7fbdc00c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01458d0 0x7fbdc00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc006ee80 con 0x7fbdc0072e50 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0073260 con 0x7fbdc01458d0 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc006f000 con 0x7fbdc0073400 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54664/0 (socket says 172.21.15.39:54664) 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 -- 172.21.15.39:0/3385321482 learned_addr learned my addr 172.21.15.39:0/3385321482 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbfe00640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01458d0 0x7fbdc00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbea00640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 0x7fbdc00c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 -- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 msgr2=0x7fbdc00c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 0x7fbdc00c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 -- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01458d0 msgr2=0x7fbdc00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01458d0 0x7fbdc00c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 -- 172.21.15.39:0/3385321482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc01442a0 con 0x7fbdc0072e50 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbea00640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 0x7fbdc00c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdbf400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c3c0 tx=0x7fbdb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0017070 con 0x7fbdc0072e50 2024-04-26T23:27:23.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb0005cf0 con 0x7fbdc0072e50 2024-04-26T23:27:23.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc0144580 con 0x7fbdc0072e50 2024-04-26T23:27:23.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00072f0 con 0x7fbdc0072e50 2024-04-26T23:27:23.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc0144b40 con 0x7fbdc0072e50 2024-04-26T23:27:23.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.204+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc006a720 con 0x7fbdc0072e50 2024-04-26T23:27:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.208+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbdb001a070 con 0x7fbdc0072e50 2024-04-26T23:27:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.208+0000 7fbdb7400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 0x7fbda006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.208+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6547+0+0 (secure 0 0 0) 0x7fbdb0086080 con 0x7fbdc0072e50 2024-04-26T23:27:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.208+0000 7fbdbea00640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 0x7fbda006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.208+0000 7fbdbea00640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 0x7fbda006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0ad000 tx=0x7fbdac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.212+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbdb0055c90 con 0x7fbdc0072e50 2024-04-26T23:27:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.400+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fbdc00b50b0 con 0x7fbda0068380 2024-04-26T23:27:23.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.400+0000 7fbdb7400640 1 -- 172.21.15.39:0/3385321482 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+81 (secure 0 0 0) 0x7fbdc00b50b0 con 0x7fbda0068380 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs" 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "vol99840" 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:23.408 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 msgr2=0x7fbda006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 0x7fbda006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0ad000 tx=0x7fbdac008040 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 msgr2=0x7fbdc015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c3c0 tx=0x7fbdb000c880 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 shutdown_connections 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbda0068380 0x7fbda006a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01458d0 0x7fbdc00c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbdc0073400 0x7fbdc00c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 --2- 172.21.15.39:0/3385321482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc0072e50 0x7fbdc015b770 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 >> 172.21.15.39:0/3385321482 conn(0x7fbdc006c7d0 msgr2=0x7fbdc013d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 shutdown_connections 2024-04-26T23:27:23.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.404+0000 7fbdc6400640 1 -- 172.21.15.39:0/3385321482 wait complete. 2024-04-26T23:27:23.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-04-26T23:27:23.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.564+0000 7f8749600640 1 Processor -- start 2024-04-26T23:27:23.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.564+0000 7f8749600640 1 -- start start 2024-04-26T23:27:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8749600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8744161850 0x7f87440d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8749600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f87440cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8749600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874406e500 con 0x7f8744140170 2024-04-26T23:27:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8749600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f874406f110 con 0x7f8744161850 2024-04-26T23:27:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8749600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f874406e7e0 con 0x7f87440d1720 2024-04-26T23:27:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f873a000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8744161850 0x7f87440d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8742a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8744140170 0x7f874415de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50394/0 (socket says 172.21.15.39:50394) 2024-04-26T23:27:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8742a00640 1 -- 172.21.15.39:0/122284166 learned_addr learned my addr 172.21.15.39:0/122284166 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8743400640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f87440cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f873a000640 1 -- 172.21.15.39:0/122284166 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 msgr2=0x7f87440cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:23.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f873a000640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f87440cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f873a000640 1 -- 172.21.15.39:0/122284166 >> v1:172.21.15.39:6789/0 conn(0x7f8744140170 legacy=0x7f874415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f873a000640 1 -- 172.21.15.39:0/122284166 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874406eac0 con 0x7f8744161850 2024-04-26T23:27:23.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.568+0000 7f8742000640 1 -- 172.21.15.39:0/122284166 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603364880 0 0) 0x7f874406e500 con 0x7f8744140170 2024-04-26T23:27:23.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f873a000640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744161850 0x7f87440d11e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb8848d572d8b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8742000640 1 -- 172.21.15.39:0/122284166 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0b0070 con 0x7f8744161850 2024-04-26T23:27:23.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8742000640 1 -- 172.21.15.39:0/122284166 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c0ab600 con 0x7f8744161850 2024-04-26T23:27:23.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8742000640 1 -- 172.21.15.39:0/122284166 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ab9d0 con 0x7f8744161850 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- 172.21.15.39:0/122284166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744161850 msgr2=0x7f87440d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744161850 0x7f87440d11e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01ce30 comp rx=0 tx=0).stop 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- 172.21.15.39:0/122284166 shutdown_connections 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f87440cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- 172.21.15.39:0/122284166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744161850 0x7f87440d11e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- 172.21.15.39:0/122284166 >> 172.21.15.39:0/122284166 conn(0x7f874406c7d0 msgr2=0x7f874406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- 172.21.15.39:0/122284166 shutdown_connections 2024-04-26T23:27:23.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- 172.21.15.39:0/122284166 wait complete. 2024-04-26T23:27:23.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 Processor -- start 2024-04-26T23:27:23.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- start start 2024-04-26T23:27:23.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f8744139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8744161850 0x7f87441f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f87440d0810 con 0x7f8744140170 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87440d0690 con 0x7f8744161850 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.572+0000 7f8749600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f87440d0990 con 0x7f87440d1720 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54674/0 (socket says 172.21.15.39:54674) 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 -- 172.21.15.39:0/801219774 learned_addr learned my addr 172.21.15.39:0/801219774 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f8742a00640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f8744139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f8743400640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8744161850 0x7f87441f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 -- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 msgr2=0x7f8744139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f8744139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 -- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8744161850 msgr2=0x7f87441f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8744161850 0x7f87441f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 -- 172.21.15.39:0/801219774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874413a180 con 0x7f8744140170 2024-04-26T23:27:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873a000640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ae040 tx=0x7f872c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0b0040 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c004020 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c006e20 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874413b5c0 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874413bb80 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874406a720 con 0x7f8744140170 2024-04-26T23:27:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f872c0b3070 con 0x7f8744140170 2024-04-26T23:27:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.576+0000 7f873b400640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 0x7f872006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.580+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6547+0+0 (secure 0 0 0) 0x7f872c120de0 con 0x7f8744140170 2024-04-26T23:27:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.580+0000 7f8742a00640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 0x7f872006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.580+0000 7f8742a00640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 0x7f872006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8734007fd0 tx=0x7f8734007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.584+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f872c0c3030 con 0x7f8744140170 2024-04-26T23:27:23.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.747+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) -- 0x7f874406fd60 con 0x7f8744140170 2024-04-26T23:27:23.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.747+0000 7f873b400640 1 -- 172.21.15.39:0/801219774 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) ==== 97+0+9302 (secure 0 0 0) 0x7f872c0ba030 con 0x7f8744140170 2024-04-26T23:27:23.755 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 msgr2=0x7f872006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 0x7f872006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8734007fd0 tx=0x7f8734007d60 comp rx=0 tx=0).stop 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 msgr2=0x7f8744138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ae040 tx=0x7f872c019170 comp rx=0 tx=0).stop 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 shutdown_connections 2024-04-26T23:27:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8720068380 0x7f872006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8744161850 0x7f87441f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8744140170 0x7f8744138040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 --2- 172.21.15.39:0/801219774 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f87440d1720 0x7f8744139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 >> 172.21.15.39:0/801219774 conn(0x7f874406c7d0 msgr2=0x7f874415f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 shutdown_connections 2024-04-26T23:27:23.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.751+0000 7f8749600640 1 -- 172.21.15.39:0/801219774 wait complete. 2024-04-26T23:27:23.776 INFO:teuthology.orchestra.run.smithi039.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":6,"pool_name":"cephfs.vol99840.meta","create_time":"2024-04-26T23:27:20.084028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"vol99840"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":7,"pool_name":"cephfs.vol99840.data","create_time":"2024-04-26T23:27:21.013017+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"vol99840"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}] 2024-04-26T23:27:23.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get vol99840 --format=json 2024-04-26T23:27:23.881 INFO:tasks.ceph.mds.c.smithi039.stderr:2024-04-26T23:27:23.871+0000 7f1f2d600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:27:23.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 Processor -- start 2024-04-26T23:27:23.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 -- start start 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3b30161850 0x7f3b300d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3006e500 con 0x7f3b30140170 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3006e7e0 con 0x7f3b300d1720 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b36600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3006f110 con 0x7f3b30161850 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b2f400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3b30140170 0x7f3b3015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50402/0 (socket says 172.21.15.39:50402) 2024-04-26T23:27:23.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.911+0000 7f3b2f400640 1 -- 172.21.15.39:0/368120607 learned_addr learned my addr 172.21.15.39:0/368120607 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:23.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b27e00640 1 --2- 172.21.15.39:0/368120607 >> v2:172.21.15.71:3300/0 conn(0x7f3b30161850 0x7f3b300d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583362839 0 0) 0x7f3b3006e500 con 0x7f3b30140170 2024-04-26T23:27:23.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b14003530 con 0x7f3b30140170 2024-04-26T23:27:23.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280127125 0 0) 0x7f3b3006e7e0 con 0x7f3b300d1720 2024-04-26T23:27:23.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3006e500 con 0x7f3b300d1720 2024-04-26T23:27:23.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b27e00640 1 -- 172.21.15.39:0/368120607 >> v1:172.21.15.71:6789/0 conn(0x7f3b300d1720 legacy=0x7f3b300cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b27e00640 1 -- 172.21.15.39:0/368120607 >> v1:172.21.15.39:6789/0 conn(0x7f3b30140170 legacy=0x7f3b3015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b27e00640 1 -- 172.21.15.39:0/368120607 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3006eac0 con 0x7f3b30161850 2024-04-26T23:27:23.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.915+0000 7f3b27e00640 1 --2- 172.21.15.39:0/368120607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30161850 0x7f3b300d11e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b180097c0 tx=0x7f3b1801ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceb49bec2c023abc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b180b0070 con 0x7f3b30161850 2024-04-26T23:27:23.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b180ab600 con 0x7f3b30161850 2024-04-26T23:27:23.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2ea00640 1 -- 172.21.15.39:0/368120607 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b180ab9b0 con 0x7f3b30161850 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- 172.21.15.39:0/368120607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30161850 msgr2=0x7f3b300d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 --2- 172.21.15.39:0/368120607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30161850 0x7f3b300d11e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b180097c0 tx=0x7f3b1801ce70 comp rx=0 tx=0).stop 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- 172.21.15.39:0/368120607 shutdown_connections 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 --2- 172.21.15.39:0/368120607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30161850 0x7f3b300d11e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- 172.21.15.39:0/368120607 >> 172.21.15.39:0/368120607 conn(0x7f3b3006c7d0 msgr2=0x7f3b3006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- 172.21.15.39:0/368120607 shutdown_connections 2024-04-26T23:27:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- 172.21.15.39:0/368120607 wait complete. 2024-04-26T23:27:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 Processor -- start 2024-04-26T23:27:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- start start 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 0x7f3b30142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30140170 0x7f3b30139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3b300d09a0 con 0x7f3b30161850 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b300d0820 con 0x7f3b30140170 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b36600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3016afc0 con 0x7f3b300d1720 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 0x7f3b30142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54686/0 (socket says 172.21.15.39:54686) 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b2fe00640 1 -- 172.21.15.39:0/221751057 learned_addr learned my addr 172.21.15.39:0/221751057 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.919+0000 7f3b27e00640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30140170 0x7f3b30139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 -- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 msgr2=0x7f3b30142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 0x7f3b30142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 -- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30140170 msgr2=0x7f3b30139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30140170 0x7f3b30139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 -- 172.21.15.39:0/221751057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b30072d40 con 0x7f3b30161850 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2f400640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 0x7f3b30142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2fe00640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c790 tx=0x7f3b2800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28003b80 con 0x7f3b30161850 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b28003d20 con 0x7f3b30161850 2024-04-26T23:27:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800aa50 con 0x7f3b30161850 2024-04-26T23:27:23.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b30073020 con 0x7f3b30161850 2024-04-26T23:27:23.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b300735e0 con 0x7f3b30161850 2024-04-26T23:27:23.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3006a720 con 0x7f3b30161850 2024-04-26T23:27:23.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b2800abf0 con 0x7f3b30161850 2024-04-26T23:27:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 0x7f3b0c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6547+0+0 (secure 0 0 0) 0x7f3b28086ad0 con 0x7f3b30161850 2024-04-26T23:27:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.923+0000 7f3b2f400640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 0x7f3b0c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.927+0000 7f3b2f400640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 0x7f3b0c06a890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b20007fd0 tx=0x7f3b20007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:23.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:23.927+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3b28056760 con 0x7f3b30161850 2024-04-26T23:27:24.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.143+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "vol99840", "format": "json"} v 0) -- 0x7f3b3006fdc0 con 0x7f3b30161850 2024-04-26T23:27:24.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.143+0000 7f3b27400640 1 -- 172.21.15.39:0/221751057 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "vol99840", "format": "json"}]=0 v20) ==== 95+0+2138 (secure 0 0 0) 0x7f3b2805aa60 con 0x7f3b30161850 2024-04-26T23:27:24.152 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:24.152 INFO:teuthology.orchestra.run.smithi039.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:22.008357+0000","modified":"2024-04-26T23:27:23.424024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.39:6834/427434532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":427434532},{"type":"v1","addr":"172.21.15.39:6834","nonce":427434532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"vol99840","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5028,"qdb_cluster":[5028]},"id":3} 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 msgr2=0x7f3b0c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 0x7f3b0c06a890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b20007fd0 tx=0x7f3b20007d80 comp rx=0 tx=0).stop 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 msgr2=0x7f3b3013a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c790 tx=0x7f3b2800cc50 comp rx=0 tx=0).stop 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 shutdown_connections 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3b0c0683d0 0x7f3b0c06a890 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b30161850 0x7f3b3013a2d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b30140170 0x7f3b30139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 --2- 172.21.15.39:0/221751057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b300d1720 0x7f3b30142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 >> 172.21.15.39:0/221751057 conn(0x7f3b3006c7d0 msgr2=0x7f3b300b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 shutdown_connections 2024-04-26T23:27:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.147+0000 7f3b36600640 1 -- 172.21.15.39:0/221751057 wait complete. 2024-04-26T23:27:24.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm vol99840 --yes-i-really-mean-it 2024-04-26T23:27:24.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 Processor -- start 2024-04-26T23:27:24.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 -- start start 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4de0140170 0x7f4de015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4de015e340 0x7f4de00d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de006e500 con 0x7f4de0161850 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4de006f110 con 0x7f4de015e340 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.311+0000 7f4de7c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4de006e7e0 con 0x7f4de0140170 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4de5c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4de0161850 0x7f4de0142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50408/0 (socket says 172.21.15.39:50408) 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4de5c00640 1 -- 172.21.15.39:0/1066881492 learned_addr learned my addr 172.21.15.39:0/1066881492 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/1066881492 >> v2:172.21.15.39:3300/0 conn(0x7f4de015e340 0x7f4de00d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4de5200640 1 --2- 172.21.15.39:0/1066881492 >> v2:172.21.15.71:3300/0 conn(0x7f4de0140170 0x7f4de015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 -- 172.21.15.39:0/1066881492 >> v2:172.21.15.71:3300/0 conn(0x7f4de0140170 msgr2=0x7f4de015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/1066881492 >> v2:172.21.15.71:3300/0 conn(0x7f4de0140170 0x7f4de015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 -- 172.21.15.39:0/1066881492 >> v1:172.21.15.39:6789/0 conn(0x7f4de0161850 legacy=0x7f4de0142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 -- 172.21.15.39:0/1066881492 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de006eac0 con 0x7f4de015e340 2024-04-26T23:27:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddf400640 1 -- 172.21.15.39:0/1066881492 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343652561 0 0) 0x7f4de006e500 con 0x7f4de0161850 2024-04-26T23:27:24.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/1066881492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de00d11e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b64c0 tx=0x7f4dcc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c266d9f15344aa8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:24.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddf400640 1 -- 172.21.15.39:0/1066881492 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0b0070 con 0x7f4de015e340 2024-04-26T23:27:24.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddf400640 1 -- 172.21.15.39:0/1066881492 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0ab600 con 0x7f4de015e340 2024-04-26T23:27:24.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.315+0000 7f4ddf400640 1 -- 172.21.15.39:0/1066881492 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ab9d0 con 0x7f4de015e340 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- 172.21.15.39:0/1066881492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 msgr2=0x7f4de00d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- 172.21.15.39:0/1066881492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de00d11e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b64c0 tx=0x7f4dcc01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- 172.21.15.39:0/1066881492 shutdown_connections 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- 172.21.15.39:0/1066881492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de00d11e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- 172.21.15.39:0/1066881492 >> v2:172.21.15.71:3300/0 conn(0x7f4de0140170 0x7f4de015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- 172.21.15.39:0/1066881492 >> 172.21.15.39:0/1066881492 conn(0x7f4de006c7d0 msgr2=0x7f4de006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- 172.21.15.39:0/1066881492 shutdown_connections 2024-04-26T23:27:24.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- 172.21.15.39:0/1066881492 wait complete. 2024-04-26T23:27:24.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 Processor -- start 2024-04-26T23:27:24.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- start start 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4de0140170 0x7f4de013cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 0x7f4de013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4de016a340 con 0x7f4de015e340 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4de016a1c0 con 0x7f4de0161850 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de7c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4de016a4c0 con 0x7f4de0140170 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54712/0 (socket says 172.21.15.39:54712) 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 -- 172.21.15.39:0/2566069488 learned_addr learned my addr 172.21.15.39:0/2566069488 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de5200640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4de0140170 0x7f4de013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de5c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 0x7f4de013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 -- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4de0140170 msgr2=0x7f4de013cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4de0140170 0x7f4de013cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 -- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 msgr2=0x7f4de013a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 0x7f4de013a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 -- 172.21.15.39:0/2566069488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de013e3a0 con 0x7f4de015e340 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4de5c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 0x7f4de013a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:24.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.319+0000 7f4ddfe00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ae040 tx=0x7f4dcc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0b8020 con 0x7f4de015e340 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0b4630 con 0x7f4de015e340 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0b0040 con 0x7f4de015e340 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de013d300 con 0x7f4de015e340 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de013d8c0 con 0x7f4de015e340 2024-04-26T23:27:24.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de006a720 con 0x7f4de015e340 2024-04-26T23:27:24.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4dcc0bb020 con 0x7f4de015e340 2024-04-26T23:27:24.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 0x7f4dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:24.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6547+0+0 (secure 0 0 0) 0x7f4dcc120b60 con 0x7f4de015e340 2024-04-26T23:27:24.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.323+0000 7f4de5200640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 0x7f4dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:24.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.327+0000 7f4de5200640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 0x7f4dc006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4de0162070 tx=0x7f4dd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:24.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.327+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4dcc0c2030 con 0x7f4de015e340 2024-04-26T23:27:24.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:24.515+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "vol99840", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7f4de00ce430 con 0x7f4dc0068380 2024-04-26T23:27:24.529 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-04-26T23:27:24.523+0000 7f6c56400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:27:24.540 INFO:tasks.ceph.mds.c.smithi039.stderr: -46> 2024-04-26T23:27:23.871+0000 7f1f2d600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:27:24.581 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:27:27.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.551+0000 7f4ddcc00640 1 -- 172.21.15.39:0/2566069488 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+80 (secure 0 0 0) 0x7f4de00ce430 con 0x7f4dc0068380 2024-04-26T23:27:27.560 INFO:teuthology.orchestra.run.smithi039.stdout:metadata pool: cephfs.vol99840.meta data pool: ['cephfs.vol99840.data'] removed 2024-04-26T23:27:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 msgr2=0x7f4dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 0x7f4dc006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4de0162070 tx=0x7f4dd4008040 comp rx=0 tx=0).stop 2024-04-26T23:27:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 msgr2=0x7f4de015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ae040 tx=0x7f4dcc019160 comp rx=0 tx=0).stop 2024-04-26T23:27:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 shutdown_connections 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4dc0068380 0x7f4dc006a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de0161850 0x7f4de013a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4de015e340 0x7f4de015ff20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 --2- 172.21.15.39:0/2566069488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4de0140170 0x7f4de013cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 >> 172.21.15.39:0/2566069488 conn(0x7f4de006c7d0 msgr2=0x7f4de013f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 shutdown_connections 2024-04-26T23:27:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:27.555+0000 7f4de7c00640 1 -- 172.21.15.39:0/2566069488 wait complete. 2024-04-26T23:27:27.586 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:27:27.586 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:27:27.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:27:27.774 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:27:27.775 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:27:27.775 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:27.775 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:27.785 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:27.785 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:27.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:28.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 Processor -- start 2024-04-26T23:27:28.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 -- start start 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fba400b4b10 0x7fba400b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba40163ce0 con 0x7fba4006d4e0 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fba400b54b0 con 0x7fba400b4b10 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.027+0000 7fba45c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba400d1390 con 0x7fba4015f500 2024-04-26T23:27:28.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:54014/0 (socket says 172.21.15.39:54014) 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3f400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fba4006d4e0 0x7fba4006d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:44148/0 (socket says 172.21.15.39:44148) 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 -- 172.21.15.39:0/540903307 learned_addr learned my addr 172.21.15.39:0/540903307 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba37e00640 1 --2- 172.21.15.39:0/540903307 >> v2:172.21.15.71:3300/0 conn(0x7fba400b4b10 0x7fba400b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3e000640 1 -- 172.21.15.39:0/540903307 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517808681 0 0) 0x7fba40163ce0 con 0x7fba4006d4e0 2024-04-26T23:27:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3e000640 1 -- 172.21.15.39:0/540903307 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba24003530 con 0x7fba4006d4e0 2024-04-26T23:27:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 -- 172.21.15.39:0/540903307 >> v2:172.21.15.71:3300/0 conn(0x7fba400b4b10 msgr2=0x7fba400b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 --2- 172.21.15.39:0/540903307 >> v2:172.21.15.71:3300/0 conn(0x7fba400b4b10 0x7fba400b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 -- 172.21.15.39:0/540903307 >> v1:172.21.15.71:6789/0 conn(0x7fba4006d4e0 legacy=0x7fba4006d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 -- 172.21.15.39:0/540903307 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba400d0dd0 con 0x7fba4015f500 2024-04-26T23:27:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.031+0000 7fba3ea00640 1 --2- 172.21.15.39:0/540903307 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba30009870 tx=0x7fba3001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fa1b2c383386b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba3e000640 1 -- 172.21.15.39:0/540903307 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300b0070 con 0x7fba4015f500 2024-04-26T23:27:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba3e000640 1 -- 172.21.15.39:0/540903307 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba30004230 con 0x7fba4015f500 2024-04-26T23:27:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba3e000640 1 -- 172.21.15.39:0/540903307 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30003620 con 0x7fba4015f500 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- 172.21.15.39:0/540903307 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 msgr2=0x7fba400d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- 172.21.15.39:0/540903307 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba30009870 tx=0x7fba3001c440 comp rx=0 tx=0).stop 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- 172.21.15.39:0/540903307 shutdown_connections 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- 172.21.15.39:0/540903307 >> v2:172.21.15.71:3300/0 conn(0x7fba400b4b10 0x7fba400b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- 172.21.15.39:0/540903307 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400d27b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- 172.21.15.39:0/540903307 >> 172.21.15.39:0/540903307 conn(0x7fba40068140 msgr2=0x7fba40068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- 172.21.15.39:0/540903307 shutdown_connections 2024-04-26T23:27:28.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- 172.21.15.39:0/540903307 wait complete. 2024-04-26T23:27:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 Processor -- start 2024-04-26T23:27:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- start start 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4006d4e0 0x7fba40156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba40163ac0 con 0x7fba400b4b10 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba40163940 con 0x7fba4006d4e0 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba45c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba4016cae0 con 0x7fba4015f500 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba37e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba37e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54748/0 (socket says 172.21.15.39:54748) 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba37e00640 1 -- 172.21.15.39:0/3828085705 learned_addr learned my addr 172.21.15.39:0/3828085705 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.035+0000 7fba3ea00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4006d4e0 0x7fba40156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba3f400640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 -- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 msgr2=0x7fba400ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 -- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4006d4e0 msgr2=0x7fba40156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4006d4e0 0x7fba40156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 -- 172.21.15.39:0/3828085705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4015f980 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba37e00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba2800e870 tx=0x7fba2800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28017070 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2800c940 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4015fc60 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2800ccf0 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba40160220 con 0x7fba400b4b10 2024-04-26T23:27:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba400715e0 con 0x7fba400b4b10 2024-04-26T23:27:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.039+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba2801a070 con 0x7fba400b4b10 2024-04-26T23:27:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.043+0000 7fba36a00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 0x7fba1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.043+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fba28086c90 con 0x7fba400b4b10 2024-04-26T23:27:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.043+0000 7fba3ea00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 0x7fba1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.043+0000 7fba3ea00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 0x7fba1c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba300ad000 tx=0x7fba300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.047+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba28056b00 con 0x7fba400b4b10 2024-04-26T23:27:28.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.211+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba40050740 con 0x7fba400b4b10 2024-04-26T23:27:28.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.211+0000 7fba36a00640 1 -- 172.21.15.39:0/3828085705 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16736 (secure 0 0 0) 0x7fba2805ae00 con 0x7fba400b4b10 2024-04-26T23:27:28.220 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:28.220 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:27.546596+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:28.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 msgr2=0x7fba1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 0x7fba1c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba300ad000 tx=0x7fba300a6000 comp rx=0 tx=0).stop 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 msgr2=0x7fba40160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba2800e870 tx=0x7fba2800ec70 comp rx=0 tx=0).stop 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 shutdown_connections 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba1c068380 0x7fba1c06a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba4015f500 0x7fba400ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba400b4b10 0x7fba40160a20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 --2- 172.21.15.39:0/3828085705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4006d4e0 0x7fba40156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 >> 172.21.15.39:0/3828085705 conn(0x7fba40068140 msgr2=0x7fba400d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 shutdown_connections 2024-04-26T23:27:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.215+0000 7fba45c00640 1 -- 172.21.15.39:0/3828085705 wait complete. 2024-04-26T23:27:28.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:07.117634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:08.271295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:28.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:28.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 Processor -- start 2024-04-26T23:27:28.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 -- start start 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe9941458d0 0x7fe9940b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe994073400 0x7fe994072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe994072180 con 0x7fe994072e50 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe9940739a0 con 0x7fe9941458d0 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe99ac00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe994073c80 con 0x7fe994073400 2024-04-26T23:27:28.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe9941458d0 0x7fe9940b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe9941458d0 0x7fe9940b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54758/0 (socket says 172.21.15.39:54758) 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 -- 172.21.15.39:0/2424562772 learned_addr learned my addr 172.21.15.39:0/2424562772 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe98be00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe994073400 0x7fe994072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 -- 172.21.15.39:0/2424562772 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe994073400 msgr2=0x7fe994072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe994073400 0x7fe994072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 -- 172.21.15.39:0/2424562772 >> v1:172.21.15.71:6789/0 conn(0x7fe994072e50 legacy=0x7fe9940ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.379+0000 7fe993e00640 1 -- 172.21.15.39:0/2424562772 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe994145cb0 con 0x7fe9941458d0 2024-04-26T23:27:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe993e00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9941458d0 0x7fe9940b4890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098a0 tx=0x7fe98401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5ac2b377e0f2d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe993400640 1 -- 172.21.15.39:0/2424562772 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840b1070 con 0x7fe9941458d0 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe993400640 1 -- 172.21.15.39:0/2424562772 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840ac620 con 0x7fe9941458d0 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe993400640 1 -- 172.21.15.39:0/2424562772 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840ac9f0 con 0x7fe9941458d0 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 -- 172.21.15.39:0/2424562772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9941458d0 msgr2=0x7fe9940b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9941458d0 0x7fe9940b4890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098a0 tx=0x7fe98401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 -- 172.21.15.39:0/2424562772 shutdown_connections 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe994073400 0x7fe994072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 --2- 172.21.15.39:0/2424562772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9941458d0 0x7fe9940b4890 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 -- 172.21.15.39:0/2424562772 >> 172.21.15.39:0/2424562772 conn(0x7fe99406c7d0 msgr2=0x7fe99406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 -- 172.21.15.39:0/2424562772 shutdown_connections 2024-04-26T23:27:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.383+0000 7fe99ac00640 1 -- 172.21.15.39:0/2424562772 wait complete. 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 Processor -- start 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- start start 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994073400 0x7fe9941fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9941458d0 0x7fe994142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940cef00 con 0x7fe994072e50 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe994073260 con 0x7fe994073400 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe994168f40 con 0x7fe9941458d0 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54768/0 (socket says 172.21.15.39:54768) 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 -- 172.21.15.39:0/4250562817 learned_addr learned my addr 172.21.15.39:0/4250562817 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe98be00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994073400 0x7fe9941fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe998c00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9941458d0 0x7fe994142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 -- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9941458d0 msgr2=0x7fe994142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9941458d0 0x7fe994142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 -- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994073400 msgr2=0x7fe9941fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994073400 0x7fe9941fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 -- 172.21.15.39:0/4250562817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99413df70 con 0x7fe994072e50 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe993e00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9840af040 tx=0x7fe98401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840bb020 con 0x7fe994072e50 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840b7420 con 0x7fe994072e50 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840b1040 con 0x7fe994072e50 2024-04-26T23:27:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9940c5f00 con 0x7fe994072e50 2024-04-26T23:27:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.387+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99413e210 con 0x7fe994072e50 2024-04-26T23:27:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99406a720 con 0x7fe994072e50 2024-04-26T23:27:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9840be020 con 0x7fe994072e50 2024-04-26T23:27:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe990c00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 0x7fe97006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fe984120a00 con 0x7fe994072e50 2024-04-26T23:27:28.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe98be00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 0x7fe97006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.391+0000 7fe98be00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 0x7fe97006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe99415c0a0 tx=0x7fe97c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.395+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe9840c5030 con 0x7fe994072e50 2024-04-26T23:27:28.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.559+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9940b50b0 con 0x7fe994072e50 2024-04-26T23:27:28.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe990c00640 1 -- 172.21.15.39:0/4250562817 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7fe984016130 con 0x7fe994072e50 2024-04-26T23:27:28.568 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 msgr2=0x7fe97006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 0x7fe97006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe99415c0a0 tx=0x7fe97c009190 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 msgr2=0x7fe99413c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9840af040 tx=0x7fe98401acf0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 shutdown_connections 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe970068380 0x7fe97006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9941458d0 0x7fe994142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994073400 0x7fe9941fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 --2- 172.21.15.39:0/4250562817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe994072e50 0x7fe99413c130 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 >> 172.21.15.39:0/4250562817 conn(0x7fe99406c7d0 msgr2=0x7fe9940b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 shutdown_connections 2024-04-26T23:27:28.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.563+0000 7fe99ac00640 1 -- 172.21.15.39:0/4250562817 wait complete. 2024-04-26T23:27:28.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:27:28.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 Processor -- start 2024-04-26T23:27:28.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 -- start start 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 0x7fab3c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab3c15e340 0x7fab3c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3c06e500 con 0x7fab3c161850 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fab3c06f110 con 0x7fab3c15e340 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab41200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fab3c06e7e0 con 0x7fab3c140170 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab3a800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fab3c161850 0x7fab3c142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50412/0 (socket says 172.21.15.39:50412) 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab3a800640 1 -- 172.21.15.39:0/3358539310 learned_addr learned my addr 172.21.15.39:0/3358539310 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab33e00640 1 --2- 172.21.15.39:0/3358539310 >> v2:172.21.15.71:3300/0 conn(0x7fab3c15e340 0x7fab3c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab39e00640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 0x7fab3c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab39400640 1 -- 172.21.15.39:0/3358539310 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990334029 0 0) 0x7fab3c06e500 con 0x7fab3c161850 2024-04-26T23:27:28.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab39400640 1 -- 172.21.15.39:0/3358539310 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab20003530 con 0x7fab3c161850 2024-04-26T23:27:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab33e00640 1 -- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 msgr2=0x7fab3c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab33e00640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 0x7fab3c15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab33e00640 1 -- 172.21.15.39:0/3358539310 >> v1:172.21.15.39:6789/0 conn(0x7fab3c161850 legacy=0x7fab3c142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab33e00640 1 -- 172.21.15.39:0/3358539310 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c06eac0 con 0x7fab3c15e340 2024-04-26T23:27:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.727+0000 7fab39e00640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 0x7fab3c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:28.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab33e00640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c15e340 0x7fab3c0d11e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab240097c0 tx=0x7fab2401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42dfb6184eda3621 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab39400640 1 -- 172.21.15.39:0/3358539310 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240b0070 con 0x7fab3c15e340 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab39400640 1 -- 172.21.15.39:0/3358539310 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab240ab600 con 0x7fab3c15e340 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab39400640 1 -- 172.21.15.39:0/3358539310 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240ab9b0 con 0x7fab3c15e340 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 -- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c15e340 msgr2=0x7fab3c0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c15e340 0x7fab3c0d11e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab240097c0 tx=0x7fab2401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 -- 172.21.15.39:0/3358539310 shutdown_connections 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c15e340 0x7fab3c0d11e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 --2- 172.21.15.39:0/3358539310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c140170 0x7fab3c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 -- 172.21.15.39:0/3358539310 >> 172.21.15.39:0/3358539310 conn(0x7fab3c06c7d0 msgr2=0x7fab3c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 -- 172.21.15.39:0/3358539310 shutdown_connections 2024-04-26T23:27:28.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.731+0000 7fab41200640 1 -- 172.21.15.39:0/3358539310 wait complete. 2024-04-26T23:27:28.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 Processor -- start 2024-04-26T23:27:28.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- start start 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c140170 0x7fab3c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c161850 0x7fab3c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c16a340 con 0x7fab3c15e340 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c16a1c0 con 0x7fab3c140170 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fab3c16a4c0 con 0x7fab3c161850 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54780/0 (socket says 172.21.15.39:54780) 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 -- 172.21.15.39:0/2941989712 learned_addr learned my addr 172.21.15.39:0/2941989712 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab39e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c140170 0x7fab3c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab3a800640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c161850 0x7fab3c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 -- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c161850 msgr2=0x7fab3c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c161850 0x7fab3c0b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 -- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c140170 msgr2=0x7fab3c15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c140170 0x7fab3c15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 -- 172.21.15.39:0/2941989712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c15e8c0 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab33e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab2401a010 tx=0x7fab24019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240b8020 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab240b4410 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c158810 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240b0040 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.735+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c13fa10 con 0x7fab3c15e340 2024-04-26T23:27:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3c06a720 con 0x7fab3c15e340 2024-04-26T23:27:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab240bb020 con 0x7fab3c15e340 2024-04-26T23:27:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab32000640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 0x7fab1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fab24120780 con 0x7fab3c15e340 2024-04-26T23:27:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab39e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 0x7fab1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.739+0000 7fab39e00640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 0x7fab1806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009580 tx=0x7fab2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.743+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fab240c2030 con 0x7fab3c15e340 2024-04-26T23:27:28.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fab3c0697b0 con 0x7fab3c15e340 2024-04-26T23:27:28.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab32000640 1 -- 172.21.15.39:0/2941989712 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7fab3c0d1b30 con 0x7fab3c15e340 2024-04-26T23:27:28.914 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:27:28.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 msgr2=0x7fab1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 0x7fab1806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009580 tx=0x7fab2c008040 comp rx=0 tx=0).stop 2024-04-26T23:27:28.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 msgr2=0x7fab3c13ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:28.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab2401a010 tx=0x7fab24019180 comp rx=0 tx=0).stop 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 shutdown_connections 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab18068380 0x7fab1806a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab3c161850 0x7fab3c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3c15e340 0x7fab3c13ea80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 --2- 172.21.15.39:0/2941989712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c140170 0x7fab3c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.907+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 >> 172.21.15.39:0/2941989712 conn(0x7fab3c06c7d0 msgr2=0x7fab3c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.911+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 shutdown_connections 2024-04-26T23:27:28.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:28.911+0000 7fab41200640 1 -- 172.21.15.39:0/2941989712 wait complete. 2024-04-26T23:27:28.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:27:29.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 Processor -- start 2024-04-26T23:27:29.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 -- start start 2024-04-26T23:27:29.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0600cfd60 0x7fd06015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0600d38c0 0x7fd0600d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0600cdbc0 con 0x7fd06015ac30 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd06015b010 con 0x7fd0600d38c0 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd065800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0600cdea0 con 0x7fd0600cfd60 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd064e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0600d38c0 0x7fd0600d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd05fe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd06015ac30 0x7fd0600cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50414/0 (socket says 172.21.15.39:50414) 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd05fe00640 1 -- 172.21.15.39:0/2897127471 learned_addr learned my addr 172.21.15.39:0/2897127471 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:29.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd05f400640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0600cfd60 0x7fd06015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd064e00640 1 -- 172.21.15.39:0/2897127471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0600cfd60 msgr2=0x7fd06015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:29.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd064e00640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0600cfd60 0x7fd06015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd064e00640 1 -- 172.21.15.39:0/2897127471 >> v1:172.21.15.39:6789/0 conn(0x7fd06015ac30 legacy=0x7fd0600cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd064e00640 1 -- 172.21.15.39:0/2897127471 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0600ce180 con 0x7fd0600d38c0 2024-04-26T23:27:29.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.075+0000 7fd05ea00640 1 -- 172.21.15.39:0/2897127471 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669199903 0 0) 0x7fd0600cdbc0 con 0x7fd06015ac30 2024-04-26T23:27:29.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd064e00640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600d38c0 0x7fd0600d0970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89400e9ef401ef4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd05ea00640 1 -- 172.21.15.39:0/2897127471 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580b2070 con 0x7fd0600d38c0 2024-04-26T23:27:29.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd05ea00640 1 -- 172.21.15.39:0/2897127471 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0580a58b0 con 0x7fd0600d38c0 2024-04-26T23:27:29.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd05ea00640 1 -- 172.21.15.39:0/2897127471 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a5c80 con 0x7fd0600d38c0 2024-04-26T23:27:29.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 -- 172.21.15.39:0/2897127471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600d38c0 msgr2=0x7fd0600d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600d38c0 0x7fd0600d0970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 -- 172.21.15.39:0/2897127471 shutdown_connections 2024-04-26T23:27:29.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600d38c0 0x7fd0600d0970 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 --2- 172.21.15.39:0/2897127471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0600cfd60 0x7fd06015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 -- 172.21.15.39:0/2897127471 >> 172.21.15.39:0/2897127471 conn(0x7fd0600d2da0 msgr2=0x7fd0600d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:29.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 -- 172.21.15.39:0/2897127471 shutdown_connections 2024-04-26T23:27:29.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.079+0000 7fd065800640 1 -- 172.21.15.39:0/2897127471 wait complete. 2024-04-26T23:27:29.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 Processor -- start 2024-04-26T23:27:29.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- start start 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0600d38c0 0x7fd060160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd06015ac30 0x7fd0601f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600d1840 con 0x7fd0600cfd60 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600d16c0 con 0x7fd0600d38c0 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd060169d80 con 0x7fd06015ac30 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54788/0 (socket says 172.21.15.39:54788) 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 -- 172.21.15.39:0/2453748099 learned_addr learned my addr 172.21.15.39:0/2453748099 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05f400640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0600d38c0 0x7fd060160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd064e00640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd06015ac30 0x7fd0601f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 -- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd06015ac30 msgr2=0x7fd0601f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd06015ac30 0x7fd0601f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 -- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0600d38c0 msgr2=0x7fd060160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0600d38c0 0x7fd060160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 -- 172.21.15.39:0/2453748099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015e7e0 con 0x7fd0600cfd60 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd05fe00640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd0500011f0 tx=0x7fd05000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050018070 con 0x7fd0600cfd60 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0500074e0 con 0x7fd0600cfd60 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050004a10 con 0x7fd0600cfd60 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06015f820 con 0x7fd0600cfd60 2024-04-26T23:27:29.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06015ed40 con 0x7fd0600cfd60 2024-04-26T23:27:29.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.083+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0600506d0 con 0x7fd0600cfd60 2024-04-26T23:27:29.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.087+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd05001b070 con 0x7fd0600cfd60 2024-04-26T23:27:29.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.087+0000 7fd057e00640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 0x7fd04006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.087+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fd050085dc0 con 0x7fd0600cfd60 2024-04-26T23:27:29.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.087+0000 7fd05f400640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 0x7fd04006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.087+0000 7fd05f400640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 0x7fd04006a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd06006ecb0 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.091+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd06015e7e0 con 0x7fd0600cfd60 2024-04-26T23:27:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.255+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd060075ef0 con 0x7fd0600cfd60 2024-04-26T23:27:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.255+0000 7fd057e00640 1 -- 172.21.15.39:0/2453748099 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7fd050056280 con 0x7fd0600cfd60 2024-04-26T23:27:29.263 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:27:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 msgr2=0x7fd04006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 0x7fd04006a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd06006ecb0 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2024-04-26T23:27:29.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 msgr2=0x7fd0600c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd0500011f0 tx=0x7fd05000c9b0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 shutdown_connections 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd040068380 0x7fd04006a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd06015ac30 0x7fd0601f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0600d38c0 0x7fd060160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 --2- 172.21.15.39:0/2453748099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0600cfd60 0x7fd0600c83c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 >> 172.21.15.39:0/2453748099 conn(0x7fd0600d2da0 msgr2=0x7fd0600aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 shutdown_connections 2024-04-26T23:27:29.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.259+0000 7fd065800640 1 -- 172.21.15.39:0/2453748099 wait complete. 2024-04-26T23:27:29.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:27:29.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 Processor -- start 2024-04-26T23:27:29.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 -- start start 2024-04-26T23:27:29.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb5c145710 0x7fbb5c074030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c145af0 con 0x7fbb5c0d0740 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c0cf440 con 0x7fbb5c145710 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.419+0000 7fbb5b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0cf6a0 con 0x7fbb5c0b4420 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb59e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb5c145710 0x7fbb5c074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:54076/0 (socket says 172.21.15.39:54076) 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 -- 172.21.15.39:0/2015602335 learned_addr learned my addr 172.21.15.39:0/2015602335 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:29.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb51400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbb5c0d0740 0x7fbb5c0b3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:44168/0 (socket says 172.21.15.39:44168) 2024-04-26T23:27:29.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 -- 172.21.15.39:0/2015602335 >> v2:172.21.15.71:3300/0 conn(0x7fbb5c145710 msgr2=0x7fbb5c074030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:29.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 --2- 172.21.15.39:0/2015602335 >> v2:172.21.15.71:3300/0 conn(0x7fbb5c145710 0x7fbb5c074030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 -- 172.21.15.39:0/2015602335 >> v1:172.21.15.71:6789/0 conn(0x7fbb5c0d0740 legacy=0x7fbb5c0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 -- 172.21.15.39:0/2015602335 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c0cf980 con 0x7fbb5c0b4420 2024-04-26T23:27:29.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb5a800640 1 --2- 172.21.15.39:0/2015602335 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009870 tx=0x7fbb5401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec99f7ccae530b71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.423+0000 7fbb59400640 1 -- 172.21.15.39:0/2015602335 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540b2070 con 0x7fbb5c0b4420 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb59400640 1 -- 172.21.15.39:0/2015602335 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540a9070 con 0x7fbb5c0b4420 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb59400640 1 -- 172.21.15.39:0/2015602335 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540ad880 con 0x7fbb5c0b4420 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- 172.21.15.39:0/2015602335 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 msgr2=0x7fbb5c15f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- 172.21.15.39:0/2015602335 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009870 tx=0x7fbb5401c560 comp rx=0 tx=0).stop 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- 172.21.15.39:0/2015602335 shutdown_connections 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- 172.21.15.39:0/2015602335 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0b4420 0x7fbb5c15f980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- 172.21.15.39:0/2015602335 >> v2:172.21.15.71:3300/0 conn(0x7fbb5c145710 0x7fbb5c074030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- 172.21.15.39:0/2015602335 >> 172.21.15.39:0/2015602335 conn(0x7fbb5c06c3d0 msgr2=0x7fbb5c06c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- 172.21.15.39:0/2015602335 shutdown_connections 2024-04-26T23:27:29.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- 172.21.15.39:0/2015602335 wait complete. 2024-04-26T23:27:29.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 Processor -- start 2024-04-26T23:27:29.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- start start 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c0b4420 0x7fbb5c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0d0740 0x7fbb5c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c06ecb0 con 0x7fbb5c145710 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c06eb30 con 0x7fbb5c0b4420 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c06ee30 con 0x7fbb5c0d0740 2024-04-26T23:27:29.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb59e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c0b4420 0x7fbb5c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb51400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0d0740 0x7fbb5c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54800/0 (socket says 172.21.15.39:54800) 2024-04-26T23:27:29.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.427+0000 7fbb5a800640 1 -- 172.21.15.39:0/426668672 learned_addr learned my addr 172.21.15.39:0/426668672 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 -- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0d0740 msgr2=0x7fbb5c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0d0740 0x7fbb5c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 -- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c0b4420 msgr2=0x7fbb5c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c0b4420 0x7fbb5c15b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 -- 172.21.15.39:0/426668672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c15ce50 con 0x7fbb5c145710 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5a800640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b0040 tx=0x7fbb54019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540bb070 con 0x7fbb5c145710 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540adc60 con 0x7fbb5c145710 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540b2040 con 0x7fbb5c145710 2024-04-26T23:27:29.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c15d130 con 0x7fbb5c145710 2024-04-26T23:27:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c15d6f0 con 0x7fbb5c145710 2024-04-26T23:27:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c075c00 con 0x7fbb5c145710 2024-04-26T23:27:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb540ab070 con 0x7fbb5c145710 2024-04-26T23:27:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.431+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fbb5411f7e0 con 0x7fbb5c145710 2024-04-26T23:27:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.435+0000 7fbb59e00640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.435+0000 7fbb59e00640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 0x7fbb3806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c011340 tx=0x7fbb4c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.435+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbb54016150 con 0x7fbb5c145710 2024-04-26T23:27:29.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.615+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbb5c0506d0 con 0x7fbb5c145710 2024-04-26T23:27:29.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.615+0000 7fbb52a00640 1 -- 172.21.15.39:0/426668672 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) ==== 80+0+120 (secure 0 0 0) 0x7fbb540ef660 con 0x7fbb5c145710 2024-04-26T23:27:29.624 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6834/427434532 2024-04-27T23:27:24.528653+0000 2024-04-26T23:27:29.624 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6832/427434532 2024-04-27T23:27:24.528653+0000 2024-04-26T23:27:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:listed 2 entries 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 msgr2=0x7fbb3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 0x7fbb3806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c011340 tx=0x7fbb4c00b040 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 msgr2=0x7fbb5c13b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b0040 tx=0x7fbb54019300 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 shutdown_connections 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb5c145710 0x7fbb5c13b840 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb5c0d0740 0x7fbb5c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 --2- 172.21.15.39:0/426668672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c0b4420 0x7fbb5c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 >> 172.21.15.39:0/426668672 conn(0x7fbb5c06c3d0 msgr2=0x7fbb5c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 shutdown_connections 2024-04-26T23:27:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.619+0000 7fbb5b200640 1 -- 172.21.15.39:0/426668672 wait complete. 2024-04-26T23:27:29.645 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:27:29.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:29.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:29.673 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:27:29.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:29.673 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:27:29.725 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:27:29.725 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:29.725 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:29.735 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:29.735 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:29.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:29.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 Processor -- start 2024-04-26T23:27:29.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 -- start start 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 0x7f857006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8570161a30 con 0x7f857015d230 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8570160bb0 con 0x7f857015e1f0 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8570160e90 con 0x7f857015ce50 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 0x7f857006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:54102/0 (socket says 172.21.15.39:54102) 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 -- 172.21.15.39:0/1929952921 learned_addr learned my addr 172.21.15.39:0/1929952921 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f857015d230 0x7f8570161320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:44170/0 (socket says 172.21.15.39:44170) 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 -- 172.21.15.39:0/1929952921 >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 msgr2=0x7f857006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 --2- 172.21.15.39:0/1929952921 >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 0x7f857006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 -- 172.21.15.39:0/1929952921 >> v1:172.21.15.71:6789/0 conn(0x7f857015d230 legacy=0x7f8570161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8575a00640 1 -- 172.21.15.39:0/1929952921 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570073b80 con 0x7f857015ce50 2024-04-26T23:27:29.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.919+0000 7f8576400640 1 --2- 172.21.15.39:0/1929952921 >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 0x7f857006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:29.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8575a00640 1 --2- 172.21.15.39:0/1929952921 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8570160d30 tx=0x7f856401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a374447dbebf7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f856fe00640 1 -- 172.21.15.39:0/1929952921 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640b2070 con 0x7f857015ce50 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f856fe00640 1 -- 172.21.15.39:0/1929952921 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85640ad640 con 0x7f857015ce50 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f856fe00640 1 -- 172.21.15.39:0/1929952921 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640ada10 con 0x7f857015ce50 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 -- 172.21.15.39:0/1929952921 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 msgr2=0x7f85700d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 --2- 172.21.15.39:0/1929952921 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8570160d30 tx=0x7f856401c480 comp rx=0 tx=0).stop 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 -- 172.21.15.39:0/1929952921 shutdown_connections 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 --2- 172.21.15.39:0/1929952921 >> v2:172.21.15.71:3300/0 conn(0x7f857015e1f0 0x7f857006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 --2- 172.21.15.39:0/1929952921 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015ce50 0x7f85700d1340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 -- 172.21.15.39:0/1929952921 >> 172.21.15.39:0/1929952921 conn(0x7f85700b3860 msgr2=0x7f85700b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 -- 172.21.15.39:0/1929952921 shutdown_connections 2024-04-26T23:27:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.923+0000 7f8576e00640 1 -- 172.21.15.39:0/1929952921 wait complete. 2024-04-26T23:27:29.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 Processor -- start 2024-04-26T23:27:29.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- start start 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 0x7f8570166c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015e1f0 0x7f85701671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85700ce580 con 0x7f857015ce50 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85700ce400 con 0x7f857015d230 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85700ce700 con 0x7f857015e1f0 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54808/0 (socket says 172.21.15.39:54808) 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 -- 172.21.15.39:0/421501345 learned_addr learned my addr 172.21.15.39:0/421501345 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575000640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 0x7f8570166c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576400640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015e1f0 0x7f85701671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 -- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015e1f0 msgr2=0x7f85701671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015e1f0 0x7f85701671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 -- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 msgr2=0x7f8570166c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 0x7f8570166c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 -- 172.21.15.39:0/421501345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570157470 con 0x7f857015ce50 2024-04-26T23:27:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575000640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 0x7f8570166c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8575a00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f85640b0040 tx=0x7f8564019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640bd070 con 0x7f857015ce50 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85640b8430 con 0x7f857015ce50 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640b2040 con 0x7f857015ce50 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8570157750 con 0x7f857015ce50 2024-04-26T23:27:29.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8570154e60 con 0x7f857015ce50 2024-04-26T23:27:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.927+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85700506d0 con 0x7f857015ce50 2024-04-26T23:27:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.931+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85640c0070 con 0x7f857015ce50 2024-04-26T23:27:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.931+0000 7f856d600640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 0x7f855006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.931+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f8564120500 con 0x7f857015ce50 2024-04-26T23:27:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.931+0000 7f8575000640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 0x7f855006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:29.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.931+0000 7f8575000640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 0x7f855006a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8570070f10 tx=0x7f855c007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:29.935+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8564016130 con 0x7f857015ce50 2024-04-26T23:27:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8570073490 con 0x7f857015ce50 2024-04-26T23:27:30.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f856d600640 1 -- 172.21.15.39:0/421501345 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16736 (secure 0 0 0) 0x7f85640f09c0 con 0x7f857015ce50 2024-04-26T23:27:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:30.110 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:27.546596+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:30.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 msgr2=0x7f855006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 0x7f855006a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8570070f10 tx=0x7f855c007d70 comp rx=0 tx=0).stop 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 msgr2=0x7f85701596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f85640b0040 tx=0x7f8564019220 comp rx=0 tx=0).stop 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 shutdown_connections 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8550068380 0x7f855006a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f857015e1f0 0x7f85701671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f857015d230 0x7f8570166c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 --2- 172.21.15.39:0/421501345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f857015ce50 0x7f85701596f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 >> 172.21.15.39:0/421501345 conn(0x7f85700b3860 msgr2=0x7f857015e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 shutdown_connections 2024-04-26T23:27:30.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.103+0000 7f8576e00640 1 -- 172.21.15.39:0/421501345 wait complete. 2024-04-26T23:27:30.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:07.117634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:08.271295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:30.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:30.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.267+0000 7f3ed6400640 1 Processor -- start 2024-04-26T23:27:30.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.267+0000 7f3ed6400640 1 -- start start 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ed6400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ed0073400 0x7f3ed0072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ed6400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 0x7f3ed00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ed6400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed0072180 con 0x7f3ed01458d0 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ed6400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed00739a0 con 0x7f3ed0073400 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ed6400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed0073c80 con 0x7f3ed0072e50 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ec7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ed0073400 0x7f3ed0072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ecf400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3ed01458d0 0x7f3ed00b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42400/0 (socket says 172.21.15.39:42400) 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ecf400640 1 -- 172.21.15.39:0/1473535332 learned_addr learned my addr 172.21.15.39:0/1473535332 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ecfe00640 1 --2- 172.21.15.39:0/1473535332 >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 0x7f3ed00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ec7e00640 1 -- 172.21.15.39:0/1473535332 >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 msgr2=0x7f3ed00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:30.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ec7e00640 1 --2- 172.21.15.39:0/1473535332 >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 0x7f3ed00ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ec7e00640 1 -- 172.21.15.39:0/1473535332 >> v1:172.21.15.39:6789/0 conn(0x7f3ed01458d0 legacy=0x7f3ed00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ec7e00640 1 -- 172.21.15.39:0/1473535332 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed0145cb0 con 0x7f3ed0073400 2024-04-26T23:27:30.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ecfe00640 1 --2- 172.21.15.39:0/1473535332 >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 0x7f3ed00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:30.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.271+0000 7f3ecea00640 1 -- 172.21.15.39:0/1473535332 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232052258 0 0) 0x7f3ed0072180 con 0x7f3ed01458d0 2024-04-26T23:27:30.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ec7e00640 1 --2- 172.21.15.39:0/1473535332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed0073400 0x7f3ed0072910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80097c0 tx=0x7f3eb801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36d198f91a086ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ecea00640 1 -- 172.21.15.39:0/1473535332 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80b0070 con 0x7f3ed0073400 2024-04-26T23:27:30.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ecea00640 1 -- 172.21.15.39:0/1473535332 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb80ab600 con 0x7f3ed0073400 2024-04-26T23:27:30.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ecea00640 1 -- 172.21.15.39:0/1473535332 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80ab9d0 con 0x7f3ed0073400 2024-04-26T23:27:30.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- 172.21.15.39:0/1473535332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed0073400 msgr2=0x7f3ed0072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- 172.21.15.39:0/1473535332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed0073400 0x7f3ed0072910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80097c0 tx=0x7f3eb801c3d0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- 172.21.15.39:0/1473535332 shutdown_connections 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- 172.21.15.39:0/1473535332 >> v2:172.21.15.71:3300/0 conn(0x7f3ed0072e50 0x7f3ed00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- 172.21.15.39:0/1473535332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed0073400 0x7f3ed0072910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- 172.21.15.39:0/1473535332 >> 172.21.15.39:0/1473535332 conn(0x7f3ed006c7d0 msgr2=0x7f3ed006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- 172.21.15.39:0/1473535332 shutdown_connections 2024-04-26T23:27:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- 172.21.15.39:0/1473535332 wait complete. 2024-04-26T23:27:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 Processor -- start 2024-04-26T23:27:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- start start 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 0x7f3ed013eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed0073400 0x7f3ed0132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed00cef30 con 0x7f3ed01458d0 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0073260 con 0x7f3ed0073400 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.275+0000 7f3ed6400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed0169150 con 0x7f3ed0072e50 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36466/0 (socket says 172.21.15.39:36466) 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 -- 172.21.15.39:0/4225271622 learned_addr learned my addr 172.21.15.39:0/4225271622 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ec7e00640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed0073400 0x7f3ed0132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecf400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 0x7f3ed013eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 -- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 msgr2=0x7f3ed013eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 0x7f3ed013eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 -- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed0073400 msgr2=0x7f3ed0132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed0073400 0x7f3ed0132570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 -- 172.21.15.39:0/4225271622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed0157600 con 0x7f3ed01458d0 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecf400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 0x7f3ed013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:30.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ecfe00640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8007ef0 tx=0x7f3ec800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec801a070 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec8003ba0 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed01578a0 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8004030 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed0157e60 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed006a720 con 0x7f3ed01458d0 2024-04-26T23:27:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.279+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ec801d070 con 0x7f3ed01458d0 2024-04-26T23:27:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.283+0000 7f3ec7400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 0x7f3eac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.283+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f3ec8086b40 con 0x7f3ed01458d0 2024-04-26T23:27:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.283+0000 7f3ecf400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 0x7f3eac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.283+0000 7f3ecf400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 0x7f3eac06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0007fd0 tx=0x7f3ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.287+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3ec8010070 con 0x7f3ed01458d0 2024-04-26T23:27:30.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.451+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ed00d0340 con 0x7f3ed01458d0 2024-04-26T23:27:30.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.451+0000 7f3ec7400640 1 -- 172.21.15.39:0/4225271622 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f3ec8056ac0 con 0x7f3ed01458d0 2024-04-26T23:27:30.460 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 msgr2=0x7f3eac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 0x7f3eac06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0007fd0 tx=0x7f3ec0009040 comp rx=0 tx=0).stop 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 msgr2=0x7f3ed0158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8007ef0 tx=0x7f3ec800d4a0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 shutdown_connections 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3eac068380 0x7f3eac06a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ed01458d0 0x7f3ed0158660 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed0073400 0x7f3ed0132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 --2- 172.21.15.39:0/4225271622 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ed0072e50 0x7f3ed013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 >> 172.21.15.39:0/4225271622 conn(0x7f3ed006c7d0 msgr2=0x7f3ed00b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 shutdown_connections 2024-04-26T23:27:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.455+0000 7f3ed6400640 1 -- 172.21.15.39:0/4225271622 wait complete. 2024-04-26T23:27:30.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:27:30.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 Processor -- start 2024-04-26T23:27:30.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 -- start start 2024-04-26T23:27:30.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8480d1b10 0x7fa8480b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480b4770 con 0x7fa84815d240 2024-04-26T23:27:30.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480aff80 con 0x7fa8480b3f10 2024-04-26T23:27:30.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa850000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa84815d620 con 0x7fa8480d1b10 2024-04-26T23:27:30.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84d600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa84815d240 0x7fa8480d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42416/0 (socket says 172.21.15.39:42416) 2024-04-26T23:27:30.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84cc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8480d1b10 0x7fa8480b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84d600640 1 -- 172.21.15.39:0/3407104415 learned_addr learned my addr 172.21.15.39:0/3407104415 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84cc00640 1 -- 172.21.15.39:0/3407104415 >> v1:172.21.15.71:6789/0 conn(0x7fa8480b3f10 legacy=0x7fa8480b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84cc00640 1 -- 172.21.15.39:0/3407104415 >> v1:172.21.15.39:6789/0 conn(0x7fa84815d240 legacy=0x7fa8480d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa84cc00640 1 -- 172.21.15.39:0/3407104415 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8480b0260 con 0x7fa8480d1b10 2024-04-26T23:27:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.619+0000 7fa847e00640 1 -- 172.21.15.39:0/3407104415 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101740486 0 0) 0x7fa8480b4770 con 0x7fa84815d240 2024-04-26T23:27:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa84cc00640 1 --2- 172.21.15.39:0/3407104415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8480d1b10 0x7fa8480b39d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097c0 tx=0x7fa83401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db31bb79cf7466f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa847e00640 1 -- 172.21.15.39:0/3407104415 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340b0070 con 0x7fa8480d1b10 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa847e00640 1 -- 172.21.15.39:0/3407104415 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8340ab600 con 0x7fa8480d1b10 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa847e00640 1 -- 172.21.15.39:0/3407104415 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340ab9d0 con 0x7fa8480d1b10 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 -- 172.21.15.39:0/3407104415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8480d1b10 msgr2=0x7fa8480b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 --2- 172.21.15.39:0/3407104415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8480d1b10 0x7fa8480b39d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097c0 tx=0x7fa83401c3d0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 -- 172.21.15.39:0/3407104415 shutdown_connections 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 --2- 172.21.15.39:0/3407104415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8480d1b10 0x7fa8480b39d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 -- 172.21.15.39:0/3407104415 >> 172.21.15.39:0/3407104415 conn(0x7fa8480d3040 msgr2=0x7fa8480d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 -- 172.21.15.39:0/3407104415 shutdown_connections 2024-04-26T23:27:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.623+0000 7fa850000640 1 -- 172.21.15.39:0/3407104415 wait complete. 2024-04-26T23:27:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 Processor -- start 2024-04-26T23:27:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- start start 2024-04-26T23:27:30.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8480b3f10 0x7fa8481512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8480d1b10 0x7fa84815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8480b1d90 con 0x7fa84815d240 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8480b1c10 con 0x7fa8480d1b10 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa84816ad00 con 0x7fa8480b3f10 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36492/0 (socket says 172.21.15.39:36492) 2024-04-26T23:27:30.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 -- 172.21.15.39:0/2632329438 learned_addr learned my addr 172.21.15.39:0/2632329438 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:30.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84cc00640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8480d1b10 0x7fa84815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84d600640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8480b3f10 0x7fa8481512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 -- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8480b3f10 msgr2=0x7fa8481512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8480b3f10 0x7fa8481512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 -- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8480d1b10 msgr2=0x7fa84815ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8480d1b10 0x7fa84815ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 -- 172.21.15.39:0/2632329438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84815fce0 con 0x7fa84815d240 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa84e000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa84000ba10 tx=0x7fa84000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840019070 con 0x7fa84815d240 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84000cac0 con 0x7fa84815d240 2024-04-26T23:27:30.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840014440 con 0x7fa84815d240 2024-04-26T23:27:30.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84815ffc0 con 0x7fa84815d240 2024-04-26T23:27:30.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa848160580 con 0x7fa84815d240 2024-04-26T23:27:30.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.627+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84806a720 con 0x7fa84815d240 2024-04-26T23:27:30.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.631+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa84001c070 con 0x7fa84815d240 2024-04-26T23:27:30.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.631+0000 7fa845600640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 0x7fa82806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.631+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fa8400865e0 con 0x7fa84815d240 2024-04-26T23:27:30.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.631+0000 7fa84d600640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 0x7fa82806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.631+0000 7fa84d600640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 0x7fa82806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000f70 tx=0x7fa83c007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.635+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa840056b30 con 0x7fa84815d240 2024-04-26T23:27:30.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.799+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa8480760f0 con 0x7fa84815d240 2024-04-26T23:27:30.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.799+0000 7fa845600640 1 -- 172.21.15.39:0/2632329438 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7fa840056430 con 0x7fa84815d240 2024-04-26T23:27:30.807 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 msgr2=0x7fa82806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 0x7fa82806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000f70 tx=0x7fa83c007b60 comp rx=0 tx=0).stop 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 msgr2=0x7fa84815f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa84000ba10 tx=0x7fa84000bed0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 shutdown_connections 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa828068380 0x7fa82806a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa84815d240 0x7fa84815f250 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8480d1b10 0x7fa84815ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 --2- 172.21.15.39:0/2632329438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa8480b3f10 0x7fa8481512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 >> 172.21.15.39:0/2632329438 conn(0x7fa8480d3040 msgr2=0x7fa8480b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 shutdown_connections 2024-04-26T23:27:30.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.803+0000 7fa850000640 1 -- 172.21.15.39:0/2632329438 wait complete. 2024-04-26T23:27:30.829 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:27:30.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 Processor -- start 2024-04-26T23:27:30.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 -- start start 2024-04-26T23:27:30.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 0x7ffa580d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 0x7ffa580cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5806e500 con 0x7ffa58140170 2024-04-26T23:27:30.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ffa5806f110 con 0x7ffa580d1720 2024-04-26T23:27:30.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa5e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5806e7e0 con 0x7ffa58161850 2024-04-26T23:27:30.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa4ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 0x7ffa580d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa57e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 0x7ffa580cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa57400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffa58140170 0x7ffa5815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:34054/0 (socket says 172.21.15.39:34054) 2024-04-26T23:27:30.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa57400640 1 -- 172.21.15.39:0/3689860486 learned_addr learned my addr 172.21.15.39:0/3689860486 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:30.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa56a00640 1 -- 172.21.15.39:0/3689860486 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536959993 0 0) 0x7ffa5806e500 con 0x7ffa58140170 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa56a00640 1 -- 172.21.15.39:0/3689860486 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa3c003530 con 0x7ffa58140170 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa4ea00640 1 -- 172.21.15.39:0/3689860486 >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 msgr2=0x7ffa580cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa4ea00640 1 --2- 172.21.15.39:0/3689860486 >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 0x7ffa580cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa4ea00640 1 -- 172.21.15.39:0/3689860486 >> v1:172.21.15.71:6789/0 conn(0x7ffa58140170 legacy=0x7ffa5815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa4ea00640 1 -- 172.21.15.39:0/3689860486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5806eac0 con 0x7ffa58161850 2024-04-26T23:27:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.967+0000 7ffa57e00640 1 --2- 172.21.15.39:0/3689860486 >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 0x7ffa580cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:30.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa4ea00640 1 --2- 172.21.15.39:0/3689860486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 0x7ffa580d11e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa400097c0 tx=0x7ffa4001cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10f065cde9c30b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa56a00640 1 -- 172.21.15.39:0/3689860486 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400b1070 con 0x7ffa58161850 2024-04-26T23:27:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa56a00640 1 -- 172.21.15.39:0/3689860486 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa400ac410 con 0x7ffa58161850 2024-04-26T23:27:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa56a00640 1 -- 172.21.15.39:0/3689860486 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400ac7e0 con 0x7ffa58161850 2024-04-26T23:27:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 -- 172.21.15.39:0/3689860486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 msgr2=0x7ffa580d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 --2- 172.21.15.39:0/3689860486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 0x7ffa580d11e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa400097c0 tx=0x7ffa4001cec0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 -- 172.21.15.39:0/3689860486 shutdown_connections 2024-04-26T23:27:30.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 --2- 172.21.15.39:0/3689860486 >> v2:172.21.15.71:3300/0 conn(0x7ffa580d1720 0x7ffa580cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 --2- 172.21.15.39:0/3689860486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58161850 0x7ffa580d11e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 -- 172.21.15.39:0/3689860486 >> 172.21.15.39:0/3689860486 conn(0x7ffa5806c7d0 msgr2=0x7ffa5806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:30.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 -- 172.21.15.39:0/3689860486 shutdown_connections 2024-04-26T23:27:30.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.971+0000 7ffa5e600640 1 -- 172.21.15.39:0/3689860486 wait complete. 2024-04-26T23:27:30.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 Processor -- start 2024-04-26T23:27:30.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- start start 2024-04-26T23:27:30.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58140170 0x7ffa58142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa58161850 0x7ffa58152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580d07d0 con 0x7ffa580d1720 2024-04-26T23:27:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580d0650 con 0x7ffa58161850 2024-04-26T23:27:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ffa580d0950 con 0x7ffa58140170 2024-04-26T23:27:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36498/0 (socket says 172.21.15.39:36498) 2024-04-26T23:27:30.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 -- 172.21.15.39:0/2792601063 learned_addr learned my addr 172.21.15.39:0/2792601063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:30.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa4ea00640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58140170 0x7ffa58142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57e00640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa58161850 0x7ffa58152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 -- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58140170 msgr2=0x7ffa58142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58140170 0x7ffa58142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 -- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa58161850 msgr2=0x7ffa58152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:30.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa58161850 0x7ffa58152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:30.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 -- 172.21.15.39:0/2792601063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa58154150 con 0x7ffa580d1720 2024-04-26T23:27:30.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa57400640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c480 tx=0x7ffa4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48017070 con 0x7ffa580d1720 2024-04-26T23:27:30.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48005cf0 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa58143460 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa480072f0 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.975+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa58155880 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5806a720 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa4801a070 con 0x7ffa580d1720 2024-04-26T23:27:30.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa4fe00640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 0x7ffa3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:30.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7ffa48085d50 con 0x7ffa580d1720 2024-04-26T23:27:30.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa4ea00640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 0x7ffa3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:30.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.979+0000 7ffa4ea00640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 0x7ffa3406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa400ae000 tx=0x7ffa40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:30.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:30.983+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffa48089030 con 0x7ffa580d1720 2024-04-26T23:27:31.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.147+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa5806fdc0 con 0x7ffa580d1720 2024-04-26T23:27:31.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.147+0000 7ffa4fe00640 1 -- 172.21.15.39:0/2792601063 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7ffa48055be0 con 0x7ffa580d1720 2024-04-26T23:27:31.156 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:27:31.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 msgr2=0x7ffa3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 0x7ffa3406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa400ae000 tx=0x7ffa40008040 comp rx=0 tx=0).stop 2024-04-26T23:27:31.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 msgr2=0x7ffa58153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c480 tx=0x7ffa4800c880 comp rx=0 tx=0).stop 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 shutdown_connections 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ffa340683b0 0x7ffa3406a870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa58161850 0x7ffa58152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ffa58140170 0x7ffa58142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 --2- 172.21.15.39:0/2792601063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa580d1720 0x7ffa58153c10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 >> 172.21.15.39:0/2792601063 conn(0x7ffa5806c7d0 msgr2=0x7ffa58073c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 shutdown_connections 2024-04-26T23:27:31.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.151+0000 7ffa5e600640 1 -- 172.21.15.39:0/2792601063 wait complete. 2024-04-26T23:27:31.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:27:31.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.311+0000 7fba61600640 1 Processor -- start 2024-04-26T23:27:31.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 -- start start 2024-04-26T23:27:31.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 0x7fba5c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c06e750 con 0x7fba5c0d0f20 2024-04-26T23:27:31.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c06ea30 con 0x7fba5c15f990 2024-04-26T23:27:31.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba61600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c06ed10 con 0x7fba5c0d1a90 2024-04-26T23:27:31.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba52000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fba5c0d0f20 0x7fba5c0d1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:34070/0 (socket says 172.21.15.39:34070) 2024-04-26T23:27:31.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba52000640 1 -- 172.21.15.39:0/1420196818 learned_addr learned my addr 172.21.15.39:0/1420196818 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:31.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5aa00640 1 --2- 172.21.15.39:0/1420196818 >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 0x7fba5c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5a000640 1 -- 172.21.15.39:0/1420196818 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810443091 0 0) 0x7fba5c06e750 con 0x7fba5c0d0f20 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5a000640 1 -- 172.21.15.39:0/1420196818 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba40003530 con 0x7fba5c0d0f20 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5b400640 1 -- 172.21.15.39:0/1420196818 >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 msgr2=0x7fba5c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5b400640 1 --2- 172.21.15.39:0/1420196818 >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 0x7fba5c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5b400640 1 -- 172.21.15.39:0/1420196818 >> v1:172.21.15.71:6789/0 conn(0x7fba5c0d0f20 legacy=0x7fba5c0d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5b400640 1 -- 172.21.15.39:0/1420196818 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0b2a00 con 0x7fba5c0d1a90 2024-04-26T23:27:31.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.315+0000 7fba5aa00640 1 --2- 172.21.15.39:0/1420196818 >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 0x7fba5c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:31.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba5b400640 1 --2- 172.21.15.39:0/1420196818 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c0b2f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba54009d90 tx=0x7fba5401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649fee8aed4f0cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba5a000640 1 -- 172.21.15.39:0/1420196818 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540b2070 con 0x7fba5c0d1a90 2024-04-26T23:27:31.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba5a000640 1 -- 172.21.15.39:0/1420196818 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba540a5830 con 0x7fba5c0d1a90 2024-04-26T23:27:31.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba5a000640 1 -- 172.21.15.39:0/1420196818 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540a5c00 con 0x7fba5c0d1a90 2024-04-26T23:27:31.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- 172.21.15.39:0/1420196818 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 msgr2=0x7fba5c0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 --2- 172.21.15.39:0/1420196818 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c0b2f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba54009d90 tx=0x7fba5401c970 comp rx=0 tx=0).stop 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- 172.21.15.39:0/1420196818 shutdown_connections 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 --2- 172.21.15.39:0/1420196818 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c0b2f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 --2- 172.21.15.39:0/1420196818 >> v2:172.21.15.71:3300/0 conn(0x7fba5c15f990 0x7fba5c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- 172.21.15.39:0/1420196818 >> 172.21.15.39:0/1420196818 conn(0x7fba5c0d3020 msgr2=0x7fba5c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- 172.21.15.39:0/1420196818 shutdown_connections 2024-04-26T23:27:31.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- 172.21.15.39:0/1420196818 wait complete. 2024-04-26T23:27:31.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 Processor -- start 2024-04-26T23:27:31.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.319+0000 7fba61600640 1 -- start start 2024-04-26T23:27:31.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c15f990 0x7fba5c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0b4080 con 0x7fba5c0d0f20 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0b3f00 con 0x7fba5c15f990 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0b4200 con 0x7fba5c0d1a90 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36510/0 (socket says 172.21.15.39:36510) 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 -- 172.21.15.39:0/3627524536 learned_addr learned my addr 172.21.15.39:0/3627524536 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 -- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 msgr2=0x7fba5c154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 -- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c15f990 msgr2=0x7fba5c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c15f990 0x7fba5c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 -- 172.21.15.39:0/3627524536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0c73a0 con 0x7fba5c0d0f20 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba5aa00640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e9b0 tx=0x7fba4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c017070 con 0x7fba5c0d0f20 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c00ca00 con 0x7fba5c0d0f20 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00cdd0 con 0x7fba5c0d0f20 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c0c7680 con 0x7fba5c0d0f20 2024-04-26T23:27:31.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c155160 con 0x7fba5c0d0f20 2024-04-26T23:27:31.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c06a720 con 0x7fba5c0d0f20 2024-04-26T23:27:31.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.323+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba4c01a070 con 0x7fba5c0d0f20 2024-04-26T23:27:31.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.327+0000 7fba53400640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 0x7fba3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.327+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fba4c086c90 con 0x7fba5c0d0f20 2024-04-26T23:27:31.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.327+0000 7fba52000640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 0x7fba3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.327+0000 7fba52000640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 0x7fba3806a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba44007fd0 tx=0x7fba44007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.331+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba4c0571e0 con 0x7fba5c0d0f20 2024-04-26T23:27:31.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.503+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba5c074580 con 0x7fba5c0d0f20 2024-04-26T23:27:31.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.503+0000 7fba53400640 1 -- 172.21.15.39:0/3627524536 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) ==== 80+0+120 (secure 0 0 0) 0x7fba4c056ae0 con 0x7fba5c0d0f20 2024-04-26T23:27:31.512 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6834/427434532 2024-04-27T23:27:24.528653+0000 2024-04-26T23:27:31.512 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6832/427434532 2024-04-27T23:27:24.528653+0000 2024-04-26T23:27:31.512 INFO:teuthology.orchestra.run.smithi039.stderr:listed 2 entries 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 msgr2=0x7fba3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 0x7fba3806a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba44007fd0 tx=0x7fba44007900 comp rx=0 tx=0).stop 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 msgr2=0x7fba5c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e9b0 tx=0x7fba4c00ee70 comp rx=0 tx=0).stop 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 shutdown_connections 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fba38068380 0x7fba3806a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c15f990 0x7fba5c0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba5c0d1a90 0x7fba5c154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 --2- 172.21.15.39:0/3627524536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba5c0d0f20 0x7fba5c15d8c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 >> 172.21.15.39:0/3627524536 conn(0x7fba5c0d3020 msgr2=0x7fba5c15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 shutdown_connections 2024-04-26T23:27:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.507+0000 7fba61600640 1 -- 172.21.15.39:0/3627524536 wait complete. 2024-04-26T23:27:31.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T23:27:31.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:31.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:31.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:27:31.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:31.563 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:27:31.616 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:27:31.617 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:31.617 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:31.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:27:31.626 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:27:31.626 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:31.626 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:31.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:27:31.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:31.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 Processor -- start 2024-04-26T23:27:31.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 -- start start 2024-04-26T23:27:31.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9740b03e0 0x7fd9740b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b0bc0 0x7fd974160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd97406c3d0 0x7fd97406c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd97406cda0 con 0x7fd9740b03e0 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd9740b07c0 con 0x7fd97406c3d0 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd97a200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd9740b1160 con 0x7fd9740b0bc0 2024-04-26T23:27:31.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9740b03e0 0x7fd9740b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9740b03e0 0x7fd9740b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36518/0 (socket says 172.21.15.39:36518) 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 -- 172.21.15.39:0/2739112810 learned_addr learned my addr 172.21.15.39:0/2739112810 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd979800640 1 --2- 172.21.15.39:0/2739112810 >> v2:172.21.15.71:3300/0 conn(0x7fd97406c3d0 0x7fd97406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd96be00640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b0bc0 0x7fd974160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 -- 172.21.15.39:0/2739112810 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b0bc0 msgr2=0x7fd974160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:31.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b0bc0 0x7fd974160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 -- 172.21.15.39:0/2739112810 >> v2:172.21.15.71:3300/0 conn(0x7fd97406c3d0 msgr2=0x7fd97406c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:31.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 --2- 172.21.15.39:0/2739112810 >> v2:172.21.15.71:3300/0 conn(0x7fd97406c3d0 0x7fd97406c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.807+0000 7fd978e00640 1 -- 172.21.15.39:0/2739112810 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9740b1440 con 0x7fd9740b03e0 2024-04-26T23:27:31.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd978e00640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b03e0 0x7fd9740b6c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd974072ea0 tx=0x7fd96401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926b9253defbaa04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd973e00640 1 -- 172.21.15.39:0/2739112810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640aa430 con 0x7fd9740b03e0 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd973e00640 1 -- 172.21.15.39:0/2739112810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9640af070 con 0x7fd9740b03e0 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd973e00640 1 -- 172.21.15.39:0/2739112810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640aa7f0 con 0x7fd9740b03e0 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 -- 172.21.15.39:0/2739112810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b03e0 msgr2=0x7fd9740b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b03e0 0x7fd9740b6c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd974072ea0 tx=0x7fd96401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 -- 172.21.15.39:0/2739112810 shutdown_connections 2024-04-26T23:27:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 --2- 172.21.15.39:0/2739112810 >> v2:172.21.15.71:3300/0 conn(0x7fd97406c3d0 0x7fd97406c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b0bc0 0x7fd974160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 --2- 172.21.15.39:0/2739112810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b03e0 0x7fd9740b6c40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 -- 172.21.15.39:0/2739112810 >> 172.21.15.39:0/2739112810 conn(0x7fd97406d6b0 msgr2=0x7fd97406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 -- 172.21.15.39:0/2739112810 shutdown_connections 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 -- 172.21.15.39:0/2739112810 wait complete. 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.811+0000 7fd97a200640 1 Processor -- start 2024-04-26T23:27:31.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- start start 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97406c3d0 0x7fd974159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b03e0 0x7fd97415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd974160670 con 0x7fd9740b0bc0 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740b7180 con 0x7fd97406c3d0 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd9741607f0 con 0x7fd9740b03e0 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36526/0 (socket says 172.21.15.39:36526) 2024-04-26T23:27:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 -- 172.21.15.39:0/2280148463 learned_addr learned my addr 172.21.15.39:0/2280148463 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd96be00640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b03e0 0x7fd97415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd978e00640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97406c3d0 0x7fd974159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 -- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b03e0 msgr2=0x7fd97415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b03e0 0x7fd97415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 -- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97406c3d0 msgr2=0x7fd974159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97406c3d0 0x7fd974159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 -- 172.21.15.39:0/2280148463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97415ce50 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd979800640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd96c007d20 tx=0x7fd96c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c014420 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c019070 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c014820 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97415c5f0 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97415c890 con 0x7fd9740b0bc0 2024-04-26T23:27:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.815+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9740506d0 con 0x7fd9740b0bc0 2024-04-26T23:27:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.819+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd96c0149c0 con 0x7fd9740b0bc0 2024-04-26T23:27:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.819+0000 7fd971600640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 0x7fd95006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.819+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7fd96c0870c0 con 0x7fd9740b0bc0 2024-04-26T23:27:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.819+0000 7fd978e00640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 0x7fd95006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.819+0000 7fd978e00640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 0x7fd95006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9640ae000 tx=0x7fd9640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:31.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:31.823+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd97415ce50 con 0x7fd9740b0bc0 2024-04-26T23:27:32.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.023+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd974073ba0 con 0x7fd9740b0bc0 2024-04-26T23:27:32.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.023+0000 7fd971600640 1 -- 172.21.15.39:0/2280148463 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5181 (secure 0 0 0) 0x7fd96c056fc0 con 0x7fd9740b0bc0 2024-04-26T23:27:32.031 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:32.031 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2535626997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2535626997},{"type":"v1","addr":"172.21.15.39:6834","nonce":2535626997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:32.031 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 22 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 msgr2=0x7fd95006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 0x7fd95006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9640ae000 tx=0x7fd9640a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 msgr2=0x7fd974070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd96c007d20 tx=0x7fd96c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 shutdown_connections 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd950068380 0x7fd95006a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9740b0bc0 0x7fd974070620 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9740b03e0 0x7fd97415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 --2- 172.21.15.39:0/2280148463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97406c3d0 0x7fd974159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 >> 172.21.15.39:0/2280148463 conn(0x7fd97406d6b0 msgr2=0x7fd9740af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 shutdown_connections 2024-04-26T23:27:32.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.027+0000 7fd97a200640 1 -- 172.21.15.39:0/2280148463 wait complete. 2024-04-26T23:27:32.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:32.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 Processor -- start 2024-04-26T23:27:32.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 -- start start 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e40cd810 0x7f82e40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40d0550 con 0x7f82e40cdbf0 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40d0830 con 0x7f82e40cfe00 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82eaa00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40d0b10 con 0x7f82e40cd810 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e8a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f82e40cdbf0 0x7f82e406ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42426/0 (socket says 172.21.15.39:42426) 2024-04-26T23:27:32.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e8a00640 1 -- 172.21.15.39:0/568677799 learned_addr learned my addr 172.21.15.39:0/568677799 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3e00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e40cd810 0x7f82e40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878412265 0 0) 0x7f82e40d0550 con 0x7f82e40cdbf0 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c8003530 con 0x7f82e40cdbf0 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244222747 0 0) 0x7f82e40d0830 con 0x7f82e40cfe00 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e40d0550 con 0x7f82e40cfe00 2024-04-26T23:27:32.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2521757565 0 0) 0x7f82c8003530 con 0x7f82e40cdbf0 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e40cd810 msgr2=0x7f82e40742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e40cd810 0x7f82e40742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 >> v1:172.21.15.71:6789/0 conn(0x7f82e40cfe00 legacy=0x7f82e4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e406e600 con 0x7f82e40cdbf0 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.187+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f82dc001a00 con 0x7f82e40cdbf0 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 >> v1:172.21.15.39:6789/0 conn(0x7f82e40cdbf0 legacy=0x7f82e406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c8003b80 0x7f82c8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82c8004810 0x7f82c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40d0b10 con 0x7f82c80051d0 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82c800c040 con 0x7f82c8003b80 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f82c800c240 con 0x7f82c8004810 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3e00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e40cd810 0x7f82e40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3e00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c8003b80 0x7f82c8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82db400640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82c8004810 0x7f82c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 -- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82c8004810 msgr2=0x7f82c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82c8004810 0x7f82c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 -- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c8003b80 msgr2=0x7f82c8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c8003b80 0x7f82c8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 -- 172.21.15.39:0/568677799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8003530 con 0x7f82c80051d0 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e8a00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82c800b9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a810 tx=0x7f82dc01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e255503794b950d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00a430 con 0x7f82c80051d0 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc0ad650 con 0x7f82c80051d0 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.191+0000 7f82e3400640 1 -- 172.21.15.39:0/568677799 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0ada40 con 0x7f82c80051d0 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- 172.21.15.39:0/568677799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 msgr2=0x7f82c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 --2- 172.21.15.39:0/568677799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82c800b9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a810 tx=0x7f82dc01d300 comp rx=0 tx=0).stop 2024-04-26T23:27:32.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e8a00640 1 -- 172.21.15.39:0/568677799 reap_dead start 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- 172.21.15.39:0/568677799 shutdown_connections 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- 172.21.15.39:0/568677799 >> 172.21.15.39:0/568677799 conn(0x7f82e40b2af0 msgr2=0x7f82e40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- 172.21.15.39:0/568677799 shutdown_connections 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- 172.21.15.39:0/568677799 wait complete. 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 Processor -- start 2024-04-26T23:27:32.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- start start 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e41f5950 0x7f82e41602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e4156820 0x7f82e4142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40ce080 con 0x7f82c80051d0 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82e406e970 con 0x7f82e41f5950 2024-04-26T23:27:32.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82eaa00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f82e4143bb0 con 0x7f82e4156820 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36550/0 (socket says 172.21.15.39:36550) 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 -- 172.21.15.39:0/487261465 learned_addr learned my addr 172.21.15.39:0/487261465 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82db400640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e41f5950 0x7f82e41602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e8a00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e4156820 0x7f82e4142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 -- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e4156820 msgr2=0x7f82e4142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e4156820 0x7f82e4142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 -- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e41f5950 msgr2=0x7f82e41602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e41f5950 0x7f82e41602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.195+0000 7f82e3e00640 1 -- 172.21.15.39:0/487261465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e415e930 con 0x7f82c80051d0 2024-04-26T23:27:32.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e3e00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f82d40119d0 tx=0x7f82d4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d400fc10 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d400fdb0 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4014640 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e41570c0 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e415dbf0 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e4050740 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82d4012040 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 0x7f82c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f82d4087260 con 0x7f82c80051d0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.199+0000 7f82db400640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 0x7f82c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.203+0000 7f82db400640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 0x7f82c006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f82cc005630 tx=0x7f82cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.203+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82d4019030 con 0x7f82c80051d0 2024-04-26T23:27:32.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82e4160810 con 0x7f82c80051d0 2024-04-26T23:27:32.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82e0c00640 1 -- 172.21.15.39:0/487261465 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16736 (secure 0 0 0) 0x7f82d4057720 con 0x7f82c80051d0 2024-04-26T23:27:32.378 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:32.378 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:27.546596+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:32.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 msgr2=0x7f82c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 0x7f82c006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f82cc005630 tx=0x7f82cc009040 comp rx=0 tx=0).stop 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 msgr2=0x7f82e415e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f82d40119d0 tx=0x7f82d4011e90 comp rx=0 tx=0).stop 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 shutdown_connections 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f82c0068380 0x7f82c006a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f82e4156820 0x7f82e4142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e41f5950 0x7f82e41602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 --2- 172.21.15.39:0/487261465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82c80051d0 0x7f82e415e3f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 >> 172.21.15.39:0/487261465 conn(0x7f82e40b2af0 msgr2=0x7f82e40ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 shutdown_connections 2024-04-26T23:27:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.371+0000 7f82eaa00640 1 -- 172.21.15.39:0/487261465 wait complete. 2024-04-26T23:27:32.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:07.117634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:08.271295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:32.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:32.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 Processor -- start 2024-04-26T23:27:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 -- start start 2024-04-26T23:27:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8344160530 0x7f8344073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8344070200 con 0x7f834406c3d0 2024-04-26T23:27:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8344073320 con 0x7f8344160150 2024-04-26T23:27:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f834bc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8344073970 con 0x7f8344160530 2024-04-26T23:27:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f8349c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f834406c3d0 0x7f83440b53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42436/0 (socket says 172.21.15.39:42436) 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f8349c00640 1 -- 172.21.15.39:0/2711459736 learned_addr learned my addr 172.21.15.39:0/2711459736 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f833be00640 1 --2- 172.21.15.39:0/2711459736 >> v2:172.21.15.71:3300/0 conn(0x7f8344160530 0x7f8344073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080769172 0 0) 0x7f8344070200 con 0x7f834406c3d0 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8328003530 con 0x7f834406c3d0 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491220804 0 0) 0x7f8344073320 con 0x7f8344160150 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f833be00640 1 -- 172.21.15.39:0/2711459736 >> v1:172.21.15.71:6789/0 conn(0x7f8344160150 legacy=0x7f834406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f833be00640 1 -- 172.21.15.39:0/2711459736 >> v1:172.21.15.39:6789/0 conn(0x7f834406c3d0 legacy=0x7f83440b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.539+0000 7f833be00640 1 -- 172.21.15.39:0/2711459736 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8344073600 con 0x7f8344160530 2024-04-26T23:27:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f833be00640 1 --2- 172.21.15.39:0/2711459736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8344160530 0x7f8344073e00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097c0 tx=0x7f832c01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22248e01133c359c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0b0070 con 0x7f8344160530 2024-04-26T23:27:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c0ab600 con 0x7f8344160530 2024-04-26T23:27:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f8343e00640 1 -- 172.21.15.39:0/2711459736 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0ab9b0 con 0x7f8344160530 2024-04-26T23:27:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 -- 172.21.15.39:0/2711459736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8344160530 msgr2=0x7f8344073e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 --2- 172.21.15.39:0/2711459736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8344160530 0x7f8344073e00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097c0 tx=0x7f832c01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 -- 172.21.15.39:0/2711459736 shutdown_connections 2024-04-26T23:27:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 --2- 172.21.15.39:0/2711459736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8344160530 0x7f8344073e00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 -- 172.21.15.39:0/2711459736 >> 172.21.15.39:0/2711459736 conn(0x7f834406dfd0 msgr2=0x7f83440b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 -- 172.21.15.39:0/2711459736 shutdown_connections 2024-04-26T23:27:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.543+0000 7f834bc00640 1 -- 172.21.15.39:0/2711459736 wait complete. 2024-04-26T23:27:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 Processor -- start 2024-04-26T23:27:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- start start 2024-04-26T23:27:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 0x7f8344146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 0x7f83441385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8344148210 con 0x7f8344160530 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8344148090 con 0x7f834406c3d0 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8344148390 con 0x7f8344160150 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36556/0 (socket says 172.21.15.39:36556) 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 -- 172.21.15.39:0/3995748152 learned_addr learned my addr 172.21.15.39:0/3995748152 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349200640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 0x7f8344146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f833be00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 0x7f83441385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 -- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 msgr2=0x7f83441385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 0x7f83441385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 -- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 msgr2=0x7f8344146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 0x7f8344146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 -- 172.21.15.39:0/3995748152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8344161f20 con 0x7f8344160530 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f833be00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 0x7f83441385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349200640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 0x7f8344146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8349c00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f833c00cb70 tx=0x7f833c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c017070 con 0x7f8344160530 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833c00ace0 con 0x7f8344160530 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c012620 con 0x7f8344160530 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83440b1660 con 0x7f8344160530 2024-04-26T23:27:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8344144760 con 0x7f8344160530 2024-04-26T23:27:32.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.547+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834406a720 con 0x7f8344160530 2024-04-26T23:27:32.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.551+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f833c01a070 con 0x7f8344160530 2024-04-26T23:27:32.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.551+0000 7f8341600640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 0x7f832006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.551+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f833c086810 con 0x7f8344160530 2024-04-26T23:27:32.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.551+0000 7f8349200640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 0x7f832006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.551+0000 7f8349200640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 0x7f832006a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8334007fd0 tx=0x7f8334009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.555+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f833c056d60 con 0x7f8344160530 2024-04-26T23:27:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.723+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8344147e70 con 0x7f8344160530 2024-04-26T23:27:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.723+0000 7f8341600640 1 -- 172.21.15.39:0/3995748152 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f833c056660 con 0x7f8344160530 2024-04-26T23:27:32.732 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 msgr2=0x7f832006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 0x7f832006a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8334007fd0 tx=0x7f8334009040 comp rx=0 tx=0).stop 2024-04-26T23:27:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 msgr2=0x7f8344138b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f833c00cb70 tx=0x7f833c00a430 comp rx=0 tx=0).stop 2024-04-26T23:27:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 shutdown_connections 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8320068380 0x7f832006a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8344160530 0x7f8344138b10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8344160150 0x7f83441385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 --2- 172.21.15.39:0/3995748152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f834406c3d0 0x7f8344146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 >> 172.21.15.39:0/3995748152 conn(0x7f834406dfd0 msgr2=0x7f8344142360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 shutdown_connections 2024-04-26T23:27:32.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.727+0000 7f834bc00640 1 -- 172.21.15.39:0/3995748152 wait complete. 2024-04-26T23:27:32.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:27:32.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.887+0000 7f51d1800640 1 Processor -- start 2024-04-26T23:27:32.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.887+0000 7f51d1800640 1 -- start start 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51d1800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f51cc0cf940 0x7f51cc06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51d1800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc1492a0 con 0x7f51cc1488f0 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51d1800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc070840 con 0x7f51cc06d2f0 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51d1800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc06d700 con 0x7f51cc0cf940 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51caa00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f51cc1488f0 0x7f51cc0cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42448/0 (socket says 172.21.15.39:42448) 2024-04-26T23:27:32.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51caa00640 1 -- 172.21.15.39:0/3002349601 learned_addr learned my addr 172.21.15.39:0/3002349601 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:32.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51c3e00640 1 --2- 172.21.15.39:0/3002349601 >> v2:172.21.15.71:3300/0 conn(0x7f51cc0cf940 0x7f51cc06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399614587 0 0) 0x7f51cc1492a0 con 0x7f51cc1488f0 2024-04-26T23:27:32.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b0003530 con 0x7f51cc1488f0 2024-04-26T23:27:32.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782363631 0 0) 0x7f51cc070840 con 0x7f51cc06d2f0 2024-04-26T23:27:32.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51cc1492a0 con 0x7f51cc06d2f0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1198685612 0 0) 0x7f51b0003530 con 0x7f51cc1488f0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 >> v2:172.21.15.71:3300/0 conn(0x7f51cc0cf940 msgr2=0x7f51cc06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 --2- 172.21.15.39:0/3002349601 >> v2:172.21.15.71:3300/0 conn(0x7f51cc0cf940 0x7f51cc06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 >> v1:172.21.15.71:6789/0 conn(0x7f51cc06d2f0 legacy=0x7f51cc06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc06d9c0 con 0x7f51cc1488f0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f51bc001680 con 0x7f51cc1488f0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 >> v1:172.21.15.39:6789/0 conn(0x7f51cc1488f0 legacy=0x7f51cc0cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51b0003ba0 0x7f51b0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b0004810 0x7f51b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 0x7f51b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc06d700 con 0x7f51b00051d0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f51b000c0a0 con 0x7f51b0004810 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51b000c2a0 con 0x7f51b0003ba0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 0x7f51b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51caa00640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51b0003ba0 0x7f51b0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51c3e00640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b0004810 0x7f51b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 -- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51b0003ba0 msgr2=0x7f51b0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51b0003ba0 0x7f51b0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 -- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b0004810 msgr2=0x7f51b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b0004810 0x7f51b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.891+0000 7f51cb400640 1 -- 172.21.15.39:0/3002349601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0003530 con 0x7f51b00051d0 2024-04-26T23:27:32.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51cb400640 1 -- 172.21.15.39:0/3002349601 reap_dead start 2024-04-26T23:27:32.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51cb400640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 0x7f51b000b9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f51c4001fd0 tx=0x7f51c401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca68c9ca2196bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4001c20 con 0x7f51b00051d0 2024-04-26T23:27:32.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c4003b80 con 0x7f51b00051d0 2024-04-26T23:27:32.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51ca000640 1 -- 172.21.15.39:0/3002349601 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40050d0 con 0x7f51b00051d0 2024-04-26T23:27:32.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 -- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 msgr2=0x7f51b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 0x7f51b000b9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f51c4001fd0 tx=0x7f51c401c900 comp rx=0 tx=0).stop 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 -- 172.21.15.39:0/3002349601 shutdown_connections 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 --2- 172.21.15.39:0/3002349601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51b00051d0 0x7f51b000b9d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 -- 172.21.15.39:0/3002349601 >> 172.21.15.39:0/3002349601 conn(0x7f51cc0ce0e0 msgr2=0x7f51cc0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 -- 172.21.15.39:0/3002349601 shutdown_connections 2024-04-26T23:27:32.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 -- 172.21.15.39:0/3002349601 wait complete. 2024-04-26T23:27:32.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.895+0000 7f51d1800640 1 Processor -- start 2024-04-26T23:27:32.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- start start 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b00051d0 0x7f51cc1f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51cc0b4460 0x7f51cc0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc06ed90 con 0x7f51cc0728d0 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc06eab0 con 0x7f51b00051d0 2024-04-26T23:27:32.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc06f070 con 0x7f51cc0b4460 2024-04-26T23:27:32.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36574/0 (socket says 172.21.15.39:36574) 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 -- 172.21.15.39:0/2601799300 learned_addr learned my addr 172.21.15.39:0/2601799300 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51caa00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b00051d0 0x7f51cc1f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51cb400640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51cc0b4460 0x7f51cc0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 -- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51cc0b4460 msgr2=0x7f51cc0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51cc0b4460 0x7f51cc0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 -- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b00051d0 msgr2=0x7f51cc1f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b00051d0 0x7f51cc1f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 -- 172.21.15.39:0/2601799300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc1f4ea0 con 0x7f51cc0728d0 2024-04-26T23:27:32.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c3e00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51b4011590 tx=0x7f51b4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4015930 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4015ad0 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b400f460 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc1f8200 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc1f5440 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.899+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc06a720 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.903+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51b400f600 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.903+0000 7f51c2a00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 0x7f51a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.903+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f51b4087300 con 0x7f51cc0728d0 2024-04-26T23:27:32.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.903+0000 7f51caa00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 0x7f51a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:32.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.903+0000 7f51caa00640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 0x7f51a806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c10 tx=0x7f51bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:32.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:32.907+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51b4019030 con 0x7f51cc0728d0 2024-04-26T23:27:33.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51cc0d0660 con 0x7f51cc0728d0 2024-04-26T23:27:33.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51c2a00640 1 -- 172.21.15.39:0/2601799300 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f51b4057200 con 0x7f51cc0728d0 2024-04-26T23:27:33.081 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 msgr2=0x7f51a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 0x7f51a806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c10 tx=0x7f51bc009040 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 msgr2=0x7f51cc072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51b4011590 tx=0x7f51b4011a50 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 shutdown_connections 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f51a8068380 0x7f51a806a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51cc0b4460 0x7f51cc0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51cc0728d0 0x7f51cc072d50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 --2- 172.21.15.39:0/2601799300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b00051d0 0x7f51cc1f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 >> 172.21.15.39:0/2601799300 conn(0x7f51cc0ce0e0 msgr2=0x7f51cc0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 shutdown_connections 2024-04-26T23:27:33.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.075+0000 7f51d1800640 1 -- 172.21.15.39:0/2601799300 wait complete. 2024-04-26T23:27:33.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:27:33.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 Processor -- start 2024-04-26T23:27:33.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 -- start start 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07201458d0 0x7f07200b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07200ce5e0 0x7f07200cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0720072180 con 0x7f0720073400 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f07200739a0 con 0x7f07200ce5e0 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f0724a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0720073c80 con 0x7f07201458d0 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07200ce5e0 0x7f07200cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07200ce5e0 0x7f07200cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36586/0 (socket says 172.21.15.39:36586) 2024-04-26T23:27:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 -- 172.21.15.39:0/605572933 learned_addr learned my addr 172.21.15.39:0/605572933 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:33.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071de00640 1 --2- 172.21.15.39:0/605572933 >> v2:172.21.15.71:3300/0 conn(0x7f07201458d0 0x7f07200b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 -- 172.21.15.39:0/605572933 >> v2:172.21.15.71:3300/0 conn(0x7f07201458d0 msgr2=0x7f07200b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:33.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 --2- 172.21.15.39:0/605572933 >> v2:172.21.15.71:3300/0 conn(0x7f07201458d0 0x7f07200b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 -- 172.21.15.39:0/605572933 >> v1:172.21.15.71:6789/0 conn(0x7f0720073400 legacy=0x7f0720072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.243+0000 7f071e800640 1 -- 172.21.15.39:0/605572933 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720145cb0 con 0x7f07200ce5e0 2024-04-26T23:27:33.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f071e800640 1 --2- 172.21.15.39:0/605572933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07200ce5e0 0x7f07200cea70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f071800d150 tx=0x7f071801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fe5208818061de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f071ca00640 1 -- 172.21.15.39:0/605572933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071800b2d0 con 0x7f07200ce5e0 2024-04-26T23:27:33.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f071ca00640 1 -- 172.21.15.39:0/605572933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071800b470 con 0x7f07200ce5e0 2024-04-26T23:27:33.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f071ca00640 1 -- 172.21.15.39:0/605572933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180a7b60 con 0x7f07200ce5e0 2024-04-26T23:27:33.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- 172.21.15.39:0/605572933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07200ce5e0 msgr2=0x7f07200cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 --2- 172.21.15.39:0/605572933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07200ce5e0 0x7f07200cea70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f071800d150 tx=0x7f071801eb60 comp rx=0 tx=0).stop 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- 172.21.15.39:0/605572933 shutdown_connections 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 --2- 172.21.15.39:0/605572933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07200ce5e0 0x7f07200cea70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 --2- 172.21.15.39:0/605572933 >> v2:172.21.15.71:3300/0 conn(0x7f07201458d0 0x7f07200b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- 172.21.15.39:0/605572933 >> 172.21.15.39:0/605572933 conn(0x7f072006c7d0 msgr2=0x7f072006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- 172.21.15.39:0/605572933 shutdown_connections 2024-04-26T23:27:33.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- 172.21.15.39:0/605572933 wait complete. 2024-04-26T23:27:33.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 Processor -- start 2024-04-26T23:27:33.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.247+0000 7f0724a00640 1 -- start start 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07200ce5e0 0x7f0720158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07201458d0 0x7f0720142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f072006ec70 con 0x7f0720073400 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0720073230 con 0x7f07200ce5e0 2024-04-26T23:27:33.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f072006edf0 con 0x7f07201458d0 2024-04-26T23:27:33.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36596/0 (socket says 172.21.15.39:36596) 2024-04-26T23:27:33.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 -- 172.21.15.39:0/2659276840 learned_addr learned my addr 172.21.15.39:0/2659276840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:33.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071d400640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07200ce5e0 0x7f0720158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071e800640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07201458d0 0x7f0720142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 -- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07201458d0 msgr2=0x7f0720142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07201458d0 0x7f0720142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 -- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07200ce5e0 msgr2=0x7f0720158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07200ce5e0 0x7f0720158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 -- 172.21.15.39:0/2659276840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720159f50 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f071de00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f071000e8a0 tx=0x7f071000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710017070 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071000c940 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071000cd10 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072015a1f0 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072015a7b0 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072006a720 con 0x7f0720073400 2024-04-26T23:27:33.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.251+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f071001a070 con 0x7f0720073400 2024-04-26T23:27:33.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.255+0000 7f0716000640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 0x7f070006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.255+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f0710086c20 con 0x7f0720073400 2024-04-26T23:27:33.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.255+0000 7f071d400640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 0x7f070006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.255+0000 7f071d400640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 0x7f070006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0720141d00 tx=0x7f070c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.259+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0710056b20 con 0x7f0720073400 2024-04-26T23:27:33.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.419+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f07200b50b0 con 0x7f0720073400 2024-04-26T23:27:33.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0716000640 1 -- 172.21.15.39:0/2659276840 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7f071005ae20 con 0x7f0720073400 2024-04-26T23:27:33.429 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:27:33.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 msgr2=0x7f070006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 0x7f070006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0720141d00 tx=0x7f070c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 msgr2=0x7f07200aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f071000e8a0 tx=0x7f071000ed60 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 shutdown_connections 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0700068380 0x7f070006a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07201458d0 0x7f0720142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07200ce5e0 0x7f0720158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 --2- 172.21.15.39:0/2659276840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0720073400 0x7f07200aa440 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 >> 172.21.15.39:0/2659276840 conn(0x7f072006c7d0 msgr2=0x7f07200b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 shutdown_connections 2024-04-26T23:27:33.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.423+0000 7f0724a00640 1 -- 172.21.15.39:0/2659276840 wait complete. 2024-04-26T23:27:33.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:33.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.591+0000 7f152d600640 1 Processor -- start 2024-04-26T23:27:33.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.591+0000 7f152d600640 1 -- start start 2024-04-26T23:27:33.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f152815cf60 0x7f15280d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f1528160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 0x7f15280cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f15280b6220 con 0x7f152815cf60 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1528161950 con 0x7f1528161500 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152d600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f15280d1a20 con 0x7f1528160b60 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f152815cf60 0x7f15280d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f152815cf60 0x7f15280d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36602/0 (socket says 172.21.15.39:36602) 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 -- 172.21.15.39:0/1800763007 learned_addr learned my addr 172.21.15.39:0/1800763007 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152cc00640 1 --2- 172.21.15.39:0/1800763007 >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 0x7f15280cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f151f400640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f1528160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 -- 172.21.15.39:0/1800763007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 msgr2=0x7f1528160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f1528160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 -- 172.21.15.39:0/1800763007 >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 msgr2=0x7f15280cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 --2- 172.21.15.39:0/1800763007 >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 0x7f15280cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f1527e00640 1 -- 172.21.15.39:0/1800763007 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15280d1d00 con 0x7f152815cf60 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f152cc00640 1 --2- 172.21.15.39:0/1800763007 >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 0x7f15280cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.595+0000 7f151f400640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f1528160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:33.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f1527e00640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280d12d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f15280740d0 tx=0x7f151801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82ee42c7c54289a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f1527400640 1 -- 172.21.15.39:0/1800763007 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180b0070 con 0x7f152815cf60 2024-04-26T23:27:33.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f1527400640 1 -- 172.21.15.39:0/1800763007 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15180ab600 con 0x7f152815cf60 2024-04-26T23:27:33.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f1527400640 1 -- 172.21.15.39:0/1800763007 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180ab9d0 con 0x7f152815cf60 2024-04-26T23:27:33.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- 172.21.15.39:0/1800763007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 msgr2=0x7f15280d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280d12d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f15280740d0 tx=0x7f151801c490 comp rx=0 tx=0).stop 2024-04-26T23:27:33.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- 172.21.15.39:0/1800763007 shutdown_connections 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- 172.21.15.39:0/1800763007 >> v2:172.21.15.71:3300/0 conn(0x7f1528161500 0x7f15280cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f1528160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- 172.21.15.39:0/1800763007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280d12d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- 172.21.15.39:0/1800763007 >> 172.21.15.39:0/1800763007 conn(0x7f15280d2d80 msgr2=0x7f15280d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- 172.21.15.39:0/1800763007 shutdown_connections 2024-04-26T23:27:33.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- 172.21.15.39:0/1800763007 wait complete. 2024-04-26T23:27:33.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 Processor -- start 2024-04-26T23:27:33.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- start start 2024-04-26T23:27:33.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f15280b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1528161500 0x7f15281511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f15280b6830 con 0x7f152815cf60 2024-04-26T23:27:33.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15280b66b0 con 0x7f1528161500 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f152d600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f15280b69b0 con 0x7f1528160b60 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.599+0000 7f1527e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36608/0 (socket says 172.21.15.39:36608) 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 -- 172.21.15.39:0/875929103 learned_addr learned my addr 172.21.15.39:0/875929103 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f152cc00640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1528161500 0x7f15281511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f151f400640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f15280b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 -- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 msgr2=0x7f15280b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f15280b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 -- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1528161500 msgr2=0x7f15281511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1528161500 0x7f15281511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 -- 172.21.15.39:0/875929103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152806da50 con 0x7f152815cf60 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1527e00640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f151801cd30 tx=0x7f1518019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180b9070 con 0x7f152815cf60 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15180ab9b0 con 0x7f152815cf60 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180b0040 con 0x7f152815cf60 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152806dd30 con 0x7f152815cf60 2024-04-26T23:27:33.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152806e2f0 con 0x7f152815cf60 2024-04-26T23:27:33.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15280506d0 con 0x7f152815cf60 2024-04-26T23:27:33.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.603+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1518003620 con 0x7f152815cf60 2024-04-26T23:27:33.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.607+0000 7f1524c00640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 0x7f150406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.607+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f151811fbc0 con 0x7f152815cf60 2024-04-26T23:27:33.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.607+0000 7f151f400640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 0x7f150406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.607+0000 7f151f400640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 0x7f150406a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15281fb7f0 tx=0x7f1510008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.611+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1518016110 con 0x7f152815cf60 2024-04-26T23:27:33.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1528160680 con 0x7f152815cf60 2024-04-26T23:27:33.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f1524c00640 1 -- 172.21.15.39:0/875929103 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5181 (secure 0 0 0) 0x7f15180efab0 con 0x7f152815cf60 2024-04-26T23:27:33.817 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:33.817 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2535626997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2535626997},{"type":"v1","addr":"172.21.15.39:6834","nonce":2535626997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:33.818 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 22 2024-04-26T23:27:33.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 msgr2=0x7f150406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 0x7f150406a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15281fb7f0 tx=0x7f1510008040 comp rx=0 tx=0).stop 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 msgr2=0x7f15280caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f151801cd30 tx=0x7f1518019230 comp rx=0 tx=0).stop 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 shutdown_connections 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1504068380 0x7f150406a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1528161500 0x7f15281511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1528160b60 0x7f15280b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 --2- 172.21.15.39:0/875929103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f152815cf60 0x7f15280caae0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 >> 172.21.15.39:0/875929103 conn(0x7f15280d2d80 msgr2=0x7f152815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 shutdown_connections 2024-04-26T23:27:33.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.811+0000 7f152d600640 1 -- 172.21.15.39:0/875929103 wait complete. 2024-04-26T23:27:33.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.975+0000 7f5f35800640 1 Processor -- start 2024-04-26T23:27:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.975+0000 7f5f35800640 1 -- start start 2024-04-26T23:27:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f35800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5f3015f1f0 0x7f5f30073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f35800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3006eab0 con 0x7f5f3015f5d0 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f35800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f300aedf0 con 0x7f5f3006daf0 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f35800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5f300b4d70 con 0x7f5f3015f1f0 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5f3015f1f0 0x7f5f30073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f26000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5f3015f5d0 0x7f5f3006d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42460/0 (socket says 172.21.15.39:42460) 2024-04-26T23:27:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f26000640 1 -- 172.21.15.39:0/191673588 learned_addr learned my addr 172.21.15.39:0/191673588 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2ea00640 1 -- 172.21.15.39:0/191673588 >> v1:172.21.15.71:6789/0 conn(0x7f5f3006daf0 legacy=0x7f5f300b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2ea00640 1 -- 172.21.15.39:0/191673588 >> v1:172.21.15.39:6789/0 conn(0x7f5f3015f5d0 legacy=0x7f5f3006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2ea00640 1 -- 172.21.15.39:0/191673588 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f300b4720 con 0x7f5f3015f1f0 2024-04-26T23:27:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2e000640 1 -- 172.21.15.39:0/191673588 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328397081 0 0) 0x7f5f18001120 con 0x7f5f3015f5d0 2024-04-26T23:27:33.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.979+0000 7f5f2ea00640 1 --2- 172.21.15.39:0/191673588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f1f0 0x7f5f30073640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097c0 tx=0x7f5f2001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17de570c2cd0e940 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2e000640 1 -- 172.21.15.39:0/191673588 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f200b5070 con 0x7f5f3015f1f0 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2e000640 1 -- 172.21.15.39:0/191673588 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f200a8990 con 0x7f5f3015f1f0 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2e000640 1 -- 172.21.15.39:0/191673588 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f200a8d60 con 0x7f5f3015f1f0 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- 172.21.15.39:0/191673588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f1f0 msgr2=0x7f5f30073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 --2- 172.21.15.39:0/191673588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f1f0 0x7f5f30073640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097c0 tx=0x7f5f2001ec90 comp rx=0 tx=0).stop 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- 172.21.15.39:0/191673588 shutdown_connections 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 --2- 172.21.15.39:0/191673588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f1f0 0x7f5f30073640 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- 172.21.15.39:0/191673588 >> 172.21.15.39:0/191673588 conn(0x7f5f300729d0 msgr2=0x7f5f30072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- 172.21.15.39:0/191673588 shutdown_connections 2024-04-26T23:27:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- 172.21.15.39:0/191673588 wait complete. 2024-04-26T23:27:33.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 Processor -- start 2024-04-26T23:27:33.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- start start 2024-04-26T23:27:33.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f3006daf0 0x7f5f301505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3015f1f0 0x7f5f3015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5f300ae850 con 0x7f5f3015f5d0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30073b80 con 0x7f5f3006daf0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f35800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5f300ae9d0 con 0x7f5f3015f1f0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36614/0 (socket says 172.21.15.39:36614) 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 -- 172.21.15.39:0/3042061258 learned_addr learned my addr 172.21.15.39:0/3042061258 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2ea00640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f3006daf0 0x7f5f301505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f26000640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3015f1f0 0x7f5f3015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 -- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3015f1f0 msgr2=0x7f5f3015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3015f1f0 0x7f5f3015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 -- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f3006daf0 msgr2=0x7f5f301505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f3006daf0 0x7f5f301505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.983+0000 7f5f2f400640 1 -- 172.21.15.39:0/3042061258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f30160010 con 0x7f5f3015f5d0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f2f400640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c770 tx=0x7f5f2800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28003b80 con 0x7f5f3015f5d0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f28003d20 con 0x7f5f3015f5d0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f301602b0 con 0x7f5f3015f5d0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800aa90 con 0x7f5f3015f5d0 2024-04-26T23:27:33.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f30160870 con 0x7f5f3015f5d0 2024-04-26T23:27:33.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f30050740 con 0x7f5f3015f5d0 2024-04-26T23:27:33.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f2800ac30 con 0x7f5f3015f5d0 2024-04-26T23:27:33.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 0x7f5f0c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:33.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.987+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f5f28086840 con 0x7f5f3015f5d0 2024-04-26T23:27:33.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.991+0000 7f5f2ea00640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 0x7f5f0c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:33.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.991+0000 7f5f2ea00640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 0x7f5f0c06a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f200b2000 tx=0x7f5f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:33.995+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f280566b0 con 0x7f5f3015f5d0 2024-04-26T23:27:34.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.159+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f3006d7f0 con 0x7f5f3015f5d0 2024-04-26T23:27:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.159+0000 7f5f27400640 1 -- 172.21.15.39:0/3042061258 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16736 (secure 0 0 0) 0x7f5f2805a9b0 con 0x7f5f3015f5d0 2024-04-26T23:27:34.167 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:34.167 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:27.546596+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:34.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 msgr2=0x7f5f0c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 0x7f5f0c06a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f200b2000 tx=0x7f5f20008040 comp rx=0 tx=0).stop 2024-04-26T23:27:34.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 msgr2=0x7f5f3015c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c770 tx=0x7f5f2800cc30 comp rx=0 tx=0).stop 2024-04-26T23:27:34.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 shutdown_connections 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5f0c0683b0 0x7f5f0c06a870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f3015f5d0 0x7f5f3015c2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3015f1f0 0x7f5f3015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 --2- 172.21.15.39:0/3042061258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f3006daf0 0x7f5f301505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 >> 172.21.15.39:0/3042061258 conn(0x7f5f300729d0 msgr2=0x7f5f300b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 shutdown_connections 2024-04-26T23:27:34.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.163+0000 7f5f35800640 1 -- 172.21.15.39:0/3042061258 wait complete. 2024-04-26T23:27:34.189 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:27:34.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:34.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 Processor -- start 2024-04-26T23:27:34.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 -- start start 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7800145820 0x7f78000cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f78000b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7800160060 con 0x7f78000b4950 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f78000cd5c0 con 0x7f7800145820 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f7806800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7800160340 con 0x7f780006fc80 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77fea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f78000b4950 0x7f780006f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42470/0 (socket says 172.21.15.39:42470) 2024-04-26T23:27:34.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77fea00640 1 -- 172.21.15.39:0/4291318488 learned_addr learned my addr 172.21.15.39:0/4291318488 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:34.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ff400640 1 --2- 172.21.15.39:0/4291318488 >> v2:172.21.15.71:3300/0 conn(0x7f7800145820 0x7f78000cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ffe00640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f78000b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77fe000640 1 -- 172.21.15.39:0/4291318488 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840113102 0 0) 0x7f7800160060 con 0x7f78000b4950 2024-04-26T23:27:34.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77fe000640 1 -- 172.21.15.39:0/4291318488 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77e4003530 con 0x7f78000b4950 2024-04-26T23:27:34.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ff400640 1 -- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 msgr2=0x7f78000b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:34.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ff400640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f78000b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ff400640 1 -- 172.21.15.39:0/4291318488 >> v1:172.21.15.39:6789/0 conn(0x7f78000b4950 legacy=0x7f780006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.327+0000 7f77ff400640 1 -- 172.21.15.39:0/4291318488 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7800160620 con 0x7f7800145820 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f77ff400640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7800145820 0x7f78000cf2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85eee8a6f81f0a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f77fe000640 1 -- 172.21.15.39:0/4291318488 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00aa5f0 con 0x7f7800145820 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f77fe000640 1 -- 172.21.15.39:0/4291318488 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f00af070 con 0x7f7800145820 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f77fe000640 1 -- 172.21.15.39:0/4291318488 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00aa9b0 con 0x7f7800145820 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 -- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7800145820 msgr2=0x7f78000cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7800145820 0x7f78000cf2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f001c470 comp rx=0 tx=0).stop 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 -- 172.21.15.39:0/4291318488 shutdown_connections 2024-04-26T23:27:34.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f78000b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 --2- 172.21.15.39:0/4291318488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7800145820 0x7f78000cf2a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 -- 172.21.15.39:0/4291318488 >> 172.21.15.39:0/4291318488 conn(0x7f78000b2af0 msgr2=0x7f78000b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:34.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 -- 172.21.15.39:0/4291318488 shutdown_connections 2024-04-26T23:27:34.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.331+0000 7f7806800640 1 -- 172.21.15.39:0/4291318488 wait complete. 2024-04-26T23:27:34.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 Processor -- start 2024-04-26T23:27:34.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- start start 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f7800151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78000b4950 0x7f780013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f78000ce260 con 0x7f7800145820 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f780015fe40 con 0x7f78000b4950 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f78000ce3e0 con 0x7f780006fc80 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36622/0 (socket says 172.21.15.39:36622) 2024-04-26T23:27:34.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 -- 172.21.15.39:0/1025435421 learned_addr learned my addr 172.21.15.39:0/1025435421 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ff400640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f7800151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77fea00640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78000b4950 0x7f780013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 -- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 msgr2=0x7f7800151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f7800151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 -- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78000b4950 msgr2=0x7f780013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78000b4950 0x7f780013ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 -- 172.21.15.39:0/1025435421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7800151d20 con 0x7f7800145820 2024-04-26T23:27:34.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77ffe00640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77f800efc0 tx=0x7f77f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8018020 con 0x7f7800145820 2024-04-26T23:27:34.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f8014480 con 0x7f7800145820 2024-04-26T23:27:34.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7800072460 con 0x7f7800145820 2024-04-26T23:27:34.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8014870 con 0x7f7800145820 2024-04-26T23:27:34.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7800072a20 con 0x7f7800145820 2024-04-26T23:27:34.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.335+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7800072c20 con 0x7f7800145820 2024-04-26T23:27:34.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.339+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77f801b020 con 0x7f7800145820 2024-04-26T23:27:34.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.339+0000 7f77f7400640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 0x7f77e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.339+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f77f80873f0 con 0x7f7800145820 2024-04-26T23:27:34.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.339+0000 7f77ff400640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 0x7f77e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.339+0000 7f77ff400640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 0x7f77e006a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ae000 tx=0x7f77f00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.343+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7800072c20 con 0x7f7800145820 2024-04-26T23:27:34.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.547+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7800050740 con 0x7f7800145820 2024-04-26T23:27:34.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.547+0000 7f77f7400640 1 -- 172.21.15.39:0/1025435421 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5181 (secure 0 0 0) 0x7f77f8022070 con 0x7f7800145820 2024-04-26T23:27:34.556 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:34.556 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2535626997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2535626997},{"type":"v1","addr":"172.21.15.39:6834","nonce":2535626997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:34.557 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 22 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 msgr2=0x7f77e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 0x7f77e006a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ae000 tx=0x7f77f00a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 msgr2=0x7f78000b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77f800efc0 tx=0x7f77f800c490 comp rx=0 tx=0).stop 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 shutdown_connections 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f77e0068380 0x7f77e006a840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7800145820 0x7f78000b1ab0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78000b4950 0x7f780013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 --2- 172.21.15.39:0/1025435421 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f780006fc80 0x7f7800151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 >> 172.21.15.39:0/1025435421 conn(0x7f78000b2af0 msgr2=0x7f780006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:34.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 shutdown_connections 2024-04-26T23:27:34.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.551+0000 7f7806800640 1 -- 172.21.15.39:0/1025435421 wait complete. 2024-04-26T23:27:34.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.711+0000 7f08b7800640 1 Processor -- start 2024-04-26T23:27:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.711+0000 7f08b7800640 1 -- start start 2024-04-26T23:27:34.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 0x7f08b0073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b015f5d0 0x7f08b006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 0x7f08b006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f08b00b4d70 con 0x7f08b015f5d0 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f08b006eab0 con 0x7f08b015f1f0 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b7800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00aedf0 con 0x7f08b00ae850 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b015f5d0 0x7f08b006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b015f5d0 0x7f08b006d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36628/0 (socket says 172.21.15.39:36628) 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 -- 172.21.15.39:0/2720676452 learned_addr learned my addr 172.21.15.39:0/2720676452 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 -- 172.21.15.39:0/2720676452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 msgr2=0x7f08b006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b5800640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 0x7f08b006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b4e00640 1 --2- 172.21.15.39:0/2720676452 >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 0x7f08b0073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 0x7f08b006d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 -- 172.21.15.39:0/2720676452 >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 msgr2=0x7f08b0073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 --2- 172.21.15.39:0/2720676452 >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 0x7f08b0073640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08a7e00640 1 -- 172.21.15.39:0/2720676452 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00b4720 con 0x7f08b015f5d0 2024-04-26T23:27:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b4e00640 1 --2- 172.21.15.39:0/2720676452 >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 0x7f08b0073640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.715+0000 7f08b5800640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 0x7f08b006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08a7e00640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b006d3e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f08b00b7750 tx=0x7f089801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88f36d4e2784732 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08afe00640 1 -- 172.21.15.39:0/2720676452 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08980b5070 con 0x7f08b015f5d0 2024-04-26T23:27:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08afe00640 1 -- 172.21.15.39:0/2720676452 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08980a89d0 con 0x7f08b015f5d0 2024-04-26T23:27:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08afe00640 1 -- 172.21.15.39:0/2720676452 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08980a8da0 con 0x7f08b015f5d0 2024-04-26T23:27:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- 172.21.15.39:0/2720676452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 msgr2=0x7f08b006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b006d3e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f08b00b7750 tx=0x7f089801ed10 comp rx=0 tx=0).stop 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- 172.21.15.39:0/2720676452 shutdown_connections 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b00ae850 0x7f08b006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- 172.21.15.39:0/2720676452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b006d3e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- 172.21.15.39:0/2720676452 >> v2:172.21.15.71:3300/0 conn(0x7f08b015f1f0 0x7f08b0073640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- 172.21.15.39:0/2720676452 >> 172.21.15.39:0/2720676452 conn(0x7f08b00729d0 msgr2=0x7f08b0072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- 172.21.15.39:0/2720676452 shutdown_connections 2024-04-26T23:27:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- 172.21.15.39:0/2720676452 wait complete. 2024-04-26T23:27:34.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 Processor -- start 2024-04-26T23:27:34.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- start start 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08b00ae850 0x7f08b014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b015f1f0 0x7f08b00b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f08b0162f70 con 0x7f08b015f5d0 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f08b0073b80 con 0x7f08b00ae850 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b7800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f08b01630f0 con 0x7f08b015f1f0 2024-04-26T23:27:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.719+0000 7f08b5800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36638/0 (socket says 172.21.15.39:36638) 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 -- 172.21.15.39:0/1124047363 learned_addr learned my addr 172.21.15.39:0/1124047363 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08a7e00640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b015f1f0 0x7f08b00b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b4e00640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08b00ae850 0x7f08b014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 -- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b015f1f0 msgr2=0x7f08b00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b015f1f0 0x7f08b00b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 -- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08b00ae850 msgr2=0x7f08b014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08b00ae850 0x7f08b014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 -- 172.21.15.39:0/1124047363 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00d01a0 con 0x7f08b015f5d0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b5800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f08a800cef0 tx=0x7f08a800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a801a070 con 0x7f08b015f5d0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a800d840 con 0x7f08b015f5d0 2024-04-26T23:27:34.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a800dc30 con 0x7f08b015f5d0 2024-04-26T23:27:34.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b0161890 con 0x7f08b015f5d0 2024-04-26T23:27:34.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b00cf6c0 con 0x7f08b015f5d0 2024-04-26T23:27:34.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0050740 con 0x7f08b015f5d0 2024-04-26T23:27:34.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08a801d070 con 0x7f08b015f5d0 2024-04-26T23:27:34.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 0x7f088c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:34.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.723+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f08a80871c0 con 0x7f08b015f5d0 2024-04-26T23:27:34.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.727+0000 7f08b4e00640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 0x7f088c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:34.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.727+0000 7f08b4e00640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 0x7f088c06a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08b015a850 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:34.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.727+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08a80570c0 con 0x7f08b015f5d0 2024-04-26T23:27:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.927+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08b0073840 con 0x7f08b015f5d0 2024-04-26T23:27:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.927+0000 7f08ad600640 1 -- 172.21.15.39:0/1124047363 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5181 (secure 0 0 0) 0x7f08a805b3c0 con 0x7f08b015f5d0 2024-04-26T23:27:34.936 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:34.936 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2535626997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2535626997},{"type":"v1","addr":"172.21.15.39:6834","nonce":2535626997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:09.296925+0000","modified":"2024-04-26T23:27:12.315061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/2348843617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2348843617},{"type":"v1","addr":"172.21.15.39:6835","nonce":2348843617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5031,"qdb_cluster":[5031]},"id":2}]} 2024-04-26T23:27:34.936 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 22 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 msgr2=0x7f088c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 0x7f088c06a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08b015a850 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 msgr2=0x7f08b00b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f08a800cef0 tx=0x7f08a800a710 comp rx=0 tx=0).stop 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 shutdown_connections 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f088c068380 0x7f088c06a840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b015f5d0 0x7f08b00b2b10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08b015f1f0 0x7f08b00b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 --2- 172.21.15.39:0/1124047363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08b00ae850 0x7f08b014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 >> 172.21.15.39:0/1124047363 conn(0x7f08b00729d0 msgr2=0x7f08b00b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 shutdown_connections 2024-04-26T23:27:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:34.931+0000 7f08b7800640 1 -- 172.21.15.39:0/1124047363 wait complete. 2024-04-26T23:27:34.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:35.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.091+0000 7f1a15e00640 1 Processor -- start 2024-04-26T23:27:35.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.091+0000 7f1a15e00640 1 -- start start 2024-04-26T23:27:35.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.091+0000 7f1a15e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a1006cae0 0x7f1a10163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.091+0000 7f1a15e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a15e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a1015fad0 con 0x7f1a1015f6f0 2024-04-26T23:27:35.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a15e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1a100d1580 con 0x7f1a1006cae0 2024-04-26T23:27:35.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a15e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1a10164110 con 0x7f1a100d19b0 2024-04-26T23:27:35.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:48542/0 (socket says 172.21.15.39:48542) 2024-04-26T23:27:35.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 -- 172.21.15.39:0/783754279 learned_addr learned my addr 172.21.15.39:0/783754279 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:35.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a06000640 1 --2- 172.21.15.39:0/783754279 >> v2:172.21.15.71:3300/0 conn(0x7f1a1006cae0 0x7f1a10163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 -- 172.21.15.39:0/783754279 >> v2:172.21.15.71:3300/0 conn(0x7f1a1006cae0 msgr2=0x7f1a10163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 --2- 172.21.15.39:0/783754279 >> v2:172.21.15.71:3300/0 conn(0x7f1a1006cae0 0x7f1a10163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 -- 172.21.15.39:0/783754279 >> v1:172.21.15.71:6789/0 conn(0x7f1a1015f6f0 legacy=0x7f1a1006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0e000640 1 -- 172.21.15.39:0/783754279 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73852122 0 0) 0x7f1a1015fad0 con 0x7f1a1015f6f0 2024-04-26T23:27:35.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 -- 172.21.15.39:0/783754279 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100d0100 con 0x7f1a100d19b0 2024-04-26T23:27:35.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.095+0000 7f1a0f400640 1 --2- 172.21.15.39:0/783754279 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009e50 tx=0x7f1a0801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb59c185160fcd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0e000640 1 -- 172.21.15.39:0/783754279 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a58d0 con 0x7f1a100d19b0 2024-04-26T23:27:35.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0e000640 1 -- 172.21.15.39:0/783754279 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a080a5a70 con 0x7f1a100d19b0 2024-04-26T23:27:35.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0e000640 1 -- 172.21.15.39:0/783754279 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a5e40 con 0x7f1a100d19b0 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- 172.21.15.39:0/783754279 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 msgr2=0x7f1a1006f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- 172.21.15.39:0/783754279 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009e50 tx=0x7f1a0801ca00 comp rx=0 tx=0).stop 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- 172.21.15.39:0/783754279 shutdown_connections 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- 172.21.15.39:0/783754279 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a100d19b0 0x7f1a1006f290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- 172.21.15.39:0/783754279 >> v2:172.21.15.71:3300/0 conn(0x7f1a1006cae0 0x7f1a10163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- 172.21.15.39:0/783754279 >> 172.21.15.39:0/783754279 conn(0x7f1a100d1ee0 msgr2=0x7f1a100d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- 172.21.15.39:0/783754279 shutdown_connections 2024-04-26T23:27:35.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- 172.21.15.39:0/783754279 wait complete. 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 Processor -- start 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- start start 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 0x7f1a1015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 0x7f1a1015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1016c310 con 0x7f1a1015f6f0 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100cfd90 con 0x7f1a100d19b0 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a15e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1016c490 con 0x7f1a1006cae0 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 0x7f1a1015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0ea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 0x7f1a1015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:48552/0 (socket says 172.21.15.39:48552) 2024-04-26T23:27:35.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36652/0 (socket says 172.21.15.39:36652) 2024-04-26T23:27:35.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a0ea00640 1 -- 172.21.15.39:0/1466005005 learned_addr learned my addr 172.21.15.39:0/1466005005 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:35.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.099+0000 7f1a06000640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 0x7f1a1015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 -- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 msgr2=0x7f1a1015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 0x7f1a1015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 -- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 msgr2=0x7f1a1015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 0x7f1a1015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 -- 172.21.15.39:0/1466005005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1015bc70 con 0x7f1a1015f6f0 2024-04-26T23:27:35.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a06000640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 0x7f1a1015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a0f400640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006e350 tx=0x7f1a080197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a58d0 con 0x7f1a1015f6f0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a08007c30 con 0x7f1a1015f6f0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1015bf10 con 0x7f1a1015f6f0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08009510 con 0x7f1a1015f6f0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a10168240 con 0x7f1a1015f6f0 2024-04-26T23:27:35.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a10050740 con 0x7f1a1015f6f0 2024-04-26T23:27:35.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a080c0020 con 0x7f1a1015f6f0 2024-04-26T23:27:35.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 0x7f19ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.103+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7f1a081215b0 con 0x7f1a1015f6f0 2024-04-26T23:27:35.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.107+0000 7f1a0ea00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 0x7f19ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.107+0000 7f1a0ea00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 0x7f19ec06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000f70 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.107+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a080c7020 con 0x7f1a1015f6f0 2024-04-26T23:27:35.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a100afcd0 con 0x7f1a1015f6f0 2024-04-26T23:27:35.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a07e00640 1 -- 172.21.15.39:0/1466005005 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16736 (secure 0 0 0) 0x7f1a08016620 con 0x7f1a1015f6f0 2024-04-26T23:27:35.282 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:35.282 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:27.546596+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:07.117634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:08.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 msgr2=0x7f19ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 0x7f19ec06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000f70 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 msgr2=0x7f1a1015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006e350 tx=0x7f1a080197a0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 shutdown_connections 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f19ec068380 0x7f19ec06a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a1015f6f0 0x7f1a1015a4f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a100d19b0 0x7f1a1015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 --2- 172.21.15.39:0/1466005005 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a1006cae0 0x7f1a1015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 >> 172.21.15.39:0/1466005005 conn(0x7f1a100d1ee0 msgr2=0x7f1a10073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 shutdown_connections 2024-04-26T23:27:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.275+0000 7f1a15e00640 1 -- 172.21.15.39:0/1466005005 wait complete. 2024-04-26T23:27:35.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:27:35.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 Processor -- start 2024-04-26T23:27:35.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 -- start start 2024-04-26T23:27:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff96015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96006e500 con 0x7ff96015e340 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96006e7e0 con 0x7ff9600d18f0 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff968000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff96006f110 con 0x7ff960140170 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff964c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff96015e340 0x7ff9600d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42478/0 (socket says 172.21.15.39:42478) 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff964c00640 1 -- 172.21.15.39:0/1133835055 learned_addr learned my addr 172.21.15.39:0/1133835055 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff965600640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff96015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560328681 0 0) 0x7ff96006e500 con 0x7ff96015e340 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff948003530 con 0x7ff96015e340 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587345934 0 0) 0x7ff96006e7e0 con 0x7ff9600d18f0 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff96006e500 con 0x7ff9600d18f0 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2901938350 0 0) 0x7ff948003530 con 0x7ff96015e340 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 msgr2=0x7ff96015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff96015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 >> v1:172.21.15.71:6789/0 conn(0x7ff9600d18f0 legacy=0x7ff9600cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96006eac0 con 0x7ff96015e340 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7ff94c001680 con 0x7ff96015e340 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 >> v1:172.21.15.39:6789/0 conn(0x7ff96015e340 legacy=0x7ff9600d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff948003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9480040e0 0x7ff948004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff948004d50 0x7ff9480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff96006f110 con 0x7ff948004d50 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff94800bb60 con 0x7ff9480040e0 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff94800bd30 con 0x7ff960140170 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff965600640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff948003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff966000640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff948004d50 0x7ff9480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.439+0000 7ff964c00640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9480040e0 0x7ff948004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 -- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9480040e0 msgr2=0x7ff948004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9480040e0 0x7ff948004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 -- 172.21.15.39:0/1133835055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff948004d50 msgr2=0x7ff9480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff948004d50 0x7ff9480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 -- 172.21.15.39:0/1133835055 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff948003530 con 0x7ff960140170 2024-04-26T23:27:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff965600640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff948003b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ae0 tx=0x7ff95401cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65f4c23fb8536aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540b2070 con 0x7ff960140170 2024-04-26T23:27:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9540a56a0 con 0x7ff960140170 2024-04-26T23:27:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff95fe00640 1 -- 172.21.15.39:0/1133835055 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540096b0 con 0x7ff960140170 2024-04-26T23:27:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff968000640 1 -- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 msgr2=0x7ff948003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff968000640 1 --2- 172.21.15.39:0/1133835055 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff948003b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ae0 tx=0x7ff95401cab0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff966000640 1 -- 172.21.15.39:0/1133835055 reap_dead start 2024-04-26T23:27:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff968000640 1 -- 172.21.15.39:0/1133835055 shutdown_connections 2024-04-26T23:27:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.443+0000 7ff968000640 1 -- 172.21.15.39:0/1133835055 >> 172.21.15.39:0/1133835055 conn(0x7ff96006c7d0 msgr2=0x7ff96006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- 172.21.15.39:0/1133835055 shutdown_connections 2024-04-26T23:27:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- 172.21.15.39:0/1133835055 wait complete. 2024-04-26T23:27:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 Processor -- start 2024-04-26T23:27:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- start start 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff960153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff96012e320 0x7ff96012e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601619d0 con 0x7ff9600b3490 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff960161850 con 0x7ff96012e320 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff968000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff960161b50 con 0x7ff960140170 2024-04-26T23:27:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36678/0 (socket says 172.21.15.39:36678) 2024-04-26T23:27:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 -- 172.21.15.39:0/486252652 learned_addr learned my addr 172.21.15.39:0/486252652 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff965600640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff960153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff966000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff96012e320 0x7ff96012e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 -- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 msgr2=0x7ff960153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff960153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 -- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff96012e320 msgr2=0x7ff96012e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff96012e320 0x7ff96012e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 -- 172.21.15.39:0/486252652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96012ee90 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff964c00640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff94c007290 tx=0x7ff94c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.447+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00f940 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c018070 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00fd40 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96012f170 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9600b2c90 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96006a720 con 0x7ff9600b3490 2024-04-26T23:27:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff94c01d460 con 0x7ff9600b3490 2024-04-26T23:27:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff95d600640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 0x7ff94006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5795+0+0 (secure 0 0 0) 0x7ff94c086970 con 0x7ff9600b3490 2024-04-26T23:27:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.451+0000 7ff965600640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 0x7ff94006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.455+0000 7ff965600640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 0x7ff94006a870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9540af000 tx=0x7ff9540046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.455+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff94c056870 con 0x7ff9600b3490 2024-04-26T23:27:35.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.655+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff960160810 con 0x7ff9600b3490 2024-04-26T23:27:35.662 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-04-26T23:27:35.655+0000 7f6c56400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:27:35.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff95d600640 1 -- 172.21.15.39:0/486252652 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7ff94c05ab70 con 0x7ff9600b3490 2024-04-26T23:27:35.665 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:27:35.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 msgr2=0x7ff94006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 0x7ff94006a870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9540af000 tx=0x7ff9540046d0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 msgr2=0x7ff9600b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff94c007290 tx=0x7ff94c007750 comp rx=0 tx=0).stop 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 shutdown_connections 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9400683b0 0x7ff94006a870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff96012e320 0x7ff96012e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9600b3490 0x7ff9600b3910 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 --2- 172.21.15.39:0/486252652 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff960140170 0x7ff960153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 >> 172.21.15.39:0/486252652 conn(0x7ff96006c7d0 msgr2=0x7ff960073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 shutdown_connections 2024-04-26T23:27:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.659+0000 7ff968000640 1 -- 172.21.15.39:0/486252652 wait complete. 2024-04-26T23:27:35.674 INFO:tasks.ceph.mds.a.smithi039.stderr: -2757> 2024-04-26T23:27:13.876+0000 7f818f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:27:35.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:27:35.723 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:27:35.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 Processor -- start 2024-04-26T23:27:35.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 -- start start 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc6201458d0 0x7fc6200b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620073400 0x7fc620072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc620072e50 0x7fc6200ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc620072180 con 0x7fc620072e50 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc6200739a0 con 0x7fc6201458d0 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc625200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc620073c80 con 0x7fc620073400 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc620072e50 0x7fc6200ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc620072e50 0x7fc6200ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36698/0 (socket says 172.21.15.39:36698) 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 -- 172.21.15.39:0/1806292820 learned_addr learned my addr 172.21.15.39:0/1806292820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61de00640 1 --2- 172.21.15.39:0/1806292820 >> v2:172.21.15.71:3300/0 conn(0x7fc6201458d0 0x7fc6200b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc617e00640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620073400 0x7fc620072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 -- 172.21.15.39:0/1806292820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620073400 msgr2=0x7fc620072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620073400 0x7fc620072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 -- 172.21.15.39:0/1806292820 >> v2:172.21.15.71:3300/0 conn(0x7fc6201458d0 msgr2=0x7fc6200b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 --2- 172.21.15.39:0/1806292820 >> v2:172.21.15.71:3300/0 conn(0x7fc6201458d0 0x7fc6200b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.827+0000 7fc61e800640 1 -- 172.21.15.39:0/1806292820 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc620145cb0 con 0x7fc620072e50 2024-04-26T23:27:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc61e800640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620072e50 0x7fc6200ce5e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e50 tx=0x7fc61801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820deba9b7a02c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc61d400640 1 -- 172.21.15.39:0/1806292820 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6180a56f0 con 0x7fc620072e50 2024-04-26T23:27:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc61d400640 1 -- 172.21.15.39:0/1806292820 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6180a5890 con 0x7fc620072e50 2024-04-26T23:27:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc61d400640 1 -- 172.21.15.39:0/1806292820 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6180a5c60 con 0x7fc620072e50 2024-04-26T23:27:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 -- 172.21.15.39:0/1806292820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620072e50 msgr2=0x7fc6200ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620072e50 0x7fc6200ce5e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e50 tx=0x7fc61801c960 comp rx=0 tx=0).stop 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 -- 172.21.15.39:0/1806292820 shutdown_connections 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620072e50 0x7fc6200ce5e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 --2- 172.21.15.39:0/1806292820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620073400 0x7fc620072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 --2- 172.21.15.39:0/1806292820 >> v2:172.21.15.71:3300/0 conn(0x7fc6201458d0 0x7fc6200b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 -- 172.21.15.39:0/1806292820 >> 172.21.15.39:0/1806292820 conn(0x7fc62006c7d0 msgr2=0x7fc62006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 -- 172.21.15.39:0/1806292820 shutdown_connections 2024-04-26T23:27:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.831+0000 7fc625200640 1 -- 172.21.15.39:0/1806292820 wait complete. 2024-04-26T23:27:35.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 Processor -- start 2024-04-26T23:27:35.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- start start 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620072e50 0x7fc6201370e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6201458d0 0x7fc62013b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc620160760 con 0x7fc620073400 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6201605e0 con 0x7fc6201458d0 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc6201608e0 con 0x7fc620072e50 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36704/0 (socket says 172.21.15.39:36704) 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 -- 172.21.15.39:0/1553628218 learned_addr learned my addr 172.21.15.39:0/1553628218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc61de00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620072e50 0x7fc6201370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc61e800640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6201458d0 0x7fc62013b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 -- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620072e50 msgr2=0x7fc6201370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620072e50 0x7fc6201370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 -- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6201458d0 msgr2=0x7fc62013b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6201458d0 0x7fc62013b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 -- 172.21.15.39:0/1553628218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62015ec50 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc617e00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc60800d800 tx=0x7fc60800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608018020 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6080096a0 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608009a50 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62015eef0 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.835+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62015f4b0 con 0x7fc620073400 2024-04-26T23:27:35.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62006a720 con 0x7fc620073400 2024-04-26T23:27:35.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc60801b020 con 0x7fc620073400 2024-04-26T23:27:35.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc616000640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 0x7fc5fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:35.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5881+0+0 (secure 0 0 0) 0x7fc608086e20 con 0x7fc620073400 2024-04-26T23:27:35.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc61de00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 0x7fc5fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:35.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.839+0000 7fc61de00640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 0x7fc5fc06a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6100079c0 tx=0x7fc610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:35.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:35.843+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc608022020 con 0x7fc620073400 2024-04-26T23:27:36.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.043+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6200b50b0 con 0x7fc620073400 2024-04-26T23:27:36.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.663+0000 7fc616000640 1 -- 172.21.15.39:0/1553628218 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7fc608056d50 con 0x7fc620073400 2024-04-26T23:27:36.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 msgr2=0x7fc5fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 0x7fc5fc06a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6100079c0 tx=0x7fc610008040 comp rx=0 tx=0).stop 2024-04-26T23:27:36.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 msgr2=0x7fc62015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc60800d800 tx=0x7fc60800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 shutdown_connections 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc5fc068380 0x7fc5fc06a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6201458d0 0x7fc62013b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc620073400 0x7fc62015e710 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 --2- 172.21.15.39:0/1553628218 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc620072e50 0x7fc6201370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 >> 172.21.15.39:0/1553628218 conn(0x7fc62006c7d0 msgr2=0x7fc62013d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 shutdown_connections 2024-04-26T23:27:36.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.667+0000 7fc625200640 1 -- 172.21.15.39:0/1553628218 wait complete. 2024-04-26T23:27:36.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:27:36.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.871+0000 7f48da400640 1 Processor -- start 2024-04-26T23:27:36.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 -- start start 2024-04-26T23:27:36.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f48d41468a0 0x7f48d4074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48d40b3df0 0x7f48d40b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d40b4280 con 0x7f48d4160cc0 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f48d406edd0 con 0x7f48d40b3df0 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48da400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f48d4072620 con 0x7f48d41468a0 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48d3e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f48d4160cc0 0x7f48d4072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42480/0 (socket says 172.21.15.39:42480) 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48d3e00640 1 -- 172.21.15.39:0/3027623982 learned_addr learned my addr 172.21.15.39:0/3027623982 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:36.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48caa00640 1 --2- 172.21.15.39:0/3027623982 >> v2:172.21.15.39:3300/0 conn(0x7f48d40b3df0 0x7f48d40b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48d3400640 1 --2- 172.21.15.39:0/3027623982 >> v2:172.21.15.71:3300/0 conn(0x7f48d41468a0 0x7f48d4074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48caa00640 1 -- 172.21.15.39:0/3027623982 >> v2:172.21.15.71:3300/0 conn(0x7f48d41468a0 msgr2=0x7f48d4074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48caa00640 1 --2- 172.21.15.39:0/3027623982 >> v2:172.21.15.71:3300/0 conn(0x7f48d41468a0 0x7f48d4074180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48caa00640 1 -- 172.21.15.39:0/3027623982 >> v1:172.21.15.39:6789/0 conn(0x7f48d4160cc0 legacy=0x7f48d4072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48caa00640 1 -- 172.21.15.39:0/3027623982 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d406f020 con 0x7f48d40b3df0 2024-04-26T23:27:36.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.875+0000 7f48d2a00640 1 -- 172.21.15.39:0/3027623982 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270582940 0 0) 0x7f48d40b4280 con 0x7f48d4160cc0 2024-04-26T23:27:36.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48caa00640 1 --2- 172.21.15.39:0/3027623982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40b3df0 0x7f48d40b5970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f48d40d0c80 tx=0x7f48bc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e757f8ef63d4432b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:36.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48d2a00640 1 -- 172.21.15.39:0/3027623982 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0b0070 con 0x7f48d40b3df0 2024-04-26T23:27:36.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48d2a00640 1 -- 172.21.15.39:0/3027623982 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc0ab600 con 0x7f48d40b3df0 2024-04-26T23:27:36.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48d2a00640 1 -- 172.21.15.39:0/3027623982 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0ab9d0 con 0x7f48d40b3df0 2024-04-26T23:27:36.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- 172.21.15.39:0/3027623982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40b3df0 msgr2=0x7f48d40b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 --2- 172.21.15.39:0/3027623982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40b3df0 0x7f48d40b5970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f48d40d0c80 tx=0x7f48bc01c360 comp rx=0 tx=0).stop 2024-04-26T23:27:36.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- 172.21.15.39:0/3027623982 shutdown_connections 2024-04-26T23:27:36.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 --2- 172.21.15.39:0/3027623982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40b3df0 0x7f48d40b5970 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 --2- 172.21.15.39:0/3027623982 >> v2:172.21.15.71:3300/0 conn(0x7f48d41468a0 0x7f48d4074180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- 172.21.15.39:0/3027623982 >> 172.21.15.39:0/3027623982 conn(0x7f48d40b2cc0 msgr2=0x7f48d40b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:36.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- 172.21.15.39:0/3027623982 shutdown_connections 2024-04-26T23:27:36.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- 172.21.15.39:0/3027623982 wait complete. 2024-04-26T23:27:36.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 Processor -- start 2024-04-26T23:27:36.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.879+0000 7f48da400640 1 -- start start 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48d41468a0 0x7f48d41595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 0x7f48d40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48d40735d0 con 0x7f48d40d03f0 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4146c80 con 0x7f48d4160cc0 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f48d4073750 con 0x7f48d41468a0 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36726/0 (socket says 172.21.15.39:36726) 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 -- 172.21.15.39:0/1764077480 learned_addr learned my addr 172.21.15.39:0/1764077480 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:36.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48caa00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 0x7f48d40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48d41468a0 0x7f48d41595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 -- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48d41468a0 msgr2=0x7f48d41595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48d41468a0 0x7f48d41595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 -- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 msgr2=0x7f48d40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 0x7f48d40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 -- 172.21.15.39:0/1764077480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40cfc00 con 0x7f48d40d03f0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48caa00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 0x7f48d40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48d3e00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00c7a0 tx=0x7f48cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc018070 con 0x7f48d40d03f0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc00a640 con 0x7f48d40d03f0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00aab0 con 0x7f48d40d03f0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d4159bd0 con 0x7f48d40d03f0 2024-04-26T23:27:36.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d40ceec0 con 0x7f48d40d03f0 2024-04-26T23:27:36.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4050740 con 0x7f48d40d03f0 2024-04-26T23:27:36.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.883+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48cc00ac50 con 0x7f48d40d03f0 2024-04-26T23:27:36.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.887+0000 7f48cbe00640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:36.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.887+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5881+0+0 (secure 0 0 0) 0x7f48cc086150 con 0x7f48d40d03f0 2024-04-26T23:27:36.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.887+0000 7f48d3400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:36.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.887+0000 7f48d3400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 0x7f48b006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48c40096f0 tx=0x7f48c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:36.891+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f48cc0565c0 con 0x7f48d40d03f0 2024-04-26T23:27:37.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.059+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48d406ffa0 con 0x7f48d40d03f0 2024-04-26T23:27:37.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.671+0000 7f48cbe00640 1 -- 172.21.15.39:0/1764077480 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f48cc055ec0 con 0x7f48d40d03f0 2024-04-26T23:27:37.678 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:27:37.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 msgr2=0x7f48b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 0x7f48b006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48c40096f0 tx=0x7f48c4008040 comp rx=0 tx=0).stop 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 msgr2=0x7f48d413cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00c7a0 tx=0x7f48cc00cc60 comp rx=0 tx=0).stop 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 shutdown_connections 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40d03f0 0x7f48d413cec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d4160cc0 0x7f48d40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 --2- 172.21.15.39:0/1764077480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48d41468a0 0x7f48d41595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 >> 172.21.15.39:0/1764077480 conn(0x7f48d40b2cc0 msgr2=0x7f48d4072ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 shutdown_connections 2024-04-26T23:27:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.675+0000 7f48da400640 1 -- 172.21.15.39:0/1764077480 wait complete. 2024-04-26T23:27:37.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:27:37.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 Processor -- start 2024-04-26T23:27:37.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 -- start start 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ce8145870 0x7f5ce80cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce80cfd30 con 0x7f5ce815fa90 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce806fe70 con 0x7f5ce8145870 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ced000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce8073d00 con 0x7f5ce806f4d0 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ce8145870 0x7f5ce80cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:37.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ce8145870 0x7f5ce80cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36734/0 (socket says 172.21.15.39:36734) 2024-04-26T23:27:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 -- 172.21.15.39:0/2577276587 learned_addr learned my addr 172.21.15.39:0/2577276587 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 -- 172.21.15.39:0/2577276587 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 msgr2=0x7f5ce806f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 --2- 172.21.15.39:0/2577276587 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 -- 172.21.15.39:0/2577276587 >> v1:172.21.15.71:6789/0 conn(0x7f5ce815fa90 legacy=0x7f5ce815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.847+0000 7f5ce5e00640 1 -- 172.21.15.39:0/2577276587 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce80d0010 con 0x7f5ce8145870 2024-04-26T23:27:37.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ce5e00640 1 --2- 172.21.15.39:0/2577276587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce8145870 0x7f5ce80cf300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d58fef166309c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ce5400640 1 -- 172.21.15.39:0/2577276587 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80a6040 con 0x7f5ce8145870 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ce5400640 1 -- 172.21.15.39:0/2577276587 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd80af070 con 0x7f5ce8145870 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ce5400640 1 -- 172.21.15.39:0/2577276587 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80aa860 con 0x7f5ce8145870 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 -- 172.21.15.39:0/2577276587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce8145870 msgr2=0x7f5ce80cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 --2- 172.21.15.39:0/2577276587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce8145870 0x7f5ce80cf300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd801c520 comp rx=0 tx=0).stop 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 -- 172.21.15.39:0/2577276587 shutdown_connections 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 --2- 172.21.15.39:0/2577276587 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 --2- 172.21.15.39:0/2577276587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce8145870 0x7f5ce80cf300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 -- 172.21.15.39:0/2577276587 >> 172.21.15.39:0/2577276587 conn(0x7f5ce80b2cc0 msgr2=0x7f5ce80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:37.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 -- 172.21.15.39:0/2577276587 shutdown_connections 2024-04-26T23:27:37.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.851+0000 7f5ced000640 1 -- 172.21.15.39:0/2577276587 wait complete. 2024-04-26T23:27:37.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 Processor -- start 2024-04-26T23:27:37.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- start start 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce8145870 0x7f5ce8159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80cf9c0 con 0x7f5ce815fa90 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80cf840 con 0x7f5ce8145870 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce815d590 con 0x7f5ce806f4d0 2024-04-26T23:27:37.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36736/0 (socket says 172.21.15.39:36736) 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 -- 172.21.15.39:0/3375351997 learned_addr learned my addr 172.21.15.39:0/3375351997 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5cdfe00640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce8145870 0x7f5ce8159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 -- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 msgr2=0x7f5ce813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce813da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 -- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce8145870 msgr2=0x7f5ce8159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce8145870 0x7f5ce8159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 -- 172.21.15.39:0/3375351997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce81580b0 con 0x7f5ce815fa90 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ce6800640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000b990 tx=0x7f5ce000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0019070 con 0x7f5ce815fa90 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce000cba0 con 0x7f5ce815fa90 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce8158390 con 0x7f5ce815fa90 2024-04-26T23:27:37.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0014440 con 0x7f5ce815fa90 2024-04-26T23:27:37.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce8158950 con 0x7f5ce815fa90 2024-04-26T23:27:37.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.855+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce8050740 con 0x7f5ce815fa90 2024-04-26T23:27:37.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.859+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ce001c070 con 0x7f5ce815fa90 2024-04-26T23:27:37.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.859+0000 7f5cde000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 0x7f5cc406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:37.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.859+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5443+0+0 (secure 0 0 0) 0x7f5ce0086500 con 0x7f5ce815fa90 2024-04-26T23:27:37.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.859+0000 7f5ce5e00640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 0x7f5cc406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:37.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.859+0000 7f5ce5e00640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 0x7f5cc406a870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ae000 tx=0x7f5cd80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:37.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:37.863+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5ce0056560 con 0x7f5ce815fa90 2024-04-26T23:27:38.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.027+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ce80b6ce0 con 0x7f5ce815fa90 2024-04-26T23:27:38.545 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:27:38.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:27:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.675+0000 7f5cde000640 1 -- 172.21.15.39:0/3375351997 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f5ce005a860 con 0x7f5ce815fa90 2024-04-26T23:27:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-04-26T23:27:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 msgr2=0x7f5cc406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 0x7f5cc406a870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ae000 tx=0x7f5cd80a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 msgr2=0x7f5ce8140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000b990 tx=0x7f5ce000be50 comp rx=0 tx=0).stop 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 shutdown_connections 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5cc40683b0 0x7f5cc406a870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ce815fa90 0x7f5ce8140210 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce8145870 0x7f5ce8159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 --2- 172.21.15.39:0/3375351997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ce806f4d0 0x7f5ce813da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 >> 172.21.15.39:0/3375351997 conn(0x7f5ce80b2cc0 msgr2=0x7f5ce813ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 shutdown_connections 2024-04-26T23:27:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.679+0000 7f5ced000640 1 -- 172.21.15.39:0/3375351997 wait complete. 2024-04-26T23:27:38.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:27:38.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 Processor -- start 2024-04-26T23:27:38.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 -- start start 2024-04-26T23:27:38.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94180b41f0 0x7f94180b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418072cf0 con 0x7f94180d11e0 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9418072fd0 con 0x7f94180b41f0 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f94180732b0 con 0x7f941806f2b0 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:48638/0 (socket says 172.21.15.39:48638) 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 -- 172.21.15.39:0/872071846 learned_addr learned my addr 172.21.15.39:0/872071846 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f941cc00640 1 --2- 172.21.15.39:0/872071846 >> v2:172.21.15.71:3300/0 conn(0x7f94180b41f0 0x7f94180b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f9417e00640 1 --1- 172.21.15.39:0/872071846 >> v1:172.21.15.71:6789/0 conn(0x7f94180d11e0 0x7f94180d15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:34180/0 (socket says 172.21.15.39:34180) 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 -- 172.21.15.39:0/872071846 >> v2:172.21.15.71:3300/0 conn(0x7f94180b41f0 msgr2=0x7f94180b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 --2- 172.21.15.39:0/872071846 >> v2:172.21.15.71:3300/0 conn(0x7f94180b41f0 0x7f94180b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 -- 172.21.15.39:0/872071846 >> v1:172.21.15.71:6789/0 conn(0x7f94180d11e0 legacy=0x7f94180d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f9417400640 1 -- 172.21.15.39:0/872071846 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370951758 0 0) 0x7f9418072cf0 con 0x7f94180d11e0 2024-04-26T23:27:38.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.847+0000 7f940f400640 1 -- 172.21.15.39:0/872071846 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418073590 con 0x7f941806f2b0 2024-04-26T23:27:38.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f940f400640 1 --2- 172.21.15.39:0/872071846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9400009870 tx=0x7f940001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa31f534c2ed7a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:38.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f9417400640 1 -- 172.21.15.39:0/872071846 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000ab660 con 0x7f941806f2b0 2024-04-26T23:27:38.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f9417400640 1 -- 172.21.15.39:0/872071846 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94000b0070 con 0x7f941806f2b0 2024-04-26T23:27:38.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f9417400640 1 -- 172.21.15.39:0/872071846 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000aba20 con 0x7f941806f2b0 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 -- 172.21.15.39:0/872071846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 msgr2=0x7f94180723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 --2- 172.21.15.39:0/872071846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9400009870 tx=0x7f940001c440 comp rx=0 tx=0).stop 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 -- 172.21.15.39:0/872071846 shutdown_connections 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 --2- 172.21.15.39:0/872071846 >> v2:172.21.15.71:3300/0 conn(0x7f94180b41f0 0x7f94180b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 --2- 172.21.15.39:0/872071846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f94180723c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 -- 172.21.15.39:0/872071846 >> 172.21.15.39:0/872071846 conn(0x7f941806c7d0 msgr2=0x7f941806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 -- 172.21.15.39:0/872071846 shutdown_connections 2024-04-26T23:27:38.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.851+0000 7f941ec00640 1 -- 172.21.15.39:0/872071846 wait complete. 2024-04-26T23:27:38.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 Processor -- start 2024-04-26T23:27:38.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- start start 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180d11e0 0x7f941814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f941816c1c0 con 0x7f94180b41f0 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9418162c00 con 0x7f94180d11e0 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f941816c340 con 0x7f941806f2b0 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f940f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:48644/0 (socket says 172.21.15.39:48644) 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f940f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36748/0 (socket says 172.21.15.39:36748) 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 -- 172.21.15.39:0/2997931827 learned_addr learned my addr 172.21.15.39:0/2997931827 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:38.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941cc00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180d11e0 0x7f941814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 -- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180d11e0 msgr2=0x7f941814f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180d11e0 0x7f941814f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 -- 172.21.15.39:0/2997931827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 msgr2=0x7f941814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 -- 172.21.15.39:0/2997931827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941814ae20 con 0x7f941806f2b0 2024-04-26T23:27:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f940f400640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9417e00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f940800c520 tx=0x7f940800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408018070 con 0x7f941806f2b0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94080074e0 con 0x7f941806f2b0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94080049f0 con 0x7f941806f2b0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941814b100 con 0x7f941806f2b0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.855+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f941814b6c0 con 0x7f941806f2b0 2024-04-26T23:27:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941806a720 con 0x7f941806f2b0 2024-04-26T23:27:38.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9408004b90 con 0x7f941806f2b0 2024-04-26T23:27:38.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f9414c00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 0x7f93f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:38.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7f9408085b60 con 0x7f941806f2b0 2024-04-26T23:27:38.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f940f400640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 0x7f93f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:38.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.859+0000 7f940f400640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 0x7f93f406a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94000af000 tx=0x7f94000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:38.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:38.863+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9408055c40 con 0x7f941806f2b0 2024-04-26T23:27:39.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.039+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f94180ae8b0 con 0x7f941806f2b0 2024-04-26T23:27:39.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f9414c00640 1 -- 172.21.15.39:0/2997931827 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f9408059f40 con 0x7f941806f2b0 2024-04-26T23:27:39.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 msgr2=0x7f93f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 0x7f93f406a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94000af000 tx=0x7f94000a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:39.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 msgr2=0x7f941814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f940800c520 tx=0x7f940800c9e0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 shutdown_connections 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f93f40683b0 0x7f93f406a870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180d11e0 0x7f941814f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94180b41f0 0x7f941814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 --2- 172.21.15.39:0/2997931827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f941806f2b0 0x7f941814a720 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 >> 172.21.15.39:0/2997931827 conn(0x7f941806c7d0 msgr2=0x7f941815bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 shutdown_connections 2024-04-26T23:27:39.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.047+0000 7f941ec00640 1 -- 172.21.15.39:0/2997931827 wait complete. 2024-04-26T23:27:39.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-04-26T23:27:39.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 Processor -- start 2024-04-26T23:27:39.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 -- start start 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbe8415f340 0x7fbe840d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 0x7fbe8409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840cd810 con 0x7fbe8415f720 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbe840d26a0 con 0x7fbe8415f340 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8c200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840ce140 con 0x7fbe840b5710 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8a200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbe8415f720 0x7fbe840b82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42494/0 (socket says 172.21.15.39:42494) 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe8a200640 1 -- 172.21.15.39:0/1540034151 learned_addr learned my addr 172.21.15.39:0/1540034151 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:39.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe88e00640 1 --2- 172.21.15.39:0/1540034151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 0x7fbe8409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe89800640 1 --2- 172.21.15.39:0/1540034151 >> v2:172.21.15.71:3300/0 conn(0x7fbe8415f340 0x7fbe840d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe83e00640 1 -- 172.21.15.39:0/1540034151 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300318644 0 0) 0x7fbe840cd810 con 0x7fbe8415f720 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe83e00640 1 -- 172.21.15.39:0/1540034151 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe6c003530 con 0x7fbe8415f720 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe88e00640 1 -- 172.21.15.39:0/1540034151 >> v2:172.21.15.71:3300/0 conn(0x7fbe8415f340 msgr2=0x7fbe840d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe88e00640 1 --2- 172.21.15.39:0/1540034151 >> v2:172.21.15.71:3300/0 conn(0x7fbe8415f340 0x7fbe840d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe88e00640 1 -- 172.21.15.39:0/1540034151 >> v1:172.21.15.39:6789/0 conn(0x7fbe8415f720 legacy=0x7fbe840b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.211+0000 7fbe88e00640 1 -- 172.21.15.39:0/1540034151 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840cdaf0 con 0x7fbe840b5710 2024-04-26T23:27:39.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe88e00640 1 --2- 172.21.15.39:0/1540034151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 0x7fbe8409b9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097c0 tx=0x7fbe7001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e02a8cb093d68c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe83e00640 1 -- 172.21.15.39:0/1540034151 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700b0070 con 0x7fbe840b5710 2024-04-26T23:27:39.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe83e00640 1 -- 172.21.15.39:0/1540034151 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe700ab600 con 0x7fbe840b5710 2024-04-26T23:27:39.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe83e00640 1 -- 172.21.15.39:0/1540034151 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700ab9d0 con 0x7fbe840b5710 2024-04-26T23:27:39.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 -- 172.21.15.39:0/1540034151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 msgr2=0x7fbe8409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 --2- 172.21.15.39:0/1540034151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 0x7fbe8409b9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097c0 tx=0x7fbe7001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 -- 172.21.15.39:0/1540034151 shutdown_connections 2024-04-26T23:27:39.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 --2- 172.21.15.39:0/1540034151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe840b5710 0x7fbe8409b9e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 --2- 172.21.15.39:0/1540034151 >> v2:172.21.15.71:3300/0 conn(0x7fbe8415f340 0x7fbe840d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 -- 172.21.15.39:0/1540034151 >> 172.21.15.39:0/1540034151 conn(0x7fbe840b4b80 msgr2=0x7fbe840b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:39.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 -- 172.21.15.39:0/1540034151 shutdown_connections 2024-04-26T23:27:39.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.215+0000 7fbe8c200640 1 -- 172.21.15.39:0/1540034151 wait complete. 2024-04-26T23:27:39.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 Processor -- start 2024-04-26T23:27:39.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- start start 2024-04-26T23:27:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe840b5710 0x7fbe84158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe8415f720 0x7fbe840c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840b8f40 con 0x7fbe8415f340 2024-04-26T23:27:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840b8dc0 con 0x7fbe840b5710 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840cedc0 con 0x7fbe8415f720 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36758/0 (socket says 172.21.15.39:36758) 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 -- 172.21.15.39:0/2891584182 learned_addr learned my addr 172.21.15.39:0/2891584182 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8a200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe8415f720 0x7fbe840c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe89800640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe840b5710 0x7fbe84158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 -- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe8415f720 msgr2=0x7fbe840c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe8415f720 0x7fbe840c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 -- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe840b5710 msgr2=0x7fbe84158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe840b5710 0x7fbe84158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 -- 172.21.15.39:0/2891584182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840c7960 con 0x7fbe8415f340 2024-04-26T23:27:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe88e00640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe7001a010 tx=0x7fbe70019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700b8020 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe700b4410 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700b0040 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe841f8e70 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.219+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841f9430 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe84050740 con 0x7fbe8415f340 2024-04-26T23:27:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe700bb020 con 0x7fbe8415f340 2024-04-26T23:27:39.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe81600640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 0x7fbe6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7fbe701201c0 con 0x7fbe8415f340 2024-04-26T23:27:39.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe89800640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 0x7fbe6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.223+0000 7fbe89800640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 0x7fbe6406a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe840d2950 tx=0x7fbe78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.227+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe700c2030 con 0x7fbe8415f340 2024-04-26T23:27:39.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.451+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) -- 0x7fbe8409c540 con 0x7fbe8415f340 2024-04-26T23:27:39.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe81600640 1 -- 172.21.15.39:0/2891584182 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v108) ==== 135+0+0 (secure 0 0 0) 0x7fbe70016090 con 0x7fbe8415f340 2024-04-26T23:27:39.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 msgr2=0x7fbe6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 0x7fbe6406a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe840d2950 tx=0x7fbe78008040 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 msgr2=0x7fbe841f8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe7001a010 tx=0x7fbe70019180 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 shutdown_connections 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbe64068380 0x7fbe6406a840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe8415f720 0x7fbe840c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8415f340 0x7fbe841f8730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 --2- 172.21.15.39:0/2891584182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe840b5710 0x7fbe84158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 >> 172.21.15.39:0/2891584182 conn(0x7fbe840b4b80 msgr2=0x7fbe840d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 shutdown_connections 2024-04-26T23:27:39.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.691+0000 7fbe8c200640 1 -- 172.21.15.39:0/2891584182 wait complete. 2024-04-26T23:27:39.718 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2024-04-26T23:27:39.718 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2024-04-26T23:27:39.718 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:27:39.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.851+0000 7f5bb0800640 1 Processor -- start 2024-04-26T23:27:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.851+0000 7f5bb0800640 1 -- start start 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bb0800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ba80b3df0 0x7f5ba80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bb0800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba815fe20 con 0x7f5ba80b5e00 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bb0800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba8160380 con 0x7f5ba813f000 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bb0800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba806eba0 con 0x7f5ba80b3df0 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bae800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5ba80b5e00 0x7f5ba806f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42510/0 (socket says 172.21.15.39:42510) 2024-04-26T23:27:39.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bae800640 1 -- 172.21.15.39:0/2815072296 learned_addr learned my addr 172.21.15.39:0/2815072296 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 --2- 172.21.15.39:0/2815072296 >> v2:172.21.15.71:3300/0 conn(0x7f5ba80b3df0 0x7f5ba80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235298666 0 0) 0x7f5ba40014a0 con 0x7f5ba80b5e00 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b90003530 con 0x7f5ba80b5e00 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 345619818 0 0) 0x7f5b90003530 con 0x7f5ba80b5e00 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 >> v2:172.21.15.71:3300/0 conn(0x7f5ba80b3df0 msgr2=0x7f5ba80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:39.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 --2- 172.21.15.39:0/2815072296 >> v2:172.21.15.71:3300/0 conn(0x7f5ba80b3df0 0x7f5ba80ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 >> v1:172.21.15.71:6789/0 conn(0x7f5ba813f000 legacy=0x7f5ba80b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba815f1d0 con 0x7f5ba80b5e00 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f5ba4001bd0 con 0x7f5ba80b5e00 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 >> v1:172.21.15.39:6789/0 conn(0x7f5ba80b5e00 legacy=0x7f5ba806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5b90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b900043c0 0x7f5b90004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b90005130 0x7f5b9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba806eba0 con 0x7f5b900043c0 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9000c070 con 0x7f5b900039c0 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9000e480 con 0x7f5b90005130 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5b90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bad400640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b900043c0 0x7f5b90004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bae800640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b90005130 0x7f5b9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 -- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b90005130 msgr2=0x7f5b9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:39.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b90005130 0x7f5b9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 -- 172.21.15.39:0/2815072296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b900043c0 msgr2=0x7f5b90004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:39.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b900043c0 0x7f5b90004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bade00640 1 -- 172.21.15.39:0/2815072296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b90003530 con 0x7f5b900039c0 2024-04-26T23:27:39.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bad400640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b900043c0 0x7f5b90004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:39.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.855+0000 7f5bae800640 1 -- 172.21.15.39:0/2815072296 reap_dead start 2024-04-26T23:27:39.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bade00640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5b90003da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00aa60 tx=0x7f5b9c01cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6c4dec633260ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0b2070 con 0x7f5b900039c0 2024-04-26T23:27:39.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c0a5c70 con 0x7f5b900039c0 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5baca00640 1 -- 172.21.15.39:0/2815072296 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00b040 con 0x7f5b900039c0 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 -- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 msgr2=0x7f5b90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5b90003da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00aa60 tx=0x7f5b9c01cc30 comp rx=0 tx=0).stop 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 -- 172.21.15.39:0/2815072296 shutdown_connections 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 --2- 172.21.15.39:0/2815072296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5b90003da0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 -- 172.21.15.39:0/2815072296 >> 172.21.15.39:0/2815072296 conn(0x7f5ba80b2af0 msgr2=0x7f5ba80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 -- 172.21.15.39:0/2815072296 shutdown_connections 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.859+0000 7f5bb0800640 1 -- 172.21.15.39:0/2815072296 wait complete. 2024-04-26T23:27:39.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 Processor -- start 2024-04-26T23:27:39.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- start start 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5ba80d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ba8074000 0x7f5ba8140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba806e830 con 0x7f5ba8073ba0 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba806e590 con 0x7f5b900039c0 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba80b6270 con 0x7f5ba8074000 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36772/0 (socket says 172.21.15.39:36772) 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 -- 172.21.15.39:0/1380654690 learned_addr learned my addr 172.21.15.39:0/1380654690 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bade00640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5ba80d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bae800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ba8074000 0x7f5ba8140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 -- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ba8074000 msgr2=0x7f5ba8140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ba8074000 0x7f5ba8140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 -- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 msgr2=0x7f5ba80d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5ba80d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 -- 172.21.15.39:0/1380654690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba80745d0 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bad400640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b98011ca0 tx=0x7f5b9800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98019020 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9800fc30 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98001460 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba81f5230 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba81f57f0 con 0x7f5ba8073ba0 2024-04-26T23:27:39.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.863+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba8050740 con 0x7f5ba8073ba0 2024-04-26T23:27:39.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.867+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b9801c020 con 0x7f5ba8073ba0 2024-04-26T23:27:39.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.867+0000 7f5ba2000640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 0x7f5b8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:39.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.867+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7f5b98089ca0 con 0x7f5ba8073ba0 2024-04-26T23:27:39.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.867+0000 7f5bade00640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 0x7f5b8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:39.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.867+0000 7f5bade00640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 0x7f5b8c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0af000 tx=0x7f5b9c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:39.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:39.871+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b98023020 con 0x7f5ba8073ba0 2024-04-26T23:27:40.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.039+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ba80cd5f0 con 0x7f5ba8073ba0 2024-04-26T23:27:40.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.039+0000 7f5ba2000640 1 -- 172.21.15.39:0/1380654690 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13088 (secure 0 0 0) 0x7f5b98059e10 con 0x7f5ba8073ba0 2024-04-26T23:27:40.050 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:40.050 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":43,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:38.676937+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6835/2348843617":"2024-04-27T23:27:35.661931+0000","172.21.15.39:6833/2348843617":"2024-04-27T23:27:35.661931+0000","172.21.15.39:6834/427434532":"2024-04-27T23:27:24.528653+0000","172.21.15.39:6832/427434532":"2024-04-27T23:27:24.528653+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:40.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 msgr2=0x7f5b8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 0x7f5b8c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0af000 tx=0x7f5b9c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 msgr2=0x7f5ba8140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b98011ca0 tx=0x7f5b9800f5a0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 shutdown_connections 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5b8c068380 0x7f5b8c06a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ba8074000 0x7f5ba8140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ba8073ba0 0x7f5ba8140900 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 --2- 172.21.15.39:0/1380654690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b900039c0 0x7f5ba80d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 >> 172.21.15.39:0/1380654690 conn(0x7f5ba80b2af0 msgr2=0x7f5ba80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 shutdown_connections 2024-04-26T23:27:40.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.043+0000 7f5bb0800640 1 -- 172.21.15.39:0/1380654690 wait complete. 2024-04-26T23:27:40.069 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:40.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:40.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.203+0000 7fc417000640 1 Processor -- start 2024-04-26T23:27:40.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.203+0000 7fc417000640 1 -- start start 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc417000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc41015b7e0 0x7fc4100cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc417000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc4100d1670 0x7fc410072b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc417000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4100b5ab0 con 0x7fc4100d11e0 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc417000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc4100b5d90 con 0x7fc4100d1670 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc417000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc41006e500 con 0x7fc41015b7e0 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc415000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc4100d1670 0x7fc410072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc407e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc4100d11e0 0x7fc4100b5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49574/0 (socket says 172.21.15.39:49574) 2024-04-26T23:27:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc407e00640 1 -- 172.21.15.39:0/2620541719 learned_addr learned my addr 172.21.15.39:0/2620541719 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc40fe00640 1 --2- 172.21.15.39:0/2620541719 >> v2:172.21.15.71:3300/0 conn(0x7fc41015b7e0 0x7fc4100cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc415000640 1 -- 172.21.15.39:0/2620541719 >> v2:172.21.15.71:3300/0 conn(0x7fc41015b7e0 msgr2=0x7fc4100cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc415000640 1 --2- 172.21.15.39:0/2620541719 >> v2:172.21.15.71:3300/0 conn(0x7fc41015b7e0 0x7fc4100cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc415000640 1 -- 172.21.15.39:0/2620541719 >> v1:172.21.15.39:6789/0 conn(0x7fc4100d11e0 legacy=0x7fc4100b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.207+0000 7fc415000640 1 -- 172.21.15.39:0/2620541719 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41006e7e0 con 0x7fc4100d1670 2024-04-26T23:27:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc415000640 1 --2- 172.21.15.39:0/2620541719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4100d1670 0x7fc410072b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b4600 tx=0x7fc40801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8368192440f7447 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc40f400640 1 -- 172.21.15.39:0/2620541719 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080b2070 con 0x7fc4100d1670 2024-04-26T23:27:40.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc40f400640 1 -- 172.21.15.39:0/2620541719 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4080a57f0 con 0x7fc4100d1670 2024-04-26T23:27:40.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc40f400640 1 -- 172.21.15.39:0/2620541719 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080a5bc0 con 0x7fc4100d1670 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- 172.21.15.39:0/2620541719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4100d1670 msgr2=0x7fc410072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 --2- 172.21.15.39:0/2620541719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4100d1670 0x7fc410072b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b4600 tx=0x7fc40801c930 comp rx=0 tx=0).stop 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- 172.21.15.39:0/2620541719 shutdown_connections 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 --2- 172.21.15.39:0/2620541719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4100d1670 0x7fc410072b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 --2- 172.21.15.39:0/2620541719 >> v2:172.21.15.71:3300/0 conn(0x7fc41015b7e0 0x7fc4100cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- 172.21.15.39:0/2620541719 >> 172.21.15.39:0/2620541719 conn(0x7fc41006c7d0 msgr2=0x7fc41006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- 172.21.15.39:0/2620541719 shutdown_connections 2024-04-26T23:27:40.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- 172.21.15.39:0/2620541719 wait complete. 2024-04-26T23:27:40.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 Processor -- start 2024-04-26T23:27:40.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.211+0000 7fc417000640 1 -- start start 2024-04-26T23:27:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 0x7fc410154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 0x7fc410151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc41006f970 con 0x7fc41015b7e0 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc41006f7f0 con 0x7fc4100d11e0 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc41006faf0 con 0x7fc4100d1670 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58118/0 (socket says 172.21.15.39:58118) 2024-04-26T23:27:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 -- 172.21.15.39:0/2956847247 learned_addr learned my addr 172.21.15.39:0/2956847247 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40fe00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 0x7fc410154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc407e00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 0x7fc410151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 -- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 msgr2=0x7fc410151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 0x7fc410151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 -- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 msgr2=0x7fc410154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 0x7fc410154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 -- 172.21.15.39:0/2956847247 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4100ce1f0 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40fe00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 0x7fc410154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc407e00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 0x7fc410151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc415000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc408019540 tx=0x7fc4080196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080b2050 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4080be070 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080ada70 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4100ce4d0 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101531b0 con 0x7fc41015b7e0 2024-04-26T23:27:40.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41006a720 con 0x7fc41015b7e0 2024-04-26T23:27:40.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.215+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4080a5670 con 0x7fc41015b7e0 2024-04-26T23:27:40.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.219+0000 7fc40cc00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 0x7fc3ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.219+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7fc408121920 con 0x7fc41015b7e0 2024-04-26T23:27:40.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.219+0000 7fc40fe00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 0x7fc3ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.219+0000 7fc40fe00640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 0x7fc3ec06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4000097a0 tx=0x7fc400008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.223+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc408016520 con 0x7fc41015b7e0 2024-04-26T23:27:40.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4100d0500 con 0x7fc41015b7e0 2024-04-26T23:27:40.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc40cc00640 1 -- 172.21.15.39:0/2956847247 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7fc4080f2290 con 0x7fc41015b7e0 2024-04-26T23:27:40.394 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 msgr2=0x7fc3ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 0x7fc3ec06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4000097a0 tx=0x7fc400008040 comp rx=0 tx=0).stop 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 msgr2=0x7fc410151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc408019540 tx=0x7fc4080196d0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 shutdown_connections 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068380 0x7fc3ec06a840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc41015b7e0 0x7fc410151bb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4100d1670 0x7fc410151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 --2- 172.21.15.39:0/2956847247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100d11e0 0x7fc410154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 >> 172.21.15.39:0/2956847247 conn(0x7fc41006c7d0 msgr2=0x7fc410155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 shutdown_connections 2024-04-26T23:27:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.387+0000 7fc417000640 1 -- 172.21.15.39:0/2956847247 wait complete. 2024-04-26T23:27:40.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2024-04-26T23:27:40.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 Processor -- start 2024-04-26T23:27:40.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 -- start start 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb11015f580 0x7fb1100d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb11006d800 0x7fb1100b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1100d1160 con 0x7fb1100b3e40 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb1100d1d30 con 0x7fb11015f580 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb115000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb1100d1400 con 0x7fb11006d800 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb11015f580 0x7fb1100d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb11015f580 0x7fb1100d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58120/0 (socket says 172.21.15.39:58120) 2024-04-26T23:27:40.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 -- 172.21.15.39:0/1375430155 learned_addr learned my addr 172.21.15.39:0/1375430155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:40.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10ea00640 1 --2- 172.21.15.39:0/1375430155 >> v2:172.21.15.71:3300/0 conn(0x7fb11006d800 0x7fb1100b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 -- 172.21.15.39:0/1375430155 >> v2:172.21.15.71:3300/0 conn(0x7fb11006d800 msgr2=0x7fb1100b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:40.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 --2- 172.21.15.39:0/1375430155 >> v2:172.21.15.71:3300/0 conn(0x7fb11006d800 0x7fb1100b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 -- 172.21.15.39:0/1375430155 >> v1:172.21.15.71:6789/0 conn(0x7fb1100b3e40 legacy=0x7fb1100cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:40.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.551+0000 7fb10f400640 1 -- 172.21.15.39:0/1375430155 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1100d16e0 con 0x7fb11015f580 2024-04-26T23:27:40.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb10f400640 1 --2- 172.21.15.39:0/1375430155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb11015f580 0x7fb1100d21c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb11006fed0 tx=0x7fb10001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44de2bff9909ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb10e000640 1 -- 172.21.15.39:0/1375430155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1000b0070 con 0x7fb11015f580 2024-04-26T23:27:40.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb10e000640 1 -- 172.21.15.39:0/1375430155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1000ab600 con 0x7fb11015f580 2024-04-26T23:27:40.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb10e000640 1 -- 172.21.15.39:0/1375430155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ab9d0 con 0x7fb11015f580 2024-04-26T23:27:40.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- 172.21.15.39:0/1375430155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb11015f580 msgr2=0x7fb1100d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 --2- 172.21.15.39:0/1375430155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb11015f580 0x7fb1100d21c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb11006fed0 tx=0x7fb10001c490 comp rx=0 tx=0).stop 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- 172.21.15.39:0/1375430155 shutdown_connections 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 --2- 172.21.15.39:0/1375430155 >> v2:172.21.15.71:3300/0 conn(0x7fb11006d800 0x7fb1100b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 --2- 172.21.15.39:0/1375430155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb11015f580 0x7fb1100d21c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- 172.21.15.39:0/1375430155 >> 172.21.15.39:0/1375430155 conn(0x7fb1100d2d80 msgr2=0x7fb1100d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- 172.21.15.39:0/1375430155 shutdown_connections 2024-04-26T23:27:40.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- 172.21.15.39:0/1375430155 wait complete. 2024-04-26T23:27:40.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 Processor -- start 2024-04-26T23:27:40.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.555+0000 7fb115000640 1 -- start start 2024-04-26T23:27:40.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1100b3e40 0x7fb11015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb11015f580 0x7fb1100b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb11016cac0 con 0x7fb1100b0840 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100b5150 con 0x7fb11015f580 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb11016cc40 con 0x7fb1100b3e40 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58132/0 (socket says 172.21.15.39:58132) 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 -- 172.21.15.39:0/292706834 learned_addr learned my addr 172.21.15.39:0/292706834 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10ea00640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb11015f580 0x7fb1100b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10f400640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1100b3e40 0x7fb11015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 -- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1100b3e40 msgr2=0x7fb11015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1100b3e40 0x7fb11015be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 -- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb11015f580 msgr2=0x7fb1100b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb11015f580 0x7fb1100b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:40.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 -- 172.21.15.39:0/292706834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1101470f0 con 0x7fb1100b0840 2024-04-26T23:27:40.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb10fe00640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb10800c730 tx=0x7fb10800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108003b80 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108003d20 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10800aa30 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1100b0ce0 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb110147670 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.559+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1100506d0 con 0x7fb1100b0840 2024-04-26T23:27:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.563+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb10800abd0 con 0x7fb1100b0840 2024-04-26T23:27:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.563+0000 7fb107400640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 0x7fb0f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.563+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7fb108086530 con 0x7fb1100b0840 2024-04-26T23:27:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.563+0000 7fb10f400640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 0x7fb0f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:40.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.563+0000 7fb10f400640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 0x7fb0f006a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ad000 tx=0x7fb1000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:40.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.567+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb1080566a0 con 0x7fb1100b0840 2024-04-26T23:27:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:40.791+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) -- 0x7fb11006dde0 con 0x7fb1100b0840 2024-04-26T23:27:41.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.699+0000 7fb107400640 1 -- 172.21.15.39:0/292706834 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v110) ==== 136+0+0 (secure 0 0 0) 0x7fb10805a9a0 con 0x7fb1100b0840 2024-04-26T23:27:41.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.699+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 msgr2=0x7fb0f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.699+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 0x7fb0f006a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ad000 tx=0x7fb1000a6000 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 msgr2=0x7fb1100cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb10800c730 tx=0x7fb10800cbf0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 shutdown_connections 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb0f0068380 0x7fb0f006a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1100b0840 0x7fb1100cb3b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb11015f580 0x7fb1100b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 --2- 172.21.15.39:0/292706834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1100b3e40 0x7fb11015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 >> 172.21.15.39:0/292706834 conn(0x7fb1100d2d80 msgr2=0x7fb1100cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 shutdown_connections 2024-04-26T23:27:41.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.703+0000 7fb115000640 1 -- 172.21.15.39:0/292706834 wait complete. 2024-04-26T23:27:41.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:27:41.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.863+0000 7fa568200640 1 Processor -- start 2024-04-26T23:27:41.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.863+0000 7fa568200640 1 -- start start 2024-04-26T23:27:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa568200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa568200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 0x7fa5600cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa568200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56006e500 con 0x7fa56015e340 2024-04-26T23:27:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa568200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa56006f110 con 0x7fa5600d18f0 2024-04-26T23:27:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa568200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa56006e7e0 con 0x7fa560140170 2024-04-26T23:27:41.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:43312/0 (socket says 172.21.15.39:43312) 2024-04-26T23:27:41.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 -- 172.21.15.39:0/1479660466 learned_addr learned my addr 172.21.15.39:0/1479660466 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:41.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa566200640 1 --2- 172.21.15.39:0/1479660466 >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 0x7fa5600cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 -- 172.21.15.39:0/1479660466 >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 msgr2=0x7fa5600cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 --2- 172.21.15.39:0/1479660466 >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 0x7fa5600cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 -- 172.21.15.39:0/1479660466 >> v1:172.21.15.71:6789/0 conn(0x7fa56015e340 legacy=0x7fa5600d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa565800640 1 -- 172.21.15.39:0/1479660466 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56006eac0 con 0x7fa560140170 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa566200640 1 --2- 172.21.15.39:0/1479660466 >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 0x7fa5600cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:41.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.867+0000 7fa55fe00640 1 -- 172.21.15.39:0/1479660466 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382008777 0 0) 0x7fa56006e500 con 0x7fa56015e340 2024-04-26T23:27:41.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa565800640 1 --2- 172.21.15.39:0/1479660466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa554009870 tx=0x7fa55401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cdaf0dde08ca004 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:41.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa55fe00640 1 -- 172.21.15.39:0/1479660466 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5540aa620 con 0x7fa560140170 2024-04-26T23:27:41.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa55fe00640 1 -- 172.21.15.39:0/1479660466 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5540af070 con 0x7fa560140170 2024-04-26T23:27:41.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa55fe00640 1 -- 172.21.15.39:0/1479660466 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5540aa9e0 con 0x7fa560140170 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- 172.21.15.39:0/1479660466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 msgr2=0x7fa56015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 --2- 172.21.15.39:0/1479660466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa554009870 tx=0x7fa55401c460 comp rx=0 tx=0).stop 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- 172.21.15.39:0/1479660466 shutdown_connections 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 --2- 172.21.15.39:0/1479660466 >> v2:172.21.15.71:3300/0 conn(0x7fa5600d18f0 0x7fa5600cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 --2- 172.21.15.39:0/1479660466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa560140170 0x7fa56015de00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- 172.21.15.39:0/1479660466 >> 172.21.15.39:0/1479660466 conn(0x7fa56006c7d0 msgr2=0x7fa56006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:41.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- 172.21.15.39:0/1479660466 shutdown_connections 2024-04-26T23:27:41.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- 172.21.15.39:0/1479660466 wait complete. 2024-04-26T23:27:41.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 Processor -- start 2024-04-26T23:27:41.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.871+0000 7fa568200640 1 -- start start 2024-04-26T23:27:41.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa560140170 0x7fa56013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa56015e340 0x7fa56015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600d07d0 con 0x7fa5600d18f0 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600d0650 con 0x7fa560140170 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa5600d0950 con 0x7fa56015e340 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58142/0 (socket says 172.21.15.39:58142) 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 -- 172.21.15.39:0/1802865072 learned_addr learned my addr 172.21.15.39:0/1802865072 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa564e00640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa560140170 0x7fa56013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa566200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa56015e340 0x7fa56015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 -- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa56015e340 msgr2=0x7fa56015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa56015e340 0x7fa56015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 -- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa560140170 msgr2=0x7fa56013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa560140170 0x7fa56013e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:41.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 -- 172.21.15.39:0/1802865072 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5600b5ae0 con 0x7fa5600d18f0 2024-04-26T23:27:41.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa565800640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ac040 tx=0x7fa55401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:41.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5540bd3f0 con 0x7fa5600d18f0 2024-04-26T23:27:41.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5540bd5b0 con 0x7fa5600d18f0 2024-04-26T23:27:41.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5540bd9a0 con 0x7fa5600d18f0 2024-04-26T23:27:41.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56013d6d0 con 0x7fa5600d18f0 2024-04-26T23:27:41.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56013dc90 con 0x7fa5600d18f0 2024-04-26T23:27:41.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.875+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56006a720 con 0x7fa5600d18f0 2024-04-26T23:27:41.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.879+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5540b33f0 con 0x7fa5600d18f0 2024-04-26T23:27:41.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.879+0000 7fa55d600640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 0x7fa54006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:41.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.879+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7fa554120c10 con 0x7fa5600d18f0 2024-04-26T23:27:41.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.879+0000 7fa564e00640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 0x7fa54006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:41.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.879+0000 7fa564e00640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 0x7fa54006a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5600b5340 tx=0x7fa54c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:41.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:41.883+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa5540c3060 con 0x7fa5600d18f0 2024-04-26T23:27:42.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.047+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa5600730c0 con 0x7fa5600d18f0 2024-04-26T23:27:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.051+0000 7fa55d600640 1 -- 172.21.15.39:0/1802865072 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fa554016110 con 0x7fa5600d18f0 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 msgr2=0x7fa54006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 0x7fa54006a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5600b5340 tx=0x7fa54c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 msgr2=0x7fa560155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ac040 tx=0x7fa55401aca0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 shutdown_connections 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa540068380 0x7fa54006a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa56015e340 0x7fa56015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa560140170 0x7fa56013e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 --2- 172.21.15.39:0/1802865072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5600d18f0 0x7fa560155790 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 >> 172.21.15.39:0/1802865072 conn(0x7fa56006c7d0 msgr2=0x7fa56006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 shutdown_connections 2024-04-26T23:27:42.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.055+0000 7fa568200640 1 -- 172.21.15.39:0/1802865072 wait complete. 2024-04-26T23:27:42.081 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:27:42.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:27:42.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:27:42.247 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:27:42.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:42.247 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:42.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:27:42.256 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:42.256 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:42.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:27:42.265 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:42.265 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:42.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:27:42.308 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:27:42.308 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:42.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:27:42.320 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:27:42.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.487+0000 7f2872200640 1 Processor -- start 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.487+0000 7f2872200640 1 -- start start 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2872200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c0cf2a0 0x7f286c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2872200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f286c06fab0 0x7f286c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2872200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c160060 con 0x7f286c145820 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2872200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0cd5c0 con 0x7f286c06fab0 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2872200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f286c160340 con 0x7f286c0cf2a0 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286b400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f286c145820 0x7f286c0b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49582/0 (socket says 172.21.15.39:49582) 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286b400640 1 -- 172.21.15.39:0/2086436086 learned_addr learned my addr 172.21.15.39:0/2086436086 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286be00640 1 --2- 172.21.15.39:0/2086436086 >> v2:172.21.15.39:3300/0 conn(0x7f286c06fab0 0x7f286c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f2862a00640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c0cf2a0 0x7f286c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286aa00640 1 -- 172.21.15.39:0/2086436086 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384142137 0 0) 0x7f286c160060 con 0x7f286c145820 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286aa00640 1 -- 172.21.15.39:0/2086436086 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2850003530 con 0x7f286c145820 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286be00640 1 -- 172.21.15.39:0/2086436086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c0cf2a0 msgr2=0x7f286c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286be00640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c0cf2a0 0x7f286c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286be00640 1 -- 172.21.15.39:0/2086436086 >> v1:172.21.15.39:6789/0 conn(0x7f286c145820 legacy=0x7f286c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.491+0000 7f286be00640 1 -- 172.21.15.39:0/2086436086 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c160620 con 0x7f286c06fab0 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f286be00640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c06fab0 0x7f286c0cda50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee88a2e45eddca5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f286aa00640 1 -- 172.21.15.39:0/2086436086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640b2070 con 0x7f286c06fab0 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f286aa00640 1 -- 172.21.15.39:0/2086436086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640a5830 con 0x7f286c06fab0 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f286aa00640 1 -- 172.21.15.39:0/2086436086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640a5c00 con 0x7f286c06fab0 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- 172.21.15.39:0/2086436086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c06fab0 msgr2=0x7f286c0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c06fab0 0x7f286c0cda50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286401c970 comp rx=0 tx=0).stop 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- 172.21.15.39:0/2086436086 shutdown_connections 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c06fab0 0x7f286c0cda50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 --2- 172.21.15.39:0/2086436086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c0cf2a0 0x7f286c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- 172.21.15.39:0/2086436086 >> 172.21.15.39:0/2086436086 conn(0x7f286c0b2af0 msgr2=0x7f286c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- 172.21.15.39:0/2086436086 shutdown_connections 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- 172.21.15.39:0/2086436086 wait complete. 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 Processor -- start 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.495+0000 7f2872200640 1 -- start start 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c06fab0 0x7f286c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f286c0cf2a0 0x7f286c13a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f286c15fdb0 con 0x7f286c145820 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f286c15fc30 con 0x7f286c0cf2a0 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f286c168dc0 con 0x7f286c06fab0 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58154/0 (socket says 172.21.15.39:58154) 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 -- 172.21.15.39:0/531731442 learned_addr learned my addr 172.21.15.39:0/531731442 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2862a00640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f286c0cf2a0 0x7f286c13a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286b400640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c06fab0 0x7f286c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 -- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c06fab0 msgr2=0x7f286c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c06fab0 0x7f286c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 -- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f286c0cf2a0 msgr2=0x7f286c13a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f286c0cf2a0 0x7f286c13a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 -- 172.21.15.39:0/531731442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c13b3a0 con 0x7f286c145820 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f286be00640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f2864019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640b2050 con 0x7f286c145820 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640be070 con 0x7f286c145820 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640ada90 con 0x7f286c145820 2024-04-26T23:27:42.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c13c320 con 0x7f286c145820 2024-04-26T23:27:42.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c13aef0 con 0x7f286c145820 2024-04-26T23:27:42.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c050740 con 0x7f286c145820 2024-04-26T23:27:42.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.499+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28640a56b0 con 0x7f286c145820 2024-04-26T23:27:42.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.503+0000 7f2863e00640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 0x7f284806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.503+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7f2864121710 con 0x7f286c145820 2024-04-26T23:27:42.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.503+0000 7f286b400640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 0x7f284806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.503+0000 7f286b400640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 0x7f284806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f285c007fd0 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.507+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2864016560 con 0x7f286c145820 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f286c15a4b0 con 0x7f286c145820 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2863e00640 1 -- 172.21.15.39:0/531731442 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3866 (secure 0 0 0) 0x7f28640f19a0 con 0x7f286c145820 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2710987498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2710987498},{"type":"v1","addr":"172.21.15.71:6836","nonce":2710987498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1601049788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1601049788},{"type":"v1","addr":"172.21.15.71:6837","nonce":1601049788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2535626997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2535626997},{"type":"v1","addr":"172.21.15.39:6834","nonce":2535626997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/620189080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":620189080},{"type":"v1","addr":"172.21.15.39:6835","nonce":620189080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 msgr2=0x7f284806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 0x7f284806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f285c007fd0 tx=0x7f285c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 msgr2=0x7f286c13de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f2864019710 comp rx=0 tx=0).stop 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 shutdown_connections 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2848068380 0x7f284806a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f286c145820 0x7f286c13de80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f286c0cf2a0 0x7f286c13a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 --2- 172.21.15.39:0/531731442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f286c06fab0 0x7f286c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 >> 172.21.15.39:0/531731442 conn(0x7f286c0b2af0 msgr2=0x7f286c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 shutdown_connections 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.707+0000 7f2872200640 1 -- 172.21.15.39:0/531731442 wait complete. 2024-04-26T23:27:42.735 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:27:42.735 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:27:42.735 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:42.735 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:27:42.735 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:27:42.736 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:42.736 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:27:42.736 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:27:42.736 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:42.736 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:27:42.736 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:27:42.737 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:27:42.748 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:27:42.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:27:42.749 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:27:42.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:27:42.751 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:27:42.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:27:42.752 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:27:42.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:27:42.799 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:27:42.799 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:42.800 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:27:42.800 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:42.802 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:27:42.802 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:42.804 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:27:42.804 DEBUG:teuthology.parallel:result is None 2024-04-26T23:27:42.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:27:42.886 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:27:42.887 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:27:42.891 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-04-26T23:27:42.892 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-04-26T23:27:42.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 Processor -- start 2024-04-26T23:27:42.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 -- start start 2024-04-26T23:27:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f898c1458d0 0x7f898c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f898c073400 0x7f898c072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c072180 con 0x7f898c072e50 2024-04-26T23:27:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f898c0739a0 con 0x7f898c073400 2024-04-26T23:27:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8990e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f898c073c80 con 0x7f898c1458d0 2024-04-26T23:27:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8983e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f898c073400 0x7f898c072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f898a800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f898c072e50 0x7f898c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49592/0 (socket says 172.21.15.39:49592) 2024-04-26T23:27:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f898a800640 1 -- 172.21.15.39:0/1942278083 learned_addr learned my addr 172.21.15.39:0/1942278083 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8989e00640 1 --2- 172.21.15.39:0/1942278083 >> v2:172.21.15.71:3300/0 conn(0x7f898c1458d0 0x7f898c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8983e00640 1 -- 172.21.15.39:0/1942278083 >> v2:172.21.15.71:3300/0 conn(0x7f898c1458d0 msgr2=0x7f898c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8983e00640 1 --2- 172.21.15.39:0/1942278083 >> v2:172.21.15.71:3300/0 conn(0x7f898c1458d0 0x7f898c0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8983e00640 1 -- 172.21.15.39:0/1942278083 >> v1:172.21.15.39:6789/0 conn(0x7f898c072e50 legacy=0x7f898c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8983e00640 1 -- 172.21.15.39:0/1942278083 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c145cb0 con 0x7f898c073400 2024-04-26T23:27:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.943+0000 7f8989400640 1 -- 172.21.15.39:0/1942278083 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909030077 0 0) 0x7f898c072180 con 0x7f898c072e50 2024-04-26T23:27:42.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8983e00640 1 --2- 172.21.15.39:0/1942278083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c072910 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f89740097c0 tx=0x7f897401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8a2e521fafeb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8989400640 1 -- 172.21.15.39:0/1942278083 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740b0070 con 0x7f898c073400 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8989400640 1 -- 172.21.15.39:0/1942278083 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89740ab600 con 0x7f898c073400 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8989400640 1 -- 172.21.15.39:0/1942278083 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740ab9d0 con 0x7f898c073400 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 -- 172.21.15.39:0/1942278083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 msgr2=0x7f898c072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 --2- 172.21.15.39:0/1942278083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c072910 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f89740097c0 tx=0x7f897401c3d0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 -- 172.21.15.39:0/1942278083 shutdown_connections 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 --2- 172.21.15.39:0/1942278083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c072910 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 --2- 172.21.15.39:0/1942278083 >> v2:172.21.15.71:3300/0 conn(0x7f898c1458d0 0x7f898c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 -- 172.21.15.39:0/1942278083 >> 172.21.15.39:0/1942278083 conn(0x7f898c06c7d0 msgr2=0x7f898c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 -- 172.21.15.39:0/1942278083 shutdown_connections 2024-04-26T23:27:42.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.947+0000 7f8990e00640 1 -- 172.21.15.39:0/1942278083 wait complete. 2024-04-26T23:27:42.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 Processor -- start 2024-04-26T23:27:42.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- start start 2024-04-26T23:27:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f898c072e50 0x7f898c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f898c1458d0 0x7f898c142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f898c168f40 con 0x7f898c073400 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0cef00 con 0x7f898c1458d0 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f898c1690c0 con 0x7f898c072e50 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58200/0 (socket says 172.21.15.39:58200) 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 -- 172.21.15.39:0/780581650 learned_addr learned my addr 172.21.15.39:0/780581650 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 -- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f898c072e50 msgr2=0x7f898c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f898c072e50 0x7f898c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 -- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f898c1458d0 msgr2=0x7f898c142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f898c1458d0 0x7f898c142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 -- 172.21.15.39:0/780581650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c13cc70 con 0x7f898c073400 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8983e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8974018fe0 tx=0x7f8974019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740b8020 con 0x7f898c073400 2024-04-26T23:27:42.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89740b4410 con 0x7f898c073400 2024-04-26T23:27:42.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740b0040 con 0x7f898c073400 2024-04-26T23:27:42.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c13c990 con 0x7f898c073400 2024-04-26T23:27:42.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.951+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c1564d0 con 0x7f898c073400 2024-04-26T23:27:42.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c06a720 con 0x7f898c073400 2024-04-26T23:27:42.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89740bb020 con 0x7f898c073400 2024-04-26T23:27:42.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8982000640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:42.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5029+0+0 (secure 0 0 0) 0x7f8974120170 con 0x7f898c073400 2024-04-26T23:27:42.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8989e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:42.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.955+0000 7f8989e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 0x7f896806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f897c006aa0 tx=0x7f897c006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:42.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:42.959+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f89740c2030 con 0x7f898c073400 2024-04-26T23:27:43.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.139+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f898c0b50b0 con 0x7f898c073400 2024-04-26T23:27:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.711+0000 7f8982000640 1 -- 172.21.15.39:0/780581650 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7f8974016050 con 0x7f898c073400 2024-04-26T23:27:43.719 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2024-04-26T23:27:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 msgr2=0x7f896806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 0x7f896806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f897c006aa0 tx=0x7f897c006a30 comp rx=0 tx=0).stop 2024-04-26T23:27:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 msgr2=0x7f898c15b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8974018fe0 tx=0x7f8974019170 comp rx=0 tx=0).stop 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 shutdown_connections 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f898c1458d0 0x7f898c142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f898c073400 0x7f898c15b980 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 --2- 172.21.15.39:0/780581650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f898c072e50 0x7f898c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 >> 172.21.15.39:0/780581650 conn(0x7f898c06c7d0 msgr2=0x7f898c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 shutdown_connections 2024-04-26T23:27:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.715+0000 7f8990e00640 1 -- 172.21.15.39:0/780581650 wait complete. 2024-04-26T23:27:43.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:27:43.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.879+0000 7fd7c0e00640 1 Processor -- start 2024-04-26T23:27:43.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.879+0000 7fd7c0e00640 1 -- start start 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7c0e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd7bc0cfe00 0x7fd7bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7c0e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7bc074750 con 0x7fd7bc0cd810 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7c0e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7bc0d0290 con 0x7fd7bc0742f0 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7c0e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd7bc0d0b10 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7b9e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd7bc0cd810 0x7fd7bc144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49596/0 (socket says 172.21.15.39:49596) 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7b9e00640 1 -- 172.21.15.39:0/236788582 learned_addr learned my addr 172.21.15.39:0/236788582 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7ba800640 1 --2- 172.21.15.39:0/236788582 >> v2:172.21.15.39:3300/0 conn(0x7fd7bc0cfe00 0x7fd7bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7b9400640 1 -- 172.21.15.39:0/236788582 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760023556 0 0) 0x7fd7bc074750 con 0x7fd7bc0cd810 2024-04-26T23:27:43.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7b9400640 1 -- 172.21.15.39:0/236788582 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7a0003530 con 0x7fd7bc0cd810 2024-04-26T23:27:43.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7ba800640 1 -- 172.21.15.39:0/236788582 >> v1:172.21.15.71:6789/0 conn(0x7fd7bc0742f0 legacy=0x7fd7bc0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7ba800640 1 -- 172.21.15.39:0/236788582 >> v1:172.21.15.39:6789/0 conn(0x7fd7bc0cd810 legacy=0x7fd7bc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.883+0000 7fd7ba800640 1 -- 172.21.15.39:0/236788582 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc0d0550 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7ba800640 1 --2- 172.21.15.39:0/236788582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc06ee00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3847b12df4647e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:43.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7b9400640 1 -- 172.21.15.39:0/236788582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40b2070 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7b9400640 1 -- 172.21.15.39:0/236788582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b40a57d0 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7b9400640 1 -- 172.21.15.39:0/236788582 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40a5b80 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- 172.21.15.39:0/236788582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 msgr2=0x7fd7bc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/236788582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc06ee00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b401c820 comp rx=0 tx=0).stop 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- 172.21.15.39:0/236788582 shutdown_connections 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/236788582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc06ee00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- 172.21.15.39:0/236788582 >> 172.21.15.39:0/236788582 conn(0x7fd7bc0b2af0 msgr2=0x7fd7bc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- 172.21.15.39:0/236788582 shutdown_connections 2024-04-26T23:27:43.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- 172.21.15.39:0/236788582 wait complete. 2024-04-26T23:27:43.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 Processor -- start 2024-04-26T23:27:43.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 -- start start 2024-04-26T23:27:43.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.887+0000 7fd7c0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7bc0742f0 0x7fd7bc13c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:43.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7bc0cd810 0x7fd7bc1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:43.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:43.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc16b080 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc16af00 con 0x7fd7bc0742f0 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc16b200 con 0x7fd7bc0cd810 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58206/0 (socket says 172.21.15.39:58206) 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 -- 172.21.15.39:0/2182248056 learned_addr learned my addr 172.21.15.39:0/2182248056 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b9e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7bc0742f0 0x7fd7bc13c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b1400640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7bc0cd810 0x7fd7bc1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:43.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 -- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7bc0cd810 msgr2=0x7fd7bc1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7bc0cd810 0x7fd7bc1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 -- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7bc0742f0 msgr2=0x7fd7bc13c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7bc0742f0 0x7fd7bc13c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 -- 172.21.15.39:0/2182248056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc159700 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7ba800640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40b0040 tx=0x7fd7b40195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40bd020 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b40b3040 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40b2050 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7bc13ca50 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7bc13d010 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc050740 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.891+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7b4003c80 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.895+0000 7fd7b2a00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 0x7fd79806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.895+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4857+0+0 (secure 0 0 0) 0x7fd7b4120e60 con 0x7fd7bc0cfe00 2024-04-26T23:27:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.895+0000 7fd7b9e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 0x7fd79806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.895+0000 7fd7b9e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 0x7fd79806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0011f0 tx=0x7fd7ac007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:43.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:43.899+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd7b40c7060 con 0x7fd7bc0cfe00 2024-04-26T23:27:44.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd7bc06d3e0 con 0x7fd7bc0cfe00 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7b2a00640 1 -- 172.21.15.39:0/2182248056 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fd7b4016560 con 0x7fd7bc0cfe00 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.129 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqV33LRAAEJGRcr66jyYjplL5wl+brg==", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmxfZIOhAAqBAlj+xssqRyWvvbCYfPwA==", 2024-04-26T23:27:44.130 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmSwdTNRAA9WY84j6z2N65LmrYLj+lYA==", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:44.131 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmau88BhAAGTd6/z68e7znV/KHRCCDGA==", 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.132 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDdNyxmZuaFKhAAsfRLhoI4+QYnw9ufIR28iA==", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDgNyxmPDO6NBAAdHN3Ijn/eE9d0sEomTfEtw==", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.133 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDkNyxmTFCfAhAA/Q6nJAECSWB/CwTzLIV3rA==", 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.134 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDnNyxmh9LLCxAA+qQSaClk3U21trpe22vj3A==", 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.135 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDtNyxmbifsBRAAjNjFGc0ejjAFGEcIugsBvA==", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDwNyxmnTs7ERAA//zGSDQBvm2tcRzZTOlNvA==", 2024-04-26T23:27:44.136 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDzNyxm5C8dHBAAeWFaQRTmZVLQqrfyScFj3A==", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD2Nyxmek04JRAALoMi3/NJ6Sp0Lfx6VeWKWA==", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g==", 2024-04-26T23:27:44.138 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow r", 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmTGgYFBAAVTR5yp7RgxU5styz5dROGw==", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmT9aVEBAAib2ep6XrtA1R8JCqVmQbRw==", 2024-04-26T23:27:44.140 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmMDXpGRAA9orIW7EXyWBNIend4Gr4pA==", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:27:44.141 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxm5J90ERAA9DJ7JqkuVegQd3DC6U1UCA==", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2024-04-26T23:27:44.142 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmW4xWKRAA7+rz/WwBsBWQ5XhHVOvfkQ==", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqK9rJRAA9aE1iwhQtH0eYlqn5obd/A==", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.143 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:44.144 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-04-26T23:27:44.144 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 msgr2=0x7fd79806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 0x7fd79806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0011f0 tx=0x7fd7ac007d40 comp rx=0 tx=0).stop 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 msgr2=0x7fd7bc15da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40b0040 tx=0x7fd7b40195c0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 shutdown_connections 2024-04-26T23:27:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd798068380 0x7fd79806a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7bc0cfe00 0x7fd7bc15da70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7bc0cd810 0x7fd7bc1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 --2- 172.21.15.39:0/2182248056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7bc0742f0 0x7fd7bc13c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 >> 172.21.15.39:0/2182248056 conn(0x7fd7bc0b2af0 msgr2=0x7fd7bc0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 shutdown_connections 2024-04-26T23:27:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.123+0000 7fd7c0e00640 1 -- 172.21.15.39:0/2182248056 wait complete. 2024-04-26T23:27:44.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 Processor -- start 2024-04-26T23:27:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 -- start start 2024-04-26T23:27:44.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f52d80cd810 0x7f52d80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80d0550 con 0x7f52d80cfe00 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f52d80d0b10 con 0x7f52d80cd810 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52dde00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f52d806e970 con 0x7f52d80cdbf0 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f52d80cd810 0x7f52d80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f52d80cd810 0x7f52d80742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58218/0 (socket says 172.21.15.39:58218) 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 -- 172.21.15.39:0/979435884 learned_addr learned my addr 172.21.15.39:0/979435884 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d7400640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 -- 172.21.15.39:0/979435884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 msgr2=0x7f52d806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:44.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 -- 172.21.15.39:0/979435884 >> v1:172.21.15.71:6789/0 conn(0x7f52d80cfe00 legacy=0x7f52d8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 -- 172.21.15.39:0/979435884 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80d0830 con 0x7f52d80cd810 2024-04-26T23:27:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.287+0000 7f52d6a00640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cd810 0x7f52d80742f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fd7e0ff2cbfc34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d5600640 1 -- 172.21.15.39:0/979435884 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c80b0070 con 0x7f52d80cd810 2024-04-26T23:27:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d5600640 1 -- 172.21.15.39:0/979435884 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c80ab600 con 0x7f52d80cd810 2024-04-26T23:27:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d5600640 1 -- 172.21.15.39:0/979435884 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c80ab9d0 con 0x7f52d80cd810 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- 172.21.15.39:0/979435884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cd810 msgr2=0x7f52d80742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cd810 0x7f52d80742f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c801c410 comp rx=0 tx=0).stop 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- 172.21.15.39:0/979435884 shutdown_connections 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- 172.21.15.39:0/979435884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cd810 0x7f52d80742f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- 172.21.15.39:0/979435884 >> 172.21.15.39:0/979435884 conn(0x7f52d80b2af0 msgr2=0x7f52d80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- 172.21.15.39:0/979435884 shutdown_connections 2024-04-26T23:27:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- 172.21.15.39:0/979435884 wait complete. 2024-04-26T23:27:44.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 Processor -- start 2024-04-26T23:27:44.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- start start 2024-04-26T23:27:44.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52d80cd810 0x7f52d815b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d8140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8143d30 con 0x7f52d80cfe00 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8143bb0 con 0x7f52d80cd810 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52dde00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f52d8169ef0 con 0x7f52d80cdbf0 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58226/0 (socket says 172.21.15.39:58226) 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d7400640 1 -- 172.21.15.39:0/1614875870 learned_addr learned my addr 172.21.15.39:0/1614875870 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d6a00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52d80cd810 0x7f52d815b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.291+0000 7f52d6000640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d8140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 -- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 msgr2=0x7f52d8140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d8140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 -- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52d80cd810 msgr2=0x7f52d815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52d80cd810 0x7f52d815b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 -- 172.21.15.39:0/1614875870 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d81410f0 con 0x7f52d80cfe00 2024-04-26T23:27:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52d7400640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f52d0007e40 tx=0x7f52d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0014620 con 0x7f52d80cfe00 2024-04-26T23:27:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0019070 con 0x7f52d80cfe00 2024-04-26T23:27:44.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d815bd80 con 0x7f52d80cfe00 2024-04-26T23:27:44.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0014a20 con 0x7f52d80cfe00 2024-04-26T23:27:44.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d815c620 con 0x7f52d80cfe00 2024-04-26T23:27:44.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8050740 con 0x7f52d80cfe00 2024-04-26T23:27:44.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52d0014bc0 con 0x7f52d80cfe00 2024-04-26T23:27:44.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 0x7f52b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.295+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4857+0+0 (secure 0 0 0) 0x7f52d0086e30 con 0x7f52d80cfe00 2024-04-26T23:27:44.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.299+0000 7f52d6a00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 0x7f52b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.299+0000 7f52d6a00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 0x7f52b806a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ad000 tx=0x7f52c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.303+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f52d81410f0 con 0x7f52d80cfe00 2024-04-26T23:27:44.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.467+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52d8157150 con 0x7f52d80cfe00 2024-04-26T23:27:44.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.467+0000 7f52cf400640 1 -- 172.21.15.39:0/1614875870 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+12831 (secure 0 0 0) 0x7f52d00570e0 con 0x7f52d80cfe00 2024-04-26T23:27:44.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:44.475 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":47,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:43.724918+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 msgr2=0x7f52b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 0x7f52b806a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ad000 tx=0x7f52c80a6000 comp rx=0 tx=0).stop 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 msgr2=0x7f52d81f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f52d0007e40 tx=0x7f52d000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 shutdown_connections 2024-04-26T23:27:44.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52b8068380 0x7f52b806a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d80cfe00 0x7f52d81f7400 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52d80cdbf0 0x7f52d8140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 --2- 172.21.15.39:0/1614875870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52d80cd810 0x7f52d815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 >> 172.21.15.39:0/1614875870 conn(0x7f52d80b2af0 msgr2=0x7f52d81565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 shutdown_connections 2024-04-26T23:27:44.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.471+0000 7f52dde00640 1 -- 172.21.15.39:0/1614875870 wait complete. 2024-04-26T23:27:44.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:27:44.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:27:44.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 Processor -- start 2024-04-26T23:27:44.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 -- start start 2024-04-26T23:27:44.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f340ce5e0 0x7f3f340cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f34072180 con 0x7f3f34073400 2024-04-26T23:27:44.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3f340739a0 con 0x7f3f340ce5e0 2024-04-26T23:27:44.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3c800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3f34073c80 con 0x7f3f341458d0 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f3a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f340ce5e0 0x7f3f340cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:43394/0 (socket says 172.21.15.39:43394) 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 -- 172.21.15.39:0/3895260834 learned_addr learned my addr 172.21.15.39:0/3895260834 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 -- 172.21.15.39:0/3895260834 >> v2:172.21.15.71:3300/0 conn(0x7f3f340ce5e0 msgr2=0x7f3f340cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 --2- 172.21.15.39:0/3895260834 >> v2:172.21.15.71:3300/0 conn(0x7f3f340ce5e0 0x7f3f340cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 -- 172.21.15.39:0/3895260834 >> v1:172.21.15.71:6789/0 conn(0x7f3f34073400 legacy=0x7f3f34072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.639+0000 7f3f39e00640 1 -- 172.21.15.39:0/3895260834 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f34145cb0 con 0x7f3f341458d0 2024-04-26T23:27:44.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f39e00640 1 --2- 172.21.15.39:0/3895260834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f280098a0 tx=0x7f3f2801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8f532eb9008e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f38a00640 1 -- 172.21.15.39:0/3895260834 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280b1070 con 0x7f3f341458d0 2024-04-26T23:27:44.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f38a00640 1 -- 172.21.15.39:0/3895260834 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f280ac620 con 0x7f3f341458d0 2024-04-26T23:27:44.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f38a00640 1 -- 172.21.15.39:0/3895260834 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280ac9f0 con 0x7f3f341458d0 2024-04-26T23:27:44.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- 172.21.15.39:0/3895260834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 msgr2=0x7f3f340b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 --2- 172.21.15.39:0/3895260834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f280098a0 tx=0x7f3f2801c4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- 172.21.15.39:0/3895260834 shutdown_connections 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 --2- 172.21.15.39:0/3895260834 >> v2:172.21.15.71:3300/0 conn(0x7f3f340ce5e0 0x7f3f340cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 --2- 172.21.15.39:0/3895260834 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341458d0 0x7f3f340b4890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- 172.21.15.39:0/3895260834 >> 172.21.15.39:0/3895260834 conn(0x7f3f3406c7d0 msgr2=0x7f3f3406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- 172.21.15.39:0/3895260834 shutdown_connections 2024-04-26T23:27:44.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- 172.21.15.39:0/3895260834 wait complete. 2024-04-26T23:27:44.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 Processor -- start 2024-04-26T23:27:44.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.643+0000 7f3f3c800640 1 -- start start 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f340ce5e0 0x7f3f340b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f341458d0 0x7f3f34165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3406e460 con 0x7f3f34073400 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34073230 con 0x7f3f341458d0 2024-04-26T23:27:44.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3406e5e0 con 0x7f3f340ce5e0 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58232/0 (socket says 172.21.15.39:58232) 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 -- 172.21.15.39:0/12297531 learned_addr learned my addr 172.21.15.39:0/12297531 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3a800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f341458d0 0x7f3f34165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39400640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f340ce5e0 0x7f3f340b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 -- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f340ce5e0 msgr2=0x7f3f340b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f340ce5e0 0x7f3f340b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 -- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f341458d0 msgr2=0x7f3f34165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f341458d0 0x7f3f34165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 -- 172.21.15.39:0/12297531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3415e2d0 con 0x7f3f34073400 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f39e00640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3f280af040 tx=0x7f3f2801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280b1040 con 0x7f3f34073400 2024-04-26T23:27:44.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f280bd070 con 0x7f3f34073400 2024-04-26T23:27:44.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280b7620 con 0x7f3f34073400 2024-04-26T23:27:44.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3415e5b0 con 0x7f3f34073400 2024-04-26T23:27:44.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3415eb70 con 0x7f3f34073400 2024-04-26T23:27:44.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.647+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3406a720 con 0x7f3f34073400 2024-04-26T23:27:44.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.651+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f280b77c0 con 0x7f3f34073400 2024-04-26T23:27:44.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.651+0000 7f3f2e000640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 0x7f3f1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.651+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4857+0+0 (secure 0 0 0) 0x7f3f28120910 con 0x7f3f34073400 2024-04-26T23:27:44.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.651+0000 7f3f39400640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 0x7f3f1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.651+0000 7f3f39400640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 0x7f3f1806a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f341447e0 tx=0x7f3f24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.655+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3f28016130 con 0x7f3f34073400 2024-04-26T23:27:44.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.819+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3f340b50b0 con 0x7f3f34073400 2024-04-26T23:27:44.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f2e000640 1 -- 172.21.15.39:0/12297531 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f3f280f1210 con 0x7f3f34073400 2024-04-26T23:27:44.825 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 msgr2=0x7f3f1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 0x7f3f1806a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f341447e0 tx=0x7f3f24009040 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 msgr2=0x7f3f3415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3f280af040 tx=0x7f3f2801acf0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 shutdown_connections 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3f180683b0 0x7f3f1806a870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f341458d0 0x7f3f34165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f340ce5e0 0x7f3f340b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 --2- 172.21.15.39:0/12297531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34073400 0x7f3f3415f370 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 >> 172.21.15.39:0/12297531 conn(0x7f3f3406c7d0 msgr2=0x7f3f340afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 shutdown_connections 2024-04-26T23:27:44.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.823+0000 7f3f3c800640 1 -- 172.21.15.39:0/12297531 wait complete. 2024-04-26T23:27:44.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:27:44.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 Processor -- start 2024-04-26T23:27:44.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 -- start start 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 0x7fabd40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd4074750 con 0x7fabd40cd810 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fabd40d0b10 con 0x7fabd40742f0 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.983+0000 7fabdae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fabd406e970 con 0x7fabd40cdbf0 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:43422/0 (socket says 172.21.15.39:43422) 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabcbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 0x7fabd40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 -- 172.21.15.39:0/1791805976 learned_addr learned my addr 172.21.15.39:0/1791805976 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 -- 172.21.15.39:0/1791805976 >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 msgr2=0x7fabd40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 --2- 172.21.15.39:0/1791805976 >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 0x7fabd40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 -- 172.21.15.39:0/1791805976 >> v1:172.21.15.71:6789/0 conn(0x7fabd40cd810 legacy=0x7fabd4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 -- 172.21.15.39:0/1791805976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40d0550 con 0x7fabd40cdbf0 2024-04-26T23:27:44.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabcbe00640 1 --2- 172.21.15.39:0/1791805976 >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 0x7fabd40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:44.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd8e00640 1 --2- 172.21.15.39:0/1791805976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009e50 tx=0x7fabcc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf9b0fc3bbf715f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.987+0000 7fabd3400640 1 -- 172.21.15.39:0/1791805976 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0a5690 con 0x7fabd40cdbf0 2024-04-26T23:27:44.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd3400640 1 -- 172.21.15.39:0/1791805976 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc0a5830 con 0x7fabd40cdbf0 2024-04-26T23:27:44.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd3400640 1 -- 172.21.15.39:0/1791805976 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0a5c00 con 0x7fabd40cdbf0 2024-04-26T23:27:44.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- 172.21.15.39:0/1791805976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 msgr2=0x7fabd406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- 172.21.15.39:0/1791805976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009e50 tx=0x7fabcc01c8e0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- 172.21.15.39:0/1791805976 shutdown_connections 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- 172.21.15.39:0/1791805976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40cdbf0 0x7fabd406ee00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- 172.21.15.39:0/1791805976 >> v2:172.21.15.71:3300/0 conn(0x7fabd40742f0 0x7fabd40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- 172.21.15.39:0/1791805976 >> 172.21.15.39:0/1791805976 conn(0x7fabd40b2af0 msgr2=0x7fabd40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- 172.21.15.39:0/1791805976 shutdown_connections 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- 172.21.15.39:0/1791805976 wait complete. 2024-04-26T23:27:44.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 Processor -- start 2024-04-26T23:27:44.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- start start 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40742f0 0x7fabd40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabd40cd810 0x7fabd41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4143d30 con 0x7fabd40cdbf0 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4143bb0 con 0x7fabd40cd810 2024-04-26T23:27:44.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabdae00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fabd4169ef0 con 0x7fabd40742f0 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58238/0 (socket says 172.21.15.39:58238) 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd8e00640 1 -- 172.21.15.39:0/634055994 learned_addr learned my addr 172.21.15.39:0/634055994 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabd3e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40742f0 0x7fabd40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.991+0000 7fabcbe00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabd40cd810 0x7fabd41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 -- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40742f0 msgr2=0x7fabd40b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40742f0 0x7fabd40b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 -- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabd40cd810 msgr2=0x7fabd41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabd40cd810 0x7fabd41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 -- 172.21.15.39:0/634055994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40b4430 con 0x7fabd40cdbf0 2024-04-26T23:27:44.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd8e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0af040 tx=0x7fabcc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0bc070 con 0x7fabd40cdbf0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc0b8640 con 0x7fabd40cdbf0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc009510 con 0x7fabd40cdbf0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd40b46d0 con 0x7fabd40cdbf0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd40b4c90 con 0x7fabd40cdbf0 2024-04-26T23:27:44.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd4050740 con 0x7fabd40cdbf0 2024-04-26T23:27:44.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabcc0b8a10 con 0x7fabd40cdbf0 2024-04-26T23:27:44.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 0x7fabb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:44.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4857+0+0 (secure 0 0 0) 0x7fabcc121230 con 0x7fabd40cdbf0 2024-04-26T23:27:45.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.995+0000 7fabd3e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 0x7fabb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.999+0000 7fabd3e00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 0x7fabb006a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabd4072780 tx=0x7fabc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:44.999+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fabcc016620 con 0x7fabd40cdbf0 2024-04-26T23:27:45.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.167+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fabd4159f60 con 0x7fabd40cdbf0 2024-04-26T23:27:45.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.167+0000 7fabd0c00640 1 -- 172.21.15.39:0/634055994 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7fabcc0f16a0 con 0x7fabd40cdbf0 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 msgr2=0x7fabb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 0x7fabb006a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabd4072780 tx=0x7fabc4009040 comp rx=0 tx=0).stop 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 msgr2=0x7fabd41418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0af040 tx=0x7fabcc019680 comp rx=0 tx=0).stop 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 shutdown_connections 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fabb0068380 0x7fabb006a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd40cdbf0 0x7fabd41418c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabd40cd810 0x7fabd41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 --2- 172.21.15.39:0/634055994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fabd40742f0 0x7fabd40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 >> 172.21.15.39:0/634055994 conn(0x7fabd40b2af0 msgr2=0x7fabd4142710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:45.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 shutdown_connections 2024-04-26T23:27:45.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.171+0000 7fabdae00640 1 -- 172.21.15.39:0/634055994 wait complete. 2024-04-26T23:27:45.192 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:27:45.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:27:45.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 Processor -- start 2024-04-26T23:27:45.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 -- start start 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbcf81468a0 0x7fbcf8074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcf81613d0 0x7fbcf80b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf80b4280 con 0x7fbcf80b3df0 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf806edd0 con 0x7fbcf81613d0 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcff800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf8072620 con 0x7fbcf81468a0 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcf81613d0 0x7fbcf80b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcf81613d0 0x7fbcf80b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58252/0 (socket says 172.21.15.39:58252) 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 -- 172.21.15.39:0/3913674699 learned_addr learned my addr 172.21.15.39:0/3913674699 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfce00640 1 --2- 172.21.15.39:0/3913674699 >> v2:172.21.15.71:3300/0 conn(0x7fbcf81468a0 0x7fbcf8074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 -- 172.21.15.39:0/3913674699 >> v2:172.21.15.71:3300/0 conn(0x7fbcf81468a0 msgr2=0x7fbcf8074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:45.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 --2- 172.21.15.39:0/3913674699 >> v2:172.21.15.71:3300/0 conn(0x7fbcf81468a0 0x7fbcf8074180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 -- 172.21.15.39:0/3913674699 >> v1:172.21.15.71:6789/0 conn(0x7fbcf80b3df0 legacy=0x7fbcf8160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.335+0000 7fbcfd800640 1 -- 172.21.15.39:0/3913674699 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf806f020 con 0x7fbcf81613d0 2024-04-26T23:27:45.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcfd800640 1 --2- 172.21.15.39:0/3913674699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf81613d0 0x7fbcf80b5970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009e50 tx=0x7fbcf001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f12e5a566fad656 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcf7400640 1 -- 172.21.15.39:0/3913674699 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00a5590 con 0x7fbcf81613d0 2024-04-26T23:27:45.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcf7400640 1 -- 172.21.15.39:0/3913674699 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf00a5730 con 0x7fbcf81613d0 2024-04-26T23:27:45.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcf7400640 1 -- 172.21.15.39:0/3913674699 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00a5b00 con 0x7fbcf81613d0 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 -- 172.21.15.39:0/3913674699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf81613d0 msgr2=0x7fbcf80b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 --2- 172.21.15.39:0/3913674699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf81613d0 0x7fbcf80b5970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009e50 tx=0x7fbcf001c8d0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 -- 172.21.15.39:0/3913674699 shutdown_connections 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 --2- 172.21.15.39:0/3913674699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf81613d0 0x7fbcf80b5970 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 --2- 172.21.15.39:0/3913674699 >> v2:172.21.15.71:3300/0 conn(0x7fbcf81468a0 0x7fbcf8074180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 -- 172.21.15.39:0/3913674699 >> 172.21.15.39:0/3913674699 conn(0x7fbcf80b2cc0 msgr2=0x7fbcf80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:45.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 -- 172.21.15.39:0/3913674699 shutdown_connections 2024-04-26T23:27:45.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.339+0000 7fbcff800640 1 -- 172.21.15.39:0/3913674699 wait complete. 2024-04-26T23:27:45.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 Processor -- start 2024-04-26T23:27:45.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- start start 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcf81468a0 0x7fbcf8140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcf81613d0 0x7fbcf813faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8073440 con 0x7fbcf813c0e0 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf80732c0 con 0x7fbcf81613d0 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80735c0 con 0x7fbcf81468a0 2024-04-26T23:27:45.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58256/0 (socket says 172.21.15.39:58256) 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 -- 172.21.15.39:0/3516780902 learned_addr learned my addr 172.21.15.39:0/3516780902 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcf7e00640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcf81613d0 0x7fbcf813faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfce00640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcf81468a0 0x7fbcf8140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 -- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcf81468a0 msgr2=0x7fbcf8140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcf81468a0 0x7fbcf8140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 -- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcf81613d0 msgr2=0x7fbcf813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcf81613d0 0x7fbcf813faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 -- 172.21.15.39:0/3516780902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf813ccf0 con 0x7fbcf813c0e0 2024-04-26T23:27:45.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcfd800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00af040 tx=0x7fbcf0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00bc020 con 0x7fbcf813c0e0 2024-04-26T23:27:45.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf00b8670 con 0x7fbcf813c0e0 2024-04-26T23:27:45.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0009510 con 0x7fbcf813c0e0 2024-04-26T23:27:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf81f71e0 con 0x7fbcf813c0e0 2024-04-26T23:27:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81f77a0 con 0x7fbcf813c0e0 2024-04-26T23:27:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.343+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf8050740 con 0x7fbcf813c0e0 2024-04-26T23:27:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.347+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcf00bf020 con 0x7fbcf813c0e0 2024-04-26T23:27:45.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.347+0000 7fbcf4c00640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 0x7fbcd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.347+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4857+0+0 (secure 0 0 0) 0x7fbcf0121400 con 0x7fbcf813c0e0 2024-04-26T23:27:45.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.347+0000 7fbcfce00640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 0x7fbcd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.347+0000 7fbcfce00640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 0x7fbcd806a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80ce4d0 tx=0x7fbcec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.351+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbcf00c6030 con 0x7fbcf813c0e0 2024-04-26T23:27:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.519+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbcf8160620 con 0x7fbcf813c0e0 2024-04-26T23:27:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcf4c00640 1 -- 172.21.15.39:0/3516780902 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7fbcf813ccf0 con 0x7fbcf813c0e0 2024-04-26T23:27:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 msgr2=0x7fbcd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 0x7fbcd806a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80ce4d0 tx=0x7fbcec008040 comp rx=0 tx=0).stop 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 msgr2=0x7fbcf815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00af040 tx=0x7fbcf0019670 comp rx=0 tx=0).stop 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 shutdown_connections 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcd8068380 0x7fbcd806a840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcf813c0e0 0x7fbcf815b650 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcf81613d0 0x7fbcf813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 --2- 172.21.15.39:0/3516780902 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcf81468a0 0x7fbcf8140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 >> 172.21.15.39:0/3516780902 conn(0x7fbcf80b2cc0 msgr2=0x7fbcf8073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:45.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 shutdown_connections 2024-04-26T23:27:45.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.727+0000 7fbcff800640 1 -- 172.21.15.39:0/3516780902 wait complete. 2024-04-26T23:27:45.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:27:45.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 Processor -- start 2024-04-26T23:27:45.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 -- start start 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d4140170 0x7f43d415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43d40d18f0 0x7f43d40cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d406e500 con 0x7f43d415e340 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f43d406f110 con 0x7f43d40d18f0 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43da600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f43d406e7e0 con 0x7f43d4140170 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43d3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43d40d18f0 0x7f43d40cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43d3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43d40d18f0 0x7f43d40cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58260/0 (socket says 172.21.15.39:58260) 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43d3e00640 1 -- 172.21.15.39:0/3232563533 learned_addr learned my addr 172.21.15.39:0/3232563533 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:45.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.903+0000 7f43d3400640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d4140170 0x7f43d415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d3e00640 1 -- 172.21.15.39:0/3232563533 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d4140170 msgr2=0x7f43d415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d3e00640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d4140170 0x7f43d415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d3e00640 1 -- 172.21.15.39:0/3232563533 >> v1:172.21.15.71:6789/0 conn(0x7f43d415e340 legacy=0x7f43d40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d3e00640 1 -- 172.21.15.39:0/3232563533 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d406eac0 con 0x7f43d40d18f0 2024-04-26T23:27:45.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d3e00640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d40d18f0 0x7f43d40cf6f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009870 tx=0x7f43cc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241f78aa8bd8c923 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d2a00640 1 -- 172.21.15.39:0/3232563533 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0aa620 con 0x7f43d40d18f0 2024-04-26T23:27:45.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d2a00640 1 -- 172.21.15.39:0/3232563533 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc0af070 con 0x7f43d40d18f0 2024-04-26T23:27:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43d2a00640 1 -- 172.21.15.39:0/3232563533 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0aa9e0 con 0x7f43d40d18f0 2024-04-26T23:27:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43da600640 1 -- 172.21.15.39:0/3232563533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d40d18f0 msgr2=0x7f43d40cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.907+0000 7f43da600640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d40d18f0 0x7f43d40cf6f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009870 tx=0x7f43cc01c460 comp rx=0 tx=0).stop 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- 172.21.15.39:0/3232563533 shutdown_connections 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d40d18f0 0x7f43d40cf6f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 --2- 172.21.15.39:0/3232563533 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d4140170 0x7f43d415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- 172.21.15.39:0/3232563533 >> 172.21.15.39:0/3232563533 conn(0x7f43d406c7d0 msgr2=0x7f43d406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- 172.21.15.39:0/3232563533 shutdown_connections 2024-04-26T23:27:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- 172.21.15.39:0/3232563533 wait complete. 2024-04-26T23:27:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 Processor -- start 2024-04-26T23:27:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- start start 2024-04-26T23:27:45.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d40d18f0 0x7f43d4140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43d4140170 0x7f43d40aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43d40d07d0 con 0x7f43d415e340 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43d40d0650 con 0x7f43d4140170 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43da600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f43d40d0950 con 0x7f43d40d18f0 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d40d18f0 0x7f43d4140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58266/0 (socket says 172.21.15.39:58266) 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 -- 172.21.15.39:0/622567139 learned_addr learned my addr 172.21.15.39:0/622567139 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43caa00640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43d4140170 0x7f43d40aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 -- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d40d18f0 msgr2=0x7f43d4140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d40d18f0 0x7f43d4140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 -- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43d4140170 msgr2=0x7f43d40aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43d4140170 0x7f43d40aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 -- 172.21.15.39:0/622567139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d40aa980 con 0x7f43d415e340 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.911+0000 7f43d3e00640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0ac040 tx=0x7f43cc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0bd3f0 con 0x7f43d415e340 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc0bd5b0 con 0x7f43d415e340 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0bd9a0 con 0x7f43d415e340 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d4140ea0 con 0x7f43d415e340 2024-04-26T23:27:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d4141460 con 0x7f43d415e340 2024-04-26T23:27:45.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d406a720 con 0x7f43d415e340 2024-04-26T23:27:45.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43cc0b33f0 con 0x7f43d415e340 2024-04-26T23:27:45.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:45.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5227+0+0 (secure 0 0 0) 0x7f43cc120e20 con 0x7f43d415e340 2024-04-26T23:27:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.915+0000 7f43d3400640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.919+0000 7f43d3400640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 0x7f43b006a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f43d40735d0 tx=0x7f43c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:45.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:45.919+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f43cc016110 con 0x7f43d415e340 2024-04-26T23:27:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.087+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f43d4073320 con 0x7f43d415e340 2024-04-26T23:27:46.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43cbe00640 1 -- 172.21.15.39:0/622567139 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f43cc0f1000 con 0x7f43d415e340 2024-04-26T23:27:46.733 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-04-26T23:27:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 msgr2=0x7f43b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 0x7f43b006a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f43d40735d0 tx=0x7f43c400b040 comp rx=0 tx=0).stop 2024-04-26T23:27:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 msgr2=0x7f43d413ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0ac040 tx=0x7f43cc01aca0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 shutdown_connections 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d415e340 0x7f43d413ee90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43d4140170 0x7f43d40aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 --2- 172.21.15.39:0/622567139 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43d40d18f0 0x7f43d4140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.731+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 >> 172.21.15.39:0/622567139 conn(0x7f43d406c7d0 msgr2=0x7f43d40d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.735+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 shutdown_connections 2024-04-26T23:27:46.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.735+0000 7f43da600640 1 -- 172.21.15.39:0/622567139 wait complete. 2024-04-26T23:27:46.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:27:46.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 Processor -- start 2024-04-26T23:27:46.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 -- start start 2024-04-26T23:27:46.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbd8c0b12e0 0x7fbd8c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:46.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c0731a0 con 0x7fbd8c15f400 2024-04-26T23:27:46.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c073480 con 0x7fbd8c06c910 2024-04-26T23:27:46.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd91a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0d1cc0 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd83e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbd8c0b12e0 0x7fbd8c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd8aa00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbd8c15f400 0x7fbd8c0d15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49612/0 (socket says 172.21.15.39:49612) 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd8aa00640 1 -- 172.21.15.39:0/294329804 learned_addr learned my addr 172.21.15.39:0/294329804 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd83e00640 1 -- 172.21.15.39:0/294329804 >> v1:172.21.15.71:6789/0 conn(0x7fbd8c06c910 legacy=0x7fbd8c0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd83e00640 1 -- 172.21.15.39:0/294329804 >> v1:172.21.15.39:6789/0 conn(0x7fbd8c15f400 legacy=0x7fbd8c0d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd8a000640 1 -- 172.21.15.39:0/294329804 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921151443 0 0) 0x7fbd8c0731a0 con 0x7fbd8c15f400 2024-04-26T23:27:46.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.919+0000 7fbd83e00640 1 -- 172.21.15.39:0/294329804 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c073760 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd83e00640 1 --2- 172.21.15.39:0/294329804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c06c3d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097c0 tx=0x7fbd7401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc50805220f21db4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:46.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd8a000640 1 -- 172.21.15.39:0/294329804 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740b0070 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd8a000640 1 -- 172.21.15.39:0/294329804 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740ab600 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd8a000640 1 -- 172.21.15.39:0/294329804 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ab9d0 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 -- 172.21.15.39:0/294329804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c0b12e0 msgr2=0x7fbd8c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 --2- 172.21.15.39:0/294329804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c06c3d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097c0 tx=0x7fbd7401c410 comp rx=0 tx=0).stop 2024-04-26T23:27:46.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 -- 172.21.15.39:0/294329804 shutdown_connections 2024-04-26T23:27:46.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 --2- 172.21.15.39:0/294329804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c06c3d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 -- 172.21.15.39:0/294329804 >> 172.21.15.39:0/294329804 conn(0x7fbd8c0d1f30 msgr2=0x7fbd8c0d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:46.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 -- 172.21.15.39:0/294329804 shutdown_connections 2024-04-26T23:27:46.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.923+0000 7fbd91a00640 1 -- 172.21.15.39:0/294329804 wait complete. 2024-04-26T23:27:46.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 Processor -- start 2024-04-26T23:27:46.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- start start 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c06c910 0x7fbd8c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0d0fc0 con 0x7fbd8c15f400 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0d0e40 con 0x7fbd8c0b12e0 2024-04-26T23:27:46.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c0d1140 con 0x7fbd8c06c910 2024-04-26T23:27:46.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:46.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58286/0 (socket says 172.21.15.39:58286) 2024-04-26T23:27:46.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 -- 172.21.15.39:0/1824049102 learned_addr learned my addr 172.21.15.39:0/1824049102 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8aa00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c06c910 0x7fbd8c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd83e00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 -- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c06c910 msgr2=0x7fbd8c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c06c910 0x7fbd8c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 -- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd8c0b12e0 msgr2=0x7fbd8c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 -- 172.21.15.39:0/1824049102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c161a90 con 0x7fbd8c15f400 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd8b400640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c7a0 tx=0x7fbd8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84003b80 con 0x7fbd8c15f400 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd84003d20 con 0x7fbd8c15f400 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c161d70 con 0x7fbd8c15f400 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400aa90 con 0x7fbd8c15f400 2024-04-26T23:27:46.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.927+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c156930 con 0x7fbd8c15f400 2024-04-26T23:27:46.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c06a720 con 0x7fbd8c15f400 2024-04-26T23:27:46.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd8400ac30 con 0x7fbd8c15f400 2024-04-26T23:27:46.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd82a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 0x7fbd6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:46.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5609+0+0 (secure 0 0 0) 0x7fbd84086830 con 0x7fbd8c15f400 2024-04-26T23:27:46.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd8aa00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 0x7fbd6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:46.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.931+0000 7fbd8aa00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 0x7fbd6806a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0010f0 tx=0x7fbd7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:46.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:46.935+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd840566d0 con 0x7fbd8c15f400 2024-04-26T23:27:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.139+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbd8c0cb680 con 0x7fbd8c15f400 2024-04-26T23:27:47.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.759+0000 7fbd82a00640 1 -- 172.21.15.39:0/1824049102 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) ==== 172+0+0 (secure 0 0 0) 0x7fbd8405a9d0 con 0x7fbd8c15f400 2024-04-26T23:27:47.768 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 8 and data pool 9 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.771+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 msgr2=0x7fbd6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.771+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 0x7fbd6806a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0010f0 tx=0x7fbd7c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.771+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 msgr2=0x7fbd8c0c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.771+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c7a0 tx=0x7fbd8400cc60 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 shutdown_connections 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbd680683b0 0x7fbd6806a870 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd8c15f400 0x7fbd8c0c79d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd8c0b12e0 0x7fbd8c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 --2- 172.21.15.39:0/1824049102 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c06c910 0x7fbd8c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 >> 172.21.15.39:0/1824049102 conn(0x7fbd8c0d1f30 msgr2=0x7fbd8c156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:47.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 shutdown_connections 2024-04-26T23:27:47.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.775+0000 7fbd91a00640 1 -- 172.21.15.39:0/1824049102 wait complete. 2024-04-26T23:27:47.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:47.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.947+0000 7fd2b4200640 1 Processor -- start 2024-04-26T23:27:47.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.947+0000 7fd2b4200640 1 -- start start 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.947+0000 7fd2b4200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2ac15f340 0x7fd2ac0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b4200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b4200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0cd810 con 0x7fd2ac15f720 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b4200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0d26a0 con 0x7fd2ac0b5710 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b4200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0ce140 con 0x7fd2ac15f340 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58288/0 (socket says 172.21.15.39:58288) 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 -- 172.21.15.39:0/2443303964 learned_addr learned my addr 172.21.15.39:0/2443303964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b1800640 1 --2- 172.21.15.39:0/2443303964 >> v2:172.21.15.71:3300/0 conn(0x7fd2ac15f340 0x7fd2ac0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 -- 172.21.15.39:0/2443303964 >> v2:172.21.15.71:3300/0 conn(0x7fd2ac15f340 msgr2=0x7fd2ac0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 --2- 172.21.15.39:0/2443303964 >> v2:172.21.15.71:3300/0 conn(0x7fd2ac15f340 0x7fd2ac0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 -- 172.21.15.39:0/2443303964 >> v1:172.21.15.71:6789/0 conn(0x7fd2ac15f720 legacy=0x7fd2ac0b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:47.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 -- 172.21.15.39:0/2443303964 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0cdaf0 con 0x7fd2ac0b5710 2024-04-26T23:27:47.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2b0e00640 1 --2- 172.21.15.39:0/2443303964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac074870 tx=0x7fd29801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e47e6a5ebd0f4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:47.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2abe00640 1 -- 172.21.15.39:0/2443303964 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b0070 con 0x7fd2ac0b5710 2024-04-26T23:27:47.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2abe00640 1 -- 172.21.15.39:0/2443303964 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2980ab600 con 0x7fd2ac0b5710 2024-04-26T23:27:47.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.951+0000 7fd2abe00640 1 -- 172.21.15.39:0/2443303964 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980ab9d0 con 0x7fd2ac0b5710 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- 172.21.15.39:0/2443303964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac0b5710 msgr2=0x7fd2ac09b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- 172.21.15.39:0/2443303964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac074870 tx=0x7fd29801c420 comp rx=0 tx=0).stop 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- 172.21.15.39:0/2443303964 shutdown_connections 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- 172.21.15.39:0/2443303964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac0b5710 0x7fd2ac09b9e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- 172.21.15.39:0/2443303964 >> v2:172.21.15.71:3300/0 conn(0x7fd2ac15f340 0x7fd2ac0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- 172.21.15.39:0/2443303964 >> 172.21.15.39:0/2443303964 conn(0x7fd2ac0b4b80 msgr2=0x7fd2ac0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- 172.21.15.39:0/2443303964 shutdown_connections 2024-04-26T23:27:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- 172.21.15.39:0/2443303964 wait complete. 2024-04-26T23:27:47.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 Processor -- start 2024-04-26T23:27:47.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- start start 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 0x7fd2ac153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 0x7fd2ac160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2ac15f720 0x7fd2ac156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b8f40 con 0x7fd2ac15f340 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b8dc0 con 0x7fd2ac15f720 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b4200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0cedc0 con 0x7fd2ac0b5710 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 0x7fd2ac160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b1800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 0x7fd2ac153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b2200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2ac15f720 0x7fd2ac156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b1800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 0x7fd2ac153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:43474/0 (socket says 172.21.15.39:43474) 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b1800640 1 -- 172.21.15.39:0/1823077709 learned_addr learned my addr 172.21.15.39:0/1823077709 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 -- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 msgr2=0x7fd2ac153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 0x7fd2ac153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 -- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2ac15f720 msgr2=0x7fd2ac156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2ac15f720 0x7fd2ac156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.955+0000 7fd2b0e00640 1 -- 172.21.15.39:0/1823077709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac154010 con 0x7fd2ac15f340 2024-04-26T23:27:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2b0e00640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 0x7fd2ac160e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2980ab000 tx=0x7fd2980191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980bb070 con 0x7fd2ac15f340 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2980b6430 con 0x7fd2ac15f340 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b0040 con 0x7fd2ac15f340 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac1542f0 con 0x7fd2ac15f340 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac1548b0 con 0x7fd2ac15f340 2024-04-26T23:27:47.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac050740 con 0x7fd2ac15f340 2024-04-26T23:27:47.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2980b53d0 con 0x7fd2ac15f340 2024-04-26T23:27:47.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.959+0000 7fd2a9600640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 0x7fd28c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:47.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.963+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7fd298120080 con 0x7fd2ac15f340 2024-04-26T23:27:47.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.963+0000 7fd2b1800640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 0x7fd28c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:47.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.963+0000 7fd2b1800640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 0x7fd28c06a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac155f70 tx=0x7fd2a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:47.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:47.967+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd2980160d0 con 0x7fd2ac15f340 2024-04-26T23:27:48.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.131+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2ac06edf0 con 0x7fd2ac15f340 2024-04-26T23:27:48.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.131+0000 7fd2a9600640 1 -- 172.21.15.39:0/1823077709 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16618 (secure 0 0 0) 0x7fd2980efff0 con 0x7fd2ac15f340 2024-04-26T23:27:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:48.135 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":50,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:47.140357+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 msgr2=0x7fd28c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 0x7fd28c06a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac155f70 tx=0x7fd2a0008040 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 msgr2=0x7fd2ac160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 0x7fd2ac160e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2980ab000 tx=0x7fd2980191c0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 shutdown_connections 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd28c068380 0x7fd28c06a840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2ac15f720 0x7fd2ac156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2ac15f340 0x7fd2ac160e70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 --2- 172.21.15.39:0/1823077709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd2ac0b5710 0x7fd2ac153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 >> 172.21.15.39:0/1823077709 conn(0x7fd2ac0b4b80 msgr2=0x7fd2ac0b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 shutdown_connections 2024-04-26T23:27:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.135+0000 7fd2b4200640 1 -- 172.21.15.39:0/1823077709 wait complete. 2024-04-26T23:27:48.157 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 Processor -- start 2024-04-26T23:27:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 -- start start 2024-04-26T23:27:48.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f91380742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91380d0550 con 0x7f91380cdbf0 2024-04-26T23:27:48.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91380d0830 con 0x7f91380cfe00 2024-04-26T23:27:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f913da00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91380d0b10 con 0x7f91380cd810 2024-04-26T23:27:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9137400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f91380cdbf0 0x7f913806ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49620/0 (socket says 172.21.15.39:49620) 2024-04-26T23:27:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9137400640 1 -- 172.21.15.39:0/2946267840 learned_addr learned my addr 172.21.15.39:0/2946267840 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9136a00640 1 --2- 172.21.15.39:0/2946267840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f91380742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501388743 0 0) 0x7f91380d0550 con 0x7f91380cdbf0 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f911c003530 con 0x7f91380cdbf0 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.295+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764161058 0 0) 0x7f91380d0830 con 0x7f91380cfe00 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91380d0550 con 0x7f91380cfe00 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136a00640 1 -- 172.21.15.39:0/2946267840 >> v1:172.21.15.71:6789/0 conn(0x7f91380cfe00 legacy=0x7f9138144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136a00640 1 -- 172.21.15.39:0/2946267840 >> v1:172.21.15.39:6789/0 conn(0x7f91380cdbf0 legacy=0x7f913806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136a00640 1 -- 172.21.15.39:0/2946267840 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913806e600 con 0x7f91380cd810 2024-04-26T23:27:48.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136a00640 1 --2- 172.21.15.39:0/2946267840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f91380742f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91280097f0 tx=0x7f912801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9c671c97fb0c01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280b2070 con 0x7f91380cd810 2024-04-26T23:27:48.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91280a9070 con 0x7f91380cd810 2024-04-26T23:27:48.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f9136000640 1 -- 172.21.15.39:0/2946267840 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280ad860 con 0x7f91380cd810 2024-04-26T23:27:48.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f913da00640 1 -- 172.21.15.39:0/2946267840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 msgr2=0x7f91380742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.299+0000 7f913da00640 1 --2- 172.21.15.39:0/2946267840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f91380742f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91280097f0 tx=0x7f912801c450 comp rx=0 tx=0).stop 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- 172.21.15.39:0/2946267840 shutdown_connections 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 --2- 172.21.15.39:0/2946267840 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f91380742f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- 172.21.15.39:0/2946267840 >> 172.21.15.39:0/2946267840 conn(0x7f91380b2af0 msgr2=0x7f91380b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- 172.21.15.39:0/2946267840 shutdown_connections 2024-04-26T23:27:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- 172.21.15.39:0/2946267840 wait complete. 2024-04-26T23:27:48.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 Processor -- start 2024-04-26T23:27:48.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- start start 2024-04-26T23:27:48.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f9138140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91380cdbf0 0x7f9138153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9138143d30 con 0x7f91380cfe00 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9138143bb0 con 0x7f91380cdbf0 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f913da00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f913816b710 con 0x7f91380cd810 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58298/0 (socket says 172.21.15.39:58298) 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 -- 172.21.15.39:0/1060090964 learned_addr learned my addr 172.21.15.39:0/1060090964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9136a00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f9138140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f912e000640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91380cdbf0 0x7f9138153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 -- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 msgr2=0x7f9138140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f9138140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 -- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91380cdbf0 msgr2=0x7f9138153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91380cdbf0 0x7f9138153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 -- 172.21.15.39:0/1060090964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91380726a0 con 0x7f91380cfe00 2024-04-26T23:27:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f9137400640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f913000cba0 tx=0x7f913000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.303+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130017070 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913000ace0 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913815f9e0 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130012620 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91380ca310 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913815ff00 con 0x7f91380cfe00 2024-04-26T23:27:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f913001a070 con 0x7f91380cfe00 2024-04-26T23:27:48.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f912f400640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 0x7f911406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f9130086870 con 0x7f91380cfe00 2024-04-26T23:27:48.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.307+0000 7f9136a00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 0x7f911406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.311+0000 7f9136a00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 0x7f911406a840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91280af000 tx=0x7f91280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.311+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f913815ff00 con 0x7f91380cfe00 2024-04-26T23:27:48.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.483+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9138050740 con 0x7f91380cfe00 2024-04-26T23:27:48.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.483+0000 7f912f400640 1 -- 172.21.15.39:0/1060090964 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16618 (secure 0 0 0) 0x7f9130056d90 con 0x7f91380cfe00 2024-04-26T23:27:48.487 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:48.487 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":50,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:47.140357+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 msgr2=0x7f911406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 0x7f911406a840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91280af000 tx=0x7f91280a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 msgr2=0x7f91381540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f913000cba0 tx=0x7f913000a430 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 shutdown_connections 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9114068380 0x7f911406a840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91380cfe00 0x7f91381540f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91380cdbf0 0x7f9138153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 --2- 172.21.15.39:0/1060090964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91380cd810 0x7f9138140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 >> 172.21.15.39:0/1060090964 conn(0x7f91380b2af0 msgr2=0x7f9138158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:48.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 shutdown_connections 2024-04-26T23:27:48.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.487+0000 7f913da00640 1 -- 172.21.15.39:0/1060090964 wait complete. 2024-04-26T23:27:48.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 Processor -- start 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 -- start start 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 0x7f544c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c06e500 con 0x7f544c140170 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f544c06f110 con 0x7f544c0d1720 2024-04-26T23:27:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5454400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f544c06e7e0 con 0x7f544c161850 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:43492/0 (socket says 172.21.15.39:43492) 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 -- 172.21.15.39:0/2234243089 learned_addr learned my addr 172.21.15.39:0/2234243089 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5452400640 1 --2- 172.21.15.39:0/2234243089 >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 0x7f544c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451a00640 1 --1- 172.21.15.39:0/2234243089 >> v1:172.21.15.71:6789/0 conn(0x7f544c140170 0x7f544c15de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:54608/0 (socket says 172.21.15.39:54608) 2024-04-26T23:27:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f544be00640 1 -- 172.21.15.39:0/2234243089 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149705434 0 0) 0x7f544c06e500 con 0x7f544c140170 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f544be00640 1 -- 172.21.15.39:0/2234243089 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5434003530 con 0x7f544c140170 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 -- 172.21.15.39:0/2234243089 >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 msgr2=0x7f544c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 --2- 172.21.15.39:0/2234243089 >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 0x7f544c0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 -- 172.21.15.39:0/2234243089 >> v1:172.21.15.71:6789/0 conn(0x7f544c140170 legacy=0x7f544c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5451000640 1 -- 172.21.15.39:0/2234243089 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c06eac0 con 0x7f544c161850 2024-04-26T23:27:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.651+0000 7f5452400640 1 --2- 172.21.15.39:0/2234243089 >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 0x7f544c0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:48.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5451000640 1 --2- 172.21.15.39:0/2234243089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5438009870 tx=0x7f543801cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a857a7598413bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f544be00640 1 -- 172.21.15.39:0/2234243089 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380a7070 con 0x7f544c161850 2024-04-26T23:27:48.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f544be00640 1 -- 172.21.15.39:0/2234243089 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54380b0070 con 0x7f544c161850 2024-04-26T23:27:48.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f544be00640 1 -- 172.21.15.39:0/2234243089 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380ab890 con 0x7f544c161850 2024-04-26T23:27:48.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 -- 172.21.15.39:0/2234243089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 msgr2=0x7f544c0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 --2- 172.21.15.39:0/2234243089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5438009870 tx=0x7f543801cf80 comp rx=0 tx=0).stop 2024-04-26T23:27:48.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 -- 172.21.15.39:0/2234243089 shutdown_connections 2024-04-26T23:27:48.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 --2- 172.21.15.39:0/2234243089 >> v2:172.21.15.71:3300/0 conn(0x7f544c0d1720 0x7f544c0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 --2- 172.21.15.39:0/2234243089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c0d11e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 -- 172.21.15.39:0/2234243089 >> 172.21.15.39:0/2234243089 conn(0x7f544c06c7d0 msgr2=0x7f544c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:48.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 -- 172.21.15.39:0/2234243089 shutdown_connections 2024-04-26T23:27:48.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.655+0000 7f5454400640 1 -- 172.21.15.39:0/2234243089 wait complete. 2024-04-26T23:27:48.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 Processor -- start 2024-04-26T23:27:48.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- start start 2024-04-26T23:27:48.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f544c140170 0x7f544c142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f544c0d07d0 con 0x7f544c0d1720 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f544c0d0650 con 0x7f544c140170 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f544c0d0950 con 0x7f544c161850 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58302/0 (socket says 172.21.15.39:58302) 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 -- 172.21.15.39:0/1271824366 learned_addr learned my addr 172.21.15.39:0/1271824366 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5452400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451000640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f544c140170 0x7f544c142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 -- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 msgr2=0x7f544c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 -- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f544c140170 msgr2=0x7f544c142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f544c140170 0x7f544c142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:48.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 -- 172.21.15.39:0/1271824366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c15cb30 con 0x7f544c0d1720 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5451a00640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f544000c430 tx=0x7f544000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400074e0 con 0x7f544c0d1720 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54400047f0 con 0x7f544c0d1720 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400076a0 con 0x7f544c0d1720 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544c141c10 con 0x7f544c0d1720 2024-04-26T23:27:48.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f544c1421d0 con 0x7f544c0d1720 2024-04-26T23:27:48.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.659+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544c06a720 con 0x7f544c0d1720 2024-04-26T23:27:48.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.663+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f544001a020 con 0x7f544c0d1720 2024-04-26T23:27:48.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.663+0000 7f5449600640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 0x7f542c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:48.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.663+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f5440086290 con 0x7f544c0d1720 2024-04-26T23:27:48.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.663+0000 7f5451000640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 0x7f542c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:48.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.663+0000 7f5451000640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 0x7f542c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54380af000 tx=0x7f5438004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:48.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.667+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f544c15cb30 con 0x7f544c0d1720 2024-04-26T23:27:48.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:48.871+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f544c06fdc0 con 0x7f544c0d1720 2024-04-26T23:27:49.723 INFO:tasks.ceph.mds.a.smithi039.stderr:2024-04-26T23:27:49.719+0000 7f9471800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:27:49.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.771+0000 7f5449600640 1 -- 172.21.15.39:0/1271824366 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f5440056850 con 0x7f544c0d1720 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 msgr2=0x7f542c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 0x7f542c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54380af000 tx=0x7f5438004740 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 msgr2=0x7f544c141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f544000c430 tx=0x7f544000c8f0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 shutdown_connections 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f542c068380 0x7f542c06a840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f544c161850 0x7f544c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f544c140170 0x7f544c142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 --2- 172.21.15.39:0/1271824366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f544c0d1720 0x7f544c141630 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 >> 172.21.15.39:0/1271824366 conn(0x7f544c06c7d0 msgr2=0x7f544c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 shutdown_connections 2024-04-26T23:27:49.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.775+0000 7f5454400640 1 -- 172.21.15.39:0/1271824366 wait complete. 2024-04-26T23:27:49.801 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:27:49.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:27:49.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.943+0000 7fd122a00640 1 Processor -- start 2024-04-26T23:27:49.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.943+0000 7fd122a00640 1 -- start start 2024-04-26T23:27:49.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd122a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd11c072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd122a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd11c072e50 0x7fd11c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd122a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd11c072180 con 0x7fd11c1458d0 2024-04-26T23:27:49.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd122a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd11c0739a0 con 0x7fd11c072e50 2024-04-26T23:27:49.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd122a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c073c80 con 0x7fd11c073400 2024-04-26T23:27:49.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd11c1458d0 0x7fd11c0b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49630/0 (socket says 172.21.15.39:49630) 2024-04-26T23:27:49.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11be00640 1 -- 172.21.15.39:0/640053157 learned_addr learned my addr 172.21.15.39:0/640053157 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd120a00640 1 --2- 172.21.15.39:0/640053157 >> v2:172.21.15.71:3300/0 conn(0x7fd11c072e50 0x7fd11c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd11c072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271086007 0 0) 0x7fd11c072180 con 0x7fd11c1458d0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd100005740 con 0x7fd11c1458d0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474435611 0 0) 0x7fd100005740 con 0x7fd11c1458d0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 msgr2=0x7fd11c072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd11c072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 >> v2:172.21.15.71:3300/0 conn(0x7fd11c072e50 msgr2=0x7fd11c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 --2- 172.21.15.39:0/640053157 >> v2:172.21.15.71:3300/0 conn(0x7fd11c072e50 0x7fd11c0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c145cb0 con 0x7fd11c1458d0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fd10c001680 con 0x7fd11c1458d0 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd11c072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd120a00640 1 --2- 172.21.15.39:0/640053157 >> v2:172.21.15.71:3300/0 conn(0x7fd11c072e50 0x7fd11c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 >> v1:172.21.15.39:6789/0 conn(0x7fd11c1458d0 legacy=0x7fd11c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd100005bd0 0x7fd100005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd100006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd1000073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c0739a0 con 0x7fd100006a20 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c073c80 con 0x7fd100005bd0 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd10000dbe0 con 0x7fd11c073400 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd100006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd11be00640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd100005bd0 0x7fd100005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd120a00640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd1000073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 -- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 msgr2=0x7fd1000073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c073400 0x7fd1000073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 -- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd100005bd0 msgr2=0x7fd100005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:49.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd100005bd0 0x7fd100005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.947+0000 7fd113400640 1 -- 172.21.15.39:0/640053157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd100005740 con 0x7fd100006a20 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd113400640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd100006ea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd104009cb0 tx=0x7fd10401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb91a3543eb45bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1040b2070 con 0x7fd100006a20 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c0cef30 con 0x7fd100006a20 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd11b400640 1 -- 172.21.15.39:0/640053157 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104009880 con 0x7fd100006a20 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 -- 172.21.15.39:0/640053157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 msgr2=0x7fd100006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 --2- 172.21.15.39:0/640053157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd100006ea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd104009cb0 tx=0x7fd10401cc10 comp rx=0 tx=0).stop 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd120a00640 1 -- 172.21.15.39:0/640053157 reap_dead start 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 -- 172.21.15.39:0/640053157 shutdown_connections 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 -- 172.21.15.39:0/640053157 >> 172.21.15.39:0/640053157 conn(0x7fd11c06c7d0 msgr2=0x7fd11c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 -- 172.21.15.39:0/640053157 shutdown_connections 2024-04-26T23:27:49.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.951+0000 7fd122a00640 1 -- 172.21.15.39:0/640053157 wait complete. 2024-04-26T23:27:49.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 Processor -- start 2024-04-26T23:27:49.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- start start 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11c0b2200 0x7fd11c13d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 0x7fd11c160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c06ee80 con 0x7fd100006a20 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c073260 con 0x7fd11c0b2200 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c06f000 con 0x7fd11c159910 2024-04-26T23:27:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58330/0 (socket says 172.21.15.39:58330) 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 -- 172.21.15.39:0/726834475 learned_addr learned my addr 172.21.15.39:0/726834475 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd120a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 0x7fd11c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd113400640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11c0b2200 0x7fd11c13d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 -- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 msgr2=0x7fd11c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 0x7fd11c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 -- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11c0b2200 msgr2=0x7fd11c13d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11c0b2200 0x7fd11c13d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 -- 172.21.15.39:0/726834475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c13db80 con 0x7fd100006a20 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd120a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 0x7fd11c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:49.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd11be00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007290 tx=0x7fd10c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:49.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00f8e0 con 0x7fd100006a20 2024-04-26T23:27:49.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c018070 con 0x7fd100006a20 2024-04-26T23:27:49.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c13de60 con 0x7fd100006a20 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00fce0 con 0x7fd100006a20 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c15b1a0 con 0x7fd100006a20 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.955+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c06a720 con 0x7fd100006a20 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.959+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd10c01d460 con 0x7fd100006a20 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.959+0000 7fd118c00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 0x7fd0f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:49.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.959+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fd10c086aa0 con 0x7fd100006a20 2024-04-26T23:27:49.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.959+0000 7fd113400640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 0x7fd0f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:49.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.959+0000 7fd113400640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 0x7fd0f806a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd1040af000 tx=0x7fd1040046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:49.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:49.963+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd10c057060 con 0x7fd100006a20 2024-04-26T23:27:50.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.163+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd11c0b50b0 con 0x7fd100006a20 2024-04-26T23:27:50.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.775+0000 7fd118c00640 1 -- 172.21.15.39:0/726834475 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fd10c056960 con 0x7fd100006a20 2024-04-26T23:27:50.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 msgr2=0x7fd0f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 0x7fd0f806a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd1040af000 tx=0x7fd1040046d0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 msgr2=0x7fd11c15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007290 tx=0x7fd10c007750 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 shutdown_connections 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd0f8068380 0x7fd0f806a840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd11c159910 0x7fd11c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11c0b2200 0x7fd11c13d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 --2- 172.21.15.39:0/726834475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd100006a20 0x7fd11c15b6c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 >> 172.21.15.39:0/726834475 conn(0x7fd11c06c7d0 msgr2=0x7fd11c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 shutdown_connections 2024-04-26T23:27:50.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.779+0000 7fd122a00640 1 -- 172.21.15.39:0/726834475 wait complete. 2024-04-26T23:27:50.802 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:27:50.802 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:50.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.939+0000 7f24a9a00640 1 Processor -- start 2024-04-26T23:27:50.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.939+0000 7f24a9a00640 1 -- start start 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a9a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f24a4145820 0x7f24a40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a9a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f24a406fc80 0x7f24a40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a9a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a4160060 con 0x7f24a40b4950 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a9a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f24a40cd5c0 con 0x7f24a4145820 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a9a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f24a4160340 con 0x7f24a406fc80 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f24a4145820 0x7f24a40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f24a4145820 0x7f24a40cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54818/0 (socket says 172.21.15.39:54818) 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 -- 172.21.15.39:0/3430206787 learned_addr learned my addr 172.21.15.39:0/3430206787 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a3400640 1 --2- 172.21.15.39:0/3430206787 >> v2:172.21.15.71:3300/0 conn(0x7f24a406fc80 0x7f24a40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 -- 172.21.15.39:0/3430206787 >> v2:172.21.15.71:3300/0 conn(0x7f24a406fc80 msgr2=0x7f24a40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:50.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 --2- 172.21.15.39:0/3430206787 >> v2:172.21.15.71:3300/0 conn(0x7f24a406fc80 0x7f24a40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 -- 172.21.15.39:0/3430206787 >> v1:172.21.15.71:6789/0 conn(0x7f24a40b4950 legacy=0x7f24a406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.943+0000 7f24a2a00640 1 -- 172.21.15.39:0/3430206787 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a4160620 con 0x7f24a4145820 2024-04-26T23:27:50.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a2a00640 1 --2- 172.21.15.39:0/3430206787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a40cf2a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2494009870 tx=0x7f249401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a22b402d026f4ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a2000640 1 -- 172.21.15.39:0/3430206787 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa670 con 0x7f24a4145820 2024-04-26T23:27:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a2000640 1 -- 172.21.15.39:0/3430206787 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24940af070 con 0x7f24a4145820 2024-04-26T23:27:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a2000640 1 -- 172.21.15.39:0/3430206787 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940aaa30 con 0x7f24a4145820 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- 172.21.15.39:0/3430206787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 msgr2=0x7f24a40cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 --2- 172.21.15.39:0/3430206787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a40cf2a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2494009870 tx=0x7f249401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- 172.21.15.39:0/3430206787 shutdown_connections 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 --2- 172.21.15.39:0/3430206787 >> v2:172.21.15.71:3300/0 conn(0x7f24a406fc80 0x7f24a40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 --2- 172.21.15.39:0/3430206787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a40cf2a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- 172.21.15.39:0/3430206787 >> 172.21.15.39:0/3430206787 conn(0x7f24a40b2af0 msgr2=0x7f24a40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- 172.21.15.39:0/3430206787 shutdown_connections 2024-04-26T23:27:50.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- 172.21.15.39:0/3430206787 wait complete. 2024-04-26T23:27:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 Processor -- start 2024-04-26T23:27:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.947+0000 7f24a9a00640 1 -- start start 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a406fc80 0x7f24a40722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24a40b4950 0x7f24a413b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f24a40ce260 con 0x7f24a4145820 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24a415fe40 con 0x7f24a406fc80 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f24a40ce3e0 con 0x7f24a40b4950 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54828/0 (socket says 172.21.15.39:54828) 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 -- 172.21.15.39:0/1950452472 learned_addr learned my addr 172.21.15.39:0/1950452472 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a2a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a406fc80 0x7f24a40722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f249a000640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24a40b4950 0x7f24a413b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 -- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24a40b4950 msgr2=0x7f24a413b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24a40b4950 0x7f24a413b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 -- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a406fc80 msgr2=0x7f24a40722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a406fc80 0x7f24a40722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 -- 172.21.15.39:0/1950452472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a40d0d10 con 0x7f24a4145820 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a3400640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f249c007e10 tx=0x7f249c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c014620 con 0x7f24a4145820 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c019070 con 0x7f24a4145820 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a40d0ff0 con 0x7f24a4145820 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c014a20 con 0x7f24a4145820 2024-04-26T23:27:50.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a40d15b0 con 0x7f24a4145820 2024-04-26T23:27:50.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4050740 con 0x7f24a4145820 2024-04-26T23:27:50.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.951+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f249c014bc0 con 0x7f24a4145820 2024-04-26T23:27:50.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.955+0000 7f249b400640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 0x7f248006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:50.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.955+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f249c087140 con 0x7f24a4145820 2024-04-26T23:27:50.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.955+0000 7f24a2a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 0x7f248006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:50.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.955+0000 7f24a2a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 0x7f248006a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:50.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:50.959+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f249c0570a0 con 0x7f24a4145820 2024-04-26T23:27:51.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.155+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a4145050 con 0x7f24a4145820 2024-04-26T23:27:51.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.155+0000 7f249b400640 1 -- 172.21.15.39:0/1950452472 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5178 (secure 0 0 0) 0x7f249c05b3a0 con 0x7f24a4145820 2024-04-26T23:27:51.159 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:51.160 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:27:51.160 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-04-26T23:27:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 msgr2=0x7f248006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 0x7f248006a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 msgr2=0x7f24a4140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f249c007e10 tx=0x7f249c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 shutdown_connections 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2480068380 0x7f248006a840 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24a4145820 0x7f24a4140730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24a40b4950 0x7f24a413b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 --2- 172.21.15.39:0/1950452472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a406fc80 0x7f24a40722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 >> 172.21.15.39:0/1950452472 conn(0x7f24a40b2af0 msgr2=0x7f24a415ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 shutdown_connections 2024-04-26T23:27:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.159+0000 7f24a9a00640 1 -- 172.21.15.39:0/1950452472 wait complete. 2024-04-26T23:27:51.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:27:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 Processor -- start 2024-04-26T23:27:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 -- start start 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1c4c0742f0 0x7f1c4c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1c4c0cdbf0 0x7f1c4c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c074750 con 0x7f1c4c0cd810 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1c4c0d0b10 con 0x7f1c4c0742f0 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c51e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1c4c06e970 con 0x7f1c4c0cdbf0 2024-04-26T23:27:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4aa00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1c4c0cd810 0x7f1c4c144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56840/0 (socket says 172.21.15.39:56840) 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4aa00640 1 -- 172.21.15.39:0/2821338434 learned_addr learned my addr 172.21.15.39:0/2821338434 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4a000640 1 --2- 172.21.15.39:0/2821338434 >> v2:172.21.15.39:3300/0 conn(0x7f1c4c0742f0 0x7f1c4c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4b400640 1 --2- 172.21.15.39:0/2821338434 >> v2:172.21.15.71:3300/0 conn(0x7f1c4c0cdbf0 0x7f1c4c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c49600640 1 -- 172.21.15.39:0/2821338434 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593106803 0 0) 0x7f1c4c074750 con 0x7f1c4c0cd810 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c49600640 1 -- 172.21.15.39:0/2821338434 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003530 con 0x7f1c4c0cd810 2024-04-26T23:27:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4a000640 1 -- 172.21.15.39:0/2821338434 >> v2:172.21.15.71:3300/0 conn(0x7f1c4c0cdbf0 msgr2=0x7f1c4c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4a000640 1 --2- 172.21.15.39:0/2821338434 >> v2:172.21.15.71:3300/0 conn(0x7f1c4c0cdbf0 0x7f1c4c06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4a000640 1 -- 172.21.15.39:0/2821338434 >> v1:172.21.15.39:6789/0 conn(0x7f1c4c0cd810 legacy=0x7f1c4c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.319+0000 7f1c4a000640 1 -- 172.21.15.39:0/2821338434 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c0d0550 con 0x7f1c4c0742f0 2024-04-26T23:27:51.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c4a000640 1 --2- 172.21.15.39:0/2821338434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c0cfe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0719c0 tx=0x7f1c3801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b734066a946130e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c49600640 1 -- 172.21.15.39:0/2821338434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380b0070 con 0x7f1c4c0742f0 2024-04-26T23:27:51.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c49600640 1 -- 172.21.15.39:0/2821338434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c380ab600 con 0x7f1c4c0742f0 2024-04-26T23:27:51.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c49600640 1 -- 172.21.15.39:0/2821338434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380ab9d0 con 0x7f1c4c0742f0 2024-04-26T23:27:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 -- 172.21.15.39:0/2821338434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0742f0 msgr2=0x7f1c4c0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 --2- 172.21.15.39:0/2821338434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c0cfe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0719c0 tx=0x7f1c3801c330 comp rx=0 tx=0).stop 2024-04-26T23:27:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 -- 172.21.15.39:0/2821338434 shutdown_connections 2024-04-26T23:27:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 --2- 172.21.15.39:0/2821338434 >> v2:172.21.15.71:3300/0 conn(0x7f1c4c0cdbf0 0x7f1c4c06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 --2- 172.21.15.39:0/2821338434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c0cfe00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 -- 172.21.15.39:0/2821338434 >> 172.21.15.39:0/2821338434 conn(0x7f1c4c0b2af0 msgr2=0x7f1c4c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 -- 172.21.15.39:0/2821338434 shutdown_connections 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.323+0000 7f1c51e00640 1 -- 172.21.15.39:0/2821338434 wait complete. 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 Processor -- start 2024-04-26T23:27:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- start start 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c4c0cdbf0 0x7f1c4c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c143d30 con 0x7f1c4c0cd810 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c143bb0 con 0x7f1c4c0742f0 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c169ef0 con 0x7f1c4c0cdbf0 2024-04-26T23:27:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54846/0 (socket says 172.21.15.39:54846) 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 -- 172.21.15.39:0/235623321 learned_addr learned my addr 172.21.15.39:0/235623321 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4b400640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c4c0cdbf0 0x7f1c4c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4aa00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c13e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 -- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c4c0cdbf0 msgr2=0x7f1c4c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c4c0cdbf0 0x7f1c4c159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 -- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0742f0 msgr2=0x7f1c4c13e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c13e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 -- 172.21.15.39:0/235623321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c15eb60 con 0x7f1c4c0cd810 2024-04-26T23:27:51.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c4a000640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c38019f60 tx=0x7f1c380190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380b0040 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c380b9070 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380b4650 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c140e10 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1410f0 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.327+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c050740 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.331+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c380b47f0 con 0x7f1c4c0cd810 2024-04-26T23:27:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.331+0000 7f1c43400640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 0x7f1c2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.331+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f1c38120670 con 0x7f1c4c0cd810 2024-04-26T23:27:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.331+0000 7f1c4aa00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 0x7f1c2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.331+0000 7f1c4aa00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 0x7f1c2c06a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005890 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.335+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c38016070 con 0x7f1c4c0cd810 2024-04-26T23:27:51.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.503+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c4c0b5ec0 con 0x7f1c4c0cd810 2024-04-26T23:27:51.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.503+0000 7f1c43400640 1 -- 172.21.15.39:0/235623321 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f1c380f0cc0 con 0x7f1c4c0cd810 2024-04-26T23:27:51.506 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:51.507 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:27:51.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 msgr2=0x7f1c2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 0x7f1c2c06a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005890 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 msgr2=0x7f1c4c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c38019f60 tx=0x7f1c380190d0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 shutdown_connections 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c2c068380 0x7f1c2c06a840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c4c0cdbf0 0x7f1c4c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c4c0cd810 0x7f1c4c1598a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 --2- 172.21.15.39:0/235623321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0742f0 0x7f1c4c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 >> 172.21.15.39:0/235623321 conn(0x7f1c4c0b2af0 msgr2=0x7f1c4c0b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 shutdown_connections 2024-04-26T23:27:51.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.507+0000 7f1c51e00640 1 -- 172.21.15.39:0/235623321 wait complete. 2024-04-26T23:27:51.529 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:27:51.529 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:51.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 Processor -- start 2024-04-26T23:27:51.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 -- start start 2024-04-26T23:27:51.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feffc1629b0 0x7feffc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feffc06e1a0 con 0x7feffc09b9e0 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7feffc162d90 con 0x7feffc1629b0 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7ff001800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7feffc06e460 con 0x7feffc0d2b60 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feff2000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feffc1629b0 0x7feffc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feffc1629b0 0x7feffc0b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:56484/0 (socket says 172.21.15.39:56484) 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffb400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feffc09b9e0 0x7feffc0d1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:51446/0 (socket says 172.21.15.39:51446) 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 -- 172.21.15.39:0/2227301888 learned_addr learned my addr 172.21.15.39:0/2227301888 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 -- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 msgr2=0x7feffc0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 --2- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 -- 172.21.15.39:0/2227301888 >> v1:172.21.15.71:6789/0 conn(0x7feffc09b9e0 legacy=0x7feffc0d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.667+0000 7feffaa00640 1 -- 172.21.15.39:0/2227301888 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc06e740 con 0x7feffc1629b0 2024-04-26T23:27:51.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7feffaa00640 1 --2- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0b1f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefec009870 tx=0x7fefec01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b4eedf868aba3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7feffa000640 1 -- 172.21.15.39:0/2227301888 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0b0070 con 0x7feffc1629b0 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7feffa000640 1 -- 172.21.15.39:0/2227301888 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefec0ab600 con 0x7feffc1629b0 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7feffa000640 1 -- 172.21.15.39:0/2227301888 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0ab9d0 con 0x7feffc1629b0 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 -- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 msgr2=0x7feffc0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 --2- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0b1f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefec009870 tx=0x7fefec01c440 comp rx=0 tx=0).stop 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 -- 172.21.15.39:0/2227301888 shutdown_connections 2024-04-26T23:27:51.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 --2- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 --2- 172.21.15.39:0/2227301888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0b1f70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 -- 172.21.15.39:0/2227301888 >> 172.21.15.39:0/2227301888 conn(0x7feffc0b4b00 msgr2=0x7feffc0b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:51.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 -- 172.21.15.39:0/2227301888 shutdown_connections 2024-04-26T23:27:51.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.671+0000 7ff001800640 1 -- 172.21.15.39:0/2227301888 wait complete. 2024-04-26T23:27:51.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 Processor -- start 2024-04-26T23:27:51.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- start start 2024-04-26T23:27:51.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feffc0d1380 con 0x7feffc09b9e0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feffc0b2650 con 0x7feffc1629b0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7feffc09c200 con 0x7feffc0d2b60 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54862/0 (socket says 172.21.15.39:54862) 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 -- 172.21.15.39:0/2646757847 learned_addr learned my addr 172.21.15.39:0/2646757847 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffb400640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feff2000640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 -- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 msgr2=0x7feffc15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 -- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 msgr2=0x7feffc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 -- 172.21.15.39:0/2646757847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc15a160 con 0x7feffc09b9e0 2024-04-26T23:27:51.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feffaa00640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ae040 tx=0x7fefec01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0ba020 con 0x7feffc09b9e0 2024-04-26T23:27:51.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefec0b6420 con 0x7feffc09b9e0 2024-04-26T23:27:51.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc15a440 con 0x7feffc09b9e0 2024-04-26T23:27:51.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0b0040 con 0x7feffc09b9e0 2024-04-26T23:27:51.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc1555e0 con 0x7feffc09b9e0 2024-04-26T23:27:51.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.675+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feffc050740 con 0x7feffc09b9e0 2024-04-26T23:27:51.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.679+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fefec0bd020 con 0x7feffc09b9e0 2024-04-26T23:27:51.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.679+0000 7feff3400640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 0x7fefd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:51.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.679+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fefec120b90 con 0x7feffc09b9e0 2024-04-26T23:27:51.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.679+0000 7feff2000640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 0x7fefd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:51.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.679+0000 7feff2000640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 0x7fefd806a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feffc0a1010 tx=0x7fefe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:51.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.683+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fefec0c4030 con 0x7feffc09b9e0 2024-04-26T23:27:51.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.851+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feffc0b1f10 con 0x7fefd8068380 2024-04-26T23:27:51.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.859+0000 7feff3400640 1 -- 172.21.15.39:0/2646757847 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239847 (secure 0 0 0) 0x7feffc0b1f10 con 0x7fefd8068380 2024-04-26T23:27:51.864 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 msgr2=0x7fefd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 0x7fefd806a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feffc0a1010 tx=0x7fefe4008040 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 msgr2=0x7feffc159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ae040 tx=0x7fefec01ac80 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 shutdown_connections 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fefd8068380 0x7fefd806a840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feffc1629b0 0x7feffc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feffc0d2b60 0x7feffc15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 --2- 172.21.15.39:0/2646757847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feffc09b9e0 0x7feffc159b80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 >> 172.21.15.39:0/2646757847 conn(0x7feffc0b4b00 msgr2=0x7feffc070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 shutdown_connections 2024-04-26T23:27:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:51.863+0000 7ff001800640 1 -- 172.21.15.39:0/2646757847 wait complete. 2024-04-26T23:27:51.884 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-04-26T23:27:51.679449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238464,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":5775360,"data_stored":3099480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948153"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737550+0000","last_change":"2024-04-26T23:27:45.737550+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737550+0000","last_undegraded":"2024-04-26T23:27:45.737550+0000","last_fullsized":"2024-04-26T23:27:45.737550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737171+0000","last_change":"2024-04-26T23:27:45.737171+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737171+0000","last_undegraded":"2024-04-26T23:27:45.737171+0000","last_fullsized":"2024-04-26T23:27:45.737171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738705+0000","last_change":"2024-04-26T23:27:45.738705+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738705+0000","last_undegraded":"2024-04-26T23:27:45.738705+0000","last_fullsized":"2024-04-26T23:27:45.738705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733907+0000","last_change":"2024-04-26T23:27:45.733907+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733907+0000","last_undegraded":"2024-04-26T23:27:45.733907+0000","last_fullsized":"2024-04-26T23:27:45.733907+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733878+0000","last_change":"2024-04-26T23:27:45.733878+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733878+0000","last_undegraded":"2024-04-26T23:27:45.733878+0000","last_fullsized":"2024-04-26T23:27:45.733878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737729+0000","last_change":"2024-04-26T23:27:45.737729+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737729+0000","last_undegraded":"2024-04-26T23:27:45.737729+0000","last_fullsized":"2024-04-26T23:27:45.737729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734269+0000","last_change":"2024-04-26T23:27:45.734269+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734269+0000","last_undegraded":"2024-04-26T23:27:45.734269+0000","last_fullsized":"2024-04-26T23:27:45.734269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732265+0000","last_change":"2024-04-26T23:27:45.732265+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732265+0000","last_undegraded":"2024-04-26T23:27:45.732265+0000","last_fullsized":"2024-04-26T23:27:45.732265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740040+0000","last_change":"2024-04-26T23:27:45.740040+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740040+0000","last_undegraded":"2024-04-26T23:27:45.740040+0000","last_fullsized":"2024-04-26T23:27:45.740040+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736709+0000","last_change":"2024-04-26T23:27:45.736709+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736709+0000","last_undegraded":"2024-04-26T23:27:45.736709+0000","last_fullsized":"2024-04-26T23:27:45.736709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740034+0000","last_change":"2024-04-26T23:27:45.740034+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740034+0000","last_undegraded":"2024-04-26T23:27:45.740034+0000","last_fullsized":"2024-04-26T23:27:45.740034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733892+0000","last_change":"2024-04-26T23:27:45.733892+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733892+0000","last_undegraded":"2024-04-26T23:27:45.733892+0000","last_fullsized":"2024-04-26T23:27:45.733892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736745+0000","last_change":"2024-04-26T23:27:45.736745+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736745+0000","last_undegraded":"2024-04-26T23:27:45.736745+0000","last_fullsized":"2024-04-26T23:27:45.736745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745351+0000","last_change":"2024-04-26T23:27:45.745351+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745351+0000","last_undegraded":"2024-04-26T23:27:45.745351+0000","last_fullsized":"2024-04-26T23:27:45.745351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733808+0000","last_change":"2024-04-26T23:27:45.733808+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733808+0000","last_undegraded":"2024-04-26T23:27:45.733808+0000","last_fullsized":"2024-04-26T23:27:45.733808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.739930+0000","last_change":"2024-04-26T23:27:45.739930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.739930+0000","last_undegraded":"2024-04-26T23:27:45.739930+0000","last_fullsized":"2024-04-26T23:27:45.739930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736501+0000","last_change":"2024-04-26T23:27:45.736501+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736501+0000","last_undegraded":"2024-04-26T23:27:45.736501+0000","last_fullsized":"2024-04-26T23:27:45.736501+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738292+0000","last_change":"2024-04-26T23:27:45.738292+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738292+0000","last_undegraded":"2024-04-26T23:27:45.738292+0000","last_fullsized":"2024-04-26T23:27:45.738292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733804+0000","last_change":"2024-04-26T23:27:45.733804+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733804+0000","last_undegraded":"2024-04-26T23:27:45.733804+0000","last_fullsized":"2024-04-26T23:27:45.733804+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738280+0000","last_change":"2024-04-26T23:27:45.738280+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738280+0000","last_undegraded":"2024-04-26T23:27:45.738280+0000","last_fullsized":"2024-04-26T23:27:45.738280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.735930+0000","last_change":"2024-04-26T23:27:45.735930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.735930+0000","last_undegraded":"2024-04-26T23:27:45.735930+0000","last_fullsized":"2024-04-26T23:27:45.735930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734363+0000","last_change":"2024-04-26T23:27:45.734363+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734363+0000","last_undegraded":"2024-04-26T23:27:45.734363+0000","last_fullsized":"2024-04-26T23:27:45.734363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732255+0000","last_change":"2024-04-26T23:27:45.732255+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732255+0000","last_undegraded":"2024-04-26T23:27:45.732255+0000","last_fullsized":"2024-04-26T23:27:45.732255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734384+0000","last_change":"2024-04-26T23:27:45.734384+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734384+0000","last_undegraded":"2024-04-26T23:27:45.734384+0000","last_fullsized":"2024-04-26T23:27:45.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737835+0000","last_change":"2024-04-26T23:27:45.737835+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737835+0000","last_undegraded":"2024-04-26T23:27:45.737835+0000","last_fullsized":"2024-04-26T23:27:45.737835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745492+0000","last_change":"2024-04-26T23:27:45.745492+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745492+0000","last_undegraded":"2024-04-26T23:27:45.745492+0000","last_fullsized":"2024-04-26T23:27:45.745492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732381+0000","last_change":"2024-04-26T23:27:45.732381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732381+0000","last_undegraded":"2024-04-26T23:27:45.732381+0000","last_fullsized":"2024-04-26T23:27:45.732381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734831+0000","last_change":"2024-04-26T23:27:45.734831+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734831+0000","last_undegraded":"2024-04-26T23:27:45.734831+0000","last_fullsized":"2024-04-26T23:27:45.734831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732392+0000","last_change":"2024-04-26T23:27:45.732392+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732392+0000","last_undegraded":"2024-04-26T23:27:45.732392+0000","last_fullsized":"2024-04-26T23:27:45.732392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734381+0000","last_change":"2024-04-26T23:27:45.734381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734381+0000","last_undegraded":"2024-04-26T23:27:45.734381+0000","last_fullsized":"2024-04-26T23:27:45.734381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736050+0000","last_change":"2024-04-26T23:27:45.736050+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736050+0000","last_undegraded":"2024-04-26T23:27:45.736050+0000","last_fullsized":"2024-04-26T23:27:45.736050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745362+0000","last_change":"2024-04-26T23:27:45.745362+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745362+0000","last_undegraded":"2024-04-26T23:27:45.745362+0000","last_fullsized":"2024-04-26T23:27:45.745362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":221,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T23:27:45.740507+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:45.740507+0000","last_peered":"2024-04-26T23:27:45.740507+0000","last_clean":"2024-04-26T23:27:45.740507+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:45.740507+0000","last_undegraded":"2024-04-26T23:27:45.740507+0000","last_fullsized":"2024-04-26T23:27:45.740507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:51.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 Processor -- start 2024-04-26T23:27:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 -- start start 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc25c15ef10 0x7fc25c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc25c06e940 0x7fc25c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc25c06c470 con 0x7fc25c06da50 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc25c06c750 con 0x7fc25c06e940 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc261000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc25c06ca30 con 0x7fc25c15ef10 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc252a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc25c06e940 0x7fc25c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc252a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc25c06e940 0x7fc25c06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54874/0 (socket says 172.21.15.39:54874) 2024-04-26T23:27:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.067+0000 7fc252a00640 1 -- 172.21.15.39:0/3676480177 learned_addr learned my addr 172.21.15.39:0/3676480177 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc25b400640 1 --2- 172.21.15.39:0/3676480177 >> v2:172.21.15.71:3300/0 conn(0x7fc25c15ef10 0x7fc25c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc252a00640 1 -- 172.21.15.39:0/3676480177 >> v2:172.21.15.71:3300/0 conn(0x7fc25c15ef10 msgr2=0x7fc25c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc252a00640 1 --2- 172.21.15.39:0/3676480177 >> v2:172.21.15.71:3300/0 conn(0x7fc25c15ef10 0x7fc25c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc252a00640 1 -- 172.21.15.39:0/3676480177 >> v1:172.21.15.71:6789/0 conn(0x7fc25c06da50 legacy=0x7fc25c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc252a00640 1 -- 172.21.15.39:0/3676480177 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c06cd10 con 0x7fc25c06e940 2024-04-26T23:27:52.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc252a00640 1 --2- 172.21.15.39:0/3676480177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c06e940 0x7fc25c06d510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b3d70 tx=0x7fc24401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6225e7e0c49e9550 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc25aa00640 1 -- 172.21.15.39:0/3676480177 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2440a58a0 con 0x7fc25c06e940 2024-04-26T23:27:52.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc25aa00640 1 -- 172.21.15.39:0/3676480177 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2440a5a40 con 0x7fc25c06e940 2024-04-26T23:27:52.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc25aa00640 1 -- 172.21.15.39:0/3676480177 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2440a5e10 con 0x7fc25c06e940 2024-04-26T23:27:52.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc261000640 1 -- 172.21.15.39:0/3676480177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c06e940 msgr2=0x7fc25c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.071+0000 7fc261000640 1 --2- 172.21.15.39:0/3676480177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c06e940 0x7fc25c06d510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b3d70 tx=0x7fc24401c9c0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- 172.21.15.39:0/3676480177 shutdown_connections 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 --2- 172.21.15.39:0/3676480177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c06e940 0x7fc25c06d510 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 --2- 172.21.15.39:0/3676480177 >> v2:172.21.15.71:3300/0 conn(0x7fc25c15ef10 0x7fc25c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- 172.21.15.39:0/3676480177 >> 172.21.15.39:0/3676480177 conn(0x7fc25c0b3780 msgr2=0x7fc25c0d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- 172.21.15.39:0/3676480177 shutdown_connections 2024-04-26T23:27:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- 172.21.15.39:0/3676480177 wait complete. 2024-04-26T23:27:52.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 Processor -- start 2024-04-26T23:27:52.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- start start 2024-04-26T23:27:52.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc25c06da50 0x7fc25c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 0x7fc25c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c15f470 con 0x7fc25c15ef10 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c15f2f0 con 0x7fc25c06e940 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc261000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c16bfe0 con 0x7fc25c06da50 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54890/0 (socket says 172.21.15.39:54890) 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 -- 172.21.15.39:0/2902663368 learned_addr learned my addr 172.21.15.39:0/2902663368 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25b400640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc25c06da50 0x7fc25c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc252a00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 0x7fc25c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 -- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc25c06da50 msgr2=0x7fc25c143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc25c06da50 0x7fc25c143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 -- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 msgr2=0x7fc25c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 0x7fc25c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 -- 172.21.15.39:0/2902663368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c159380 con 0x7fc25c15ef10 2024-04-26T23:27:52.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc252a00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 0x7fc25c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.075+0000 7fc25be00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c430 tx=0x7fc25400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254005220 con 0x7fc25c15ef10 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2540053c0 con 0x7fc25c15ef10 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254007270 con 0x7fc25c15ef10 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c159660 con 0x7fc25c15ef10 2024-04-26T23:27:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c159c20 con 0x7fc25c15ef10 2024-04-26T23:27:52.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c0506d0 con 0x7fc25c15ef10 2024-04-26T23:27:52.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc254019020 con 0x7fc25c15ef10 2024-04-26T23:27:52.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 0x7fc23806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fc254085ce0 con 0x7fc25c15ef10 2024-04-26T23:27:52.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc25b400640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 0x7fc23806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.079+0000 7fc25b400640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 0x7fc23806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00b930 tx=0x7fc24c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.083+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc254056330 con 0x7fc25c15ef10 2024-04-26T23:27:52.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.247+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc25c0b68e0 con 0x7fc238068380 2024-04-26T23:27:52.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.255+0000 7fc253e00640 1 -- 172.21.15.39:0/2902663368 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239847 (secure 0 0 0) 0x7fc25c0b68e0 con 0x7fc238068380 2024-04-26T23:27:52.260 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:52.261 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:52.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 msgr2=0x7fc23806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 0x7fc23806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00b930 tx=0x7fc24c008040 comp rx=0 tx=0).stop 2024-04-26T23:27:52.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 msgr2=0x7fc25c161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c430 tx=0x7fc25400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 shutdown_connections 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc238068380 0x7fc23806a840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc25c15ef10 0x7fc25c161bb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc25c06e940 0x7fc25c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 --2- 172.21.15.39:0/2902663368 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc25c06da50 0x7fc25c143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 >> 172.21.15.39:0/2902663368 conn(0x7fc25c0b3780 msgr2=0x7fc25c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 shutdown_connections 2024-04-26T23:27:52.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.259+0000 7fc261000640 1 -- 172.21.15.39:0/2902663368 wait complete. 2024-04-26T23:27:52.282 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-04-26T23:27:51.679449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238464,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":5775360,"data_stored":3099480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948153"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737550+0000","last_change":"2024-04-26T23:27:45.737550+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737550+0000","last_undegraded":"2024-04-26T23:27:45.737550+0000","last_fullsized":"2024-04-26T23:27:45.737550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737171+0000","last_change":"2024-04-26T23:27:45.737171+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737171+0000","last_undegraded":"2024-04-26T23:27:45.737171+0000","last_fullsized":"2024-04-26T23:27:45.737171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738705+0000","last_change":"2024-04-26T23:27:45.738705+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738705+0000","last_undegraded":"2024-04-26T23:27:45.738705+0000","last_fullsized":"2024-04-26T23:27:45.738705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733907+0000","last_change":"2024-04-26T23:27:45.733907+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733907+0000","last_undegraded":"2024-04-26T23:27:45.733907+0000","last_fullsized":"2024-04-26T23:27:45.733907+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733878+0000","last_change":"2024-04-26T23:27:45.733878+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733878+0000","last_undegraded":"2024-04-26T23:27:45.733878+0000","last_fullsized":"2024-04-26T23:27:45.733878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737729+0000","last_change":"2024-04-26T23:27:45.737729+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737729+0000","last_undegraded":"2024-04-26T23:27:45.737729+0000","last_fullsized":"2024-04-26T23:27:45.737729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734269+0000","last_change":"2024-04-26T23:27:45.734269+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734269+0000","last_undegraded":"2024-04-26T23:27:45.734269+0000","last_fullsized":"2024-04-26T23:27:45.734269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732265+0000","last_change":"2024-04-26T23:27:45.732265+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732265+0000","last_undegraded":"2024-04-26T23:27:45.732265+0000","last_fullsized":"2024-04-26T23:27:45.732265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740040+0000","last_change":"2024-04-26T23:27:45.740040+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740040+0000","last_undegraded":"2024-04-26T23:27:45.740040+0000","last_fullsized":"2024-04-26T23:27:45.740040+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736709+0000","last_change":"2024-04-26T23:27:45.736709+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736709+0000","last_undegraded":"2024-04-26T23:27:45.736709+0000","last_fullsized":"2024-04-26T23:27:45.736709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740034+0000","last_change":"2024-04-26T23:27:45.740034+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740034+0000","last_undegraded":"2024-04-26T23:27:45.740034+0000","last_fullsized":"2024-04-26T23:27:45.740034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733892+0000","last_change":"2024-04-26T23:27:45.733892+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733892+0000","last_undegraded":"2024-04-26T23:27:45.733892+0000","last_fullsized":"2024-04-26T23:27:45.733892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736745+0000","last_change":"2024-04-26T23:27:45.736745+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736745+0000","last_undegraded":"2024-04-26T23:27:45.736745+0000","last_fullsized":"2024-04-26T23:27:45.736745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745351+0000","last_change":"2024-04-26T23:27:45.745351+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745351+0000","last_undegraded":"2024-04-26T23:27:45.745351+0000","last_fullsized":"2024-04-26T23:27:45.745351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733808+0000","last_change":"2024-04-26T23:27:45.733808+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733808+0000","last_undegraded":"2024-04-26T23:27:45.733808+0000","last_fullsized":"2024-04-26T23:27:45.733808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.739930+0000","last_change":"2024-04-26T23:27:45.739930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.739930+0000","last_undegraded":"2024-04-26T23:27:45.739930+0000","last_fullsized":"2024-04-26T23:27:45.739930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736501+0000","last_change":"2024-04-26T23:27:45.736501+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736501+0000","last_undegraded":"2024-04-26T23:27:45.736501+0000","last_fullsized":"2024-04-26T23:27:45.736501+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738292+0000","last_change":"2024-04-26T23:27:45.738292+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738292+0000","last_undegraded":"2024-04-26T23:27:45.738292+0000","last_fullsized":"2024-04-26T23:27:45.738292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733804+0000","last_change":"2024-04-26T23:27:45.733804+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733804+0000","last_undegraded":"2024-04-26T23:27:45.733804+0000","last_fullsized":"2024-04-26T23:27:45.733804+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738280+0000","last_change":"2024-04-26T23:27:45.738280+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738280+0000","last_undegraded":"2024-04-26T23:27:45.738280+0000","last_fullsized":"2024-04-26T23:27:45.738280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.735930+0000","last_change":"2024-04-26T23:27:45.735930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.735930+0000","last_undegraded":"2024-04-26T23:27:45.735930+0000","last_fullsized":"2024-04-26T23:27:45.735930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734363+0000","last_change":"2024-04-26T23:27:45.734363+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734363+0000","last_undegraded":"2024-04-26T23:27:45.734363+0000","last_fullsized":"2024-04-26T23:27:45.734363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732255+0000","last_change":"2024-04-26T23:27:45.732255+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732255+0000","last_undegraded":"2024-04-26T23:27:45.732255+0000","last_fullsized":"2024-04-26T23:27:45.732255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734384+0000","last_change":"2024-04-26T23:27:45.734384+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734384+0000","last_undegraded":"2024-04-26T23:27:45.734384+0000","last_fullsized":"2024-04-26T23:27:45.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737835+0000","last_change":"2024-04-26T23:27:45.737835+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737835+0000","last_undegraded":"2024-04-26T23:27:45.737835+0000","last_fullsized":"2024-04-26T23:27:45.737835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745492+0000","last_change":"2024-04-26T23:27:45.745492+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745492+0000","last_undegraded":"2024-04-26T23:27:45.745492+0000","last_fullsized":"2024-04-26T23:27:45.745492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732381+0000","last_change":"2024-04-26T23:27:45.732381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732381+0000","last_undegraded":"2024-04-26T23:27:45.732381+0000","last_fullsized":"2024-04-26T23:27:45.732381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734831+0000","last_change":"2024-04-26T23:27:45.734831+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734831+0000","last_undegraded":"2024-04-26T23:27:45.734831+0000","last_fullsized":"2024-04-26T23:27:45.734831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732392+0000","last_change":"2024-04-26T23:27:45.732392+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732392+0000","last_undegraded":"2024-04-26T23:27:45.732392+0000","last_fullsized":"2024-04-26T23:27:45.732392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734381+0000","last_change":"2024-04-26T23:27:45.734381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734381+0000","last_undegraded":"2024-04-26T23:27:45.734381+0000","last_fullsized":"2024-04-26T23:27:45.734381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736050+0000","last_change":"2024-04-26T23:27:45.736050+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736050+0000","last_undegraded":"2024-04-26T23:27:45.736050+0000","last_fullsized":"2024-04-26T23:27:45.736050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745362+0000","last_change":"2024-04-26T23:27:45.745362+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745362+0000","last_undegraded":"2024-04-26T23:27:45.745362+0000","last_fullsized":"2024-04-26T23:27:45.745362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":221,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T23:27:45.740507+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:45.740507+0000","last_peered":"2024-04-26T23:27:45.740507+0000","last_clean":"2024-04-26T23:27:45.740507+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:45.740507+0000","last_undegraded":"2024-04-26T23:27:45.740507+0000","last_fullsized":"2024-04-26T23:27:45.740507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:52.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:52.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.459+0000 7f368e400640 1 Processor -- start 2024-04-26T23:27:52.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.459+0000 7f368e400640 1 -- start start 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f368e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3688162800 0x7f3688160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f368e400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36880d0b80 0x7f36880b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f368e400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3688162be0 con 0x7f36880d0fa0 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f368e400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f36880d2b00 con 0x7f36880d0b80 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f368e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f368815fbd0 con 0x7f3688162800 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36880d0b80 0x7f36880b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36880d0b80 0x7f36880b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54894/0 (socket says 172.21.15.39:54894) 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 -- 172.21.15.39:0/3343194640 learned_addr learned my addr 172.21.15.39:0/3343194640 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f3687400640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3688162800 0x7f3688160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 -- 172.21.15.39:0/3343194640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3688162800 msgr2=0x7f3688160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:52.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3688162800 0x7f3688160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 -- 172.21.15.39:0/3343194640 >> v1:172.21.15.71:6789/0 conn(0x7f36880d0fa0 legacy=0x7f36881630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.463+0000 7f367ea00640 1 -- 172.21.15.39:0/3343194640 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368815feb0 con 0x7f36880d0b80 2024-04-26T23:27:52.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f367ea00640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36880d0b80 0x7f36880b4b10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3670009870 tx=0x7f367001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aca3a3b3a42ab6d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f3686a00640 1 -- 172.21.15.39:0/3343194640 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36700ab640 con 0x7f36880d0b80 2024-04-26T23:27:52.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f3686a00640 1 -- 172.21.15.39:0/3343194640 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36700b0070 con 0x7f36880d0b80 2024-04-26T23:27:52.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f3686a00640 1 -- 172.21.15.39:0/3343194640 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36700aba00 con 0x7f36880d0b80 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- 172.21.15.39:0/3343194640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36880d0b80 msgr2=0x7f36880b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36880d0b80 0x7f36880b4b10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3670009870 tx=0x7f367001c530 comp rx=0 tx=0).stop 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- 172.21.15.39:0/3343194640 shutdown_connections 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36880d0b80 0x7f36880b4b10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 --2- 172.21.15.39:0/3343194640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3688162800 0x7f3688160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- 172.21.15.39:0/3343194640 >> 172.21.15.39:0/3343194640 conn(0x7f3688068140 msgr2=0x7f3688068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:52.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- 172.21.15.39:0/3343194640 shutdown_connections 2024-04-26T23:27:52.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- 172.21.15.39:0/3343194640 wait complete. 2024-04-26T23:27:52.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 Processor -- start 2024-04-26T23:27:52.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.467+0000 7f368e400640 1 -- start start 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f36880d0b80 0x7f36881fc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36880d0fa0 0x7f36880cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3688163bf0 con 0x7f3688162800 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f368815f8a0 con 0x7f36880d0fa0 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3688163d70 con 0x7f36880d0b80 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54900/0 (socket says 172.21.15.39:54900) 2024-04-26T23:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 -- 172.21.15.39:0/54181630 learned_addr learned my addr 172.21.15.39:0/54181630 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f367ea00640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36880d0fa0 0x7f36880cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f36880d0b80 0x7f36881fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 -- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f36880d0b80 msgr2=0x7f36881fc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f36880d0b80 0x7f36881fc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 -- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36880d0fa0 msgr2=0x7f36880cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36880d0fa0 0x7f36880cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 -- 172.21.15.39:0/54181630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36880cca00 con 0x7f3688162800 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f3687e00640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f368000c7a0 tx=0x7f368000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680003b80 con 0x7f3688162800 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680003d20 con 0x7f3688162800 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36880ccce0 con 0x7f3688162800 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368000aa30 con 0x7f3688162800 2024-04-26T23:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36881fc470 con 0x7f3688162800 2024-04-26T23:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36881fbfa0 con 0x7f3688162800 2024-04-26T23:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.471+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f368000abd0 con 0x7f3688162800 2024-04-26T23:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.475+0000 7f367fe00640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 0x7f366406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.475+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f36800866b0 con 0x7f3688162800 2024-04-26T23:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.475+0000 7f3687400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 0x7f366406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.475+0000 7f3687400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 0x7f366406a840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3678006aa0 tx=0x7f3678008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.479+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f36800566b0 con 0x7f3688162800 2024-04-26T23:27:52.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.639+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36880c6890 con 0x7f3664068380 2024-04-26T23:27:52.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f367fe00640 1 -- 172.21.15.39:0/54181630 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239847 (secure 0 0 0) 0x7f36880c6890 con 0x7f3664068380 2024-04-26T23:27:52.651 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:52.652 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:52.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 msgr2=0x7f366406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 0x7f366406a840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3678006aa0 tx=0x7f3678008040 comp rx=0 tx=0).stop 2024-04-26T23:27:52.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 msgr2=0x7f3688150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f368000c7a0 tx=0x7f368000cc60 comp rx=0 tx=0).stop 2024-04-26T23:27:52.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 shutdown_connections 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f3664068380 0x7f366406a840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.647+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3688162800 0x7f3688150d70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.651+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36880d0fa0 0x7f36880cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.651+0000 7f368e400640 1 --2- 172.21.15.39:0/54181630 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f36880d0b80 0x7f36881fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.651+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 >> 172.21.15.39:0/54181630 conn(0x7f3688068140 msgr2=0x7f3688068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.651+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 shutdown_connections 2024-04-26T23:27:52.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.651+0000 7f368e400640 1 -- 172.21.15.39:0/54181630 wait complete. 2024-04-26T23:27:52.672 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-04-26T23:27:51.679449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238464,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":5775360,"data_stored":3099480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948153"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737550+0000","last_change":"2024-04-26T23:27:45.737550+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737550+0000","last_undegraded":"2024-04-26T23:27:45.737550+0000","last_fullsized":"2024-04-26T23:27:45.737550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737171+0000","last_change":"2024-04-26T23:27:45.737171+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737171+0000","last_undegraded":"2024-04-26T23:27:45.737171+0000","last_fullsized":"2024-04-26T23:27:45.737171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738705+0000","last_change":"2024-04-26T23:27:45.738705+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738705+0000","last_undegraded":"2024-04-26T23:27:45.738705+0000","last_fullsized":"2024-04-26T23:27:45.738705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733907+0000","last_change":"2024-04-26T23:27:45.733907+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733907+0000","last_undegraded":"2024-04-26T23:27:45.733907+0000","last_fullsized":"2024-04-26T23:27:45.733907+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733878+0000","last_change":"2024-04-26T23:27:45.733878+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733878+0000","last_undegraded":"2024-04-26T23:27:45.733878+0000","last_fullsized":"2024-04-26T23:27:45.733878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737729+0000","last_change":"2024-04-26T23:27:45.737729+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737729+0000","last_undegraded":"2024-04-26T23:27:45.737729+0000","last_fullsized":"2024-04-26T23:27:45.737729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734269+0000","last_change":"2024-04-26T23:27:45.734269+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734269+0000","last_undegraded":"2024-04-26T23:27:45.734269+0000","last_fullsized":"2024-04-26T23:27:45.734269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732265+0000","last_change":"2024-04-26T23:27:45.732265+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732265+0000","last_undegraded":"2024-04-26T23:27:45.732265+0000","last_fullsized":"2024-04-26T23:27:45.732265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740040+0000","last_change":"2024-04-26T23:27:45.740040+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740040+0000","last_undegraded":"2024-04-26T23:27:45.740040+0000","last_fullsized":"2024-04-26T23:27:45.740040+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736709+0000","last_change":"2024-04-26T23:27:45.736709+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736709+0000","last_undegraded":"2024-04-26T23:27:45.736709+0000","last_fullsized":"2024-04-26T23:27:45.736709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740034+0000","last_change":"2024-04-26T23:27:45.740034+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740034+0000","last_undegraded":"2024-04-26T23:27:45.740034+0000","last_fullsized":"2024-04-26T23:27:45.740034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733892+0000","last_change":"2024-04-26T23:27:45.733892+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733892+0000","last_undegraded":"2024-04-26T23:27:45.733892+0000","last_fullsized":"2024-04-26T23:27:45.733892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736745+0000","last_change":"2024-04-26T23:27:45.736745+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736745+0000","last_undegraded":"2024-04-26T23:27:45.736745+0000","last_fullsized":"2024-04-26T23:27:45.736745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745351+0000","last_change":"2024-04-26T23:27:45.745351+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745351+0000","last_undegraded":"2024-04-26T23:27:45.745351+0000","last_fullsized":"2024-04-26T23:27:45.745351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733808+0000","last_change":"2024-04-26T23:27:45.733808+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733808+0000","last_undegraded":"2024-04-26T23:27:45.733808+0000","last_fullsized":"2024-04-26T23:27:45.733808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.739930+0000","last_change":"2024-04-26T23:27:45.739930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.739930+0000","last_undegraded":"2024-04-26T23:27:45.739930+0000","last_fullsized":"2024-04-26T23:27:45.739930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736501+0000","last_change":"2024-04-26T23:27:45.736501+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736501+0000","last_undegraded":"2024-04-26T23:27:45.736501+0000","last_fullsized":"2024-04-26T23:27:45.736501+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738292+0000","last_change":"2024-04-26T23:27:45.738292+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738292+0000","last_undegraded":"2024-04-26T23:27:45.738292+0000","last_fullsized":"2024-04-26T23:27:45.738292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733804+0000","last_change":"2024-04-26T23:27:45.733804+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733804+0000","last_undegraded":"2024-04-26T23:27:45.733804+0000","last_fullsized":"2024-04-26T23:27:45.733804+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738280+0000","last_change":"2024-04-26T23:27:45.738280+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738280+0000","last_undegraded":"2024-04-26T23:27:45.738280+0000","last_fullsized":"2024-04-26T23:27:45.738280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.735930+0000","last_change":"2024-04-26T23:27:45.735930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.735930+0000","last_undegraded":"2024-04-26T23:27:45.735930+0000","last_fullsized":"2024-04-26T23:27:45.735930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734363+0000","last_change":"2024-04-26T23:27:45.734363+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734363+0000","last_undegraded":"2024-04-26T23:27:45.734363+0000","last_fullsized":"2024-04-26T23:27:45.734363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732255+0000","last_change":"2024-04-26T23:27:45.732255+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732255+0000","last_undegraded":"2024-04-26T23:27:45.732255+0000","last_fullsized":"2024-04-26T23:27:45.732255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734384+0000","last_change":"2024-04-26T23:27:45.734384+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734384+0000","last_undegraded":"2024-04-26T23:27:45.734384+0000","last_fullsized":"2024-04-26T23:27:45.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737835+0000","last_change":"2024-04-26T23:27:45.737835+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737835+0000","last_undegraded":"2024-04-26T23:27:45.737835+0000","last_fullsized":"2024-04-26T23:27:45.737835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745492+0000","last_change":"2024-04-26T23:27:45.745492+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745492+0000","last_undegraded":"2024-04-26T23:27:45.745492+0000","last_fullsized":"2024-04-26T23:27:45.745492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732381+0000","last_change":"2024-04-26T23:27:45.732381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732381+0000","last_undegraded":"2024-04-26T23:27:45.732381+0000","last_fullsized":"2024-04-26T23:27:45.732381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734831+0000","last_change":"2024-04-26T23:27:45.734831+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734831+0000","last_undegraded":"2024-04-26T23:27:45.734831+0000","last_fullsized":"2024-04-26T23:27:45.734831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732392+0000","last_change":"2024-04-26T23:27:45.732392+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732392+0000","last_undegraded":"2024-04-26T23:27:45.732392+0000","last_fullsized":"2024-04-26T23:27:45.732392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734381+0000","last_change":"2024-04-26T23:27:45.734381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734381+0000","last_undegraded":"2024-04-26T23:27:45.734381+0000","last_fullsized":"2024-04-26T23:27:45.734381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736050+0000","last_change":"2024-04-26T23:27:45.736050+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736050+0000","last_undegraded":"2024-04-26T23:27:45.736050+0000","last_fullsized":"2024-04-26T23:27:45.736050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745362+0000","last_change":"2024-04-26T23:27:45.745362+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745362+0000","last_undegraded":"2024-04-26T23:27:45.745362+0000","last_fullsized":"2024-04-26T23:27:45.745362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":221,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T23:27:45.740507+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:45.740507+0000","last_peered":"2024-04-26T23:27:45.740507+0000","last_clean":"2024-04-26T23:27:45.740507+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:45.740507+0000","last_undegraded":"2024-04-26T23:27:45.740507+0000","last_fullsized":"2024-04-26T23:27:45.740507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:52.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-04-26T23:27:52.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-04-26T23:27:52.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-04-26T23:27:52.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-04-26T23:27:52.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-04-26T23:27:52.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-04-26T23:27:52.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.737550+0000', 'last_change': '2024-04-26T23:27:45.737550+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.737550+0000', 'last_undegraded': '2024-04-26T23:27:45.737550+0000', 'last_fullsized': '2024-04-26T23:27:45.737550+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.737171+0000', 'last_change': '2024-04-26T23:27:45.737171+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.737171+0000', 'last_undegraded': '2024-04-26T23:27:45.737171+0000', 'last_fullsized': '2024-04-26T23:27:45.737171+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.738705+0000', 'last_change': '2024-04-26T23:27:45.738705+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.738705+0000', 'last_undegraded': '2024-04-26T23:27:45.738705+0000', 'last_fullsized': '2024-04-26T23:27:45.738705+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-04-26T23:27:52.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.733907+0000', 'last_change': '2024-04-26T23:27:45.733907+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.733907+0000', 'last_undegraded': '2024-04-26T23:27:45.733907+0000', 'last_fullsized': '2024-04-26T23:27:45.733907+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.733878+0000', 'last_change': '2024-04-26T23:27:45.733878+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.733878+0000', 'last_undegraded': '2024-04-26T23:27:45.733878+0000', 'last_fullsized': '2024-04-26T23:27:45.733878+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.737729+0000', 'last_change': '2024-04-26T23:27:45.737729+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.737729+0000', 'last_undegraded': '2024-04-26T23:27:45.737729+0000', 'last_fullsized': '2024-04-26T23:27:45.737729+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-04-26T23:27:52.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.734269+0000', 'last_change': '2024-04-26T23:27:45.734269+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.734269+0000', 'last_undegraded': '2024-04-26T23:27:45.734269+0000', 'last_fullsized': '2024-04-26T23:27:45.734269+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.732265+0000', 'last_change': '2024-04-26T23:27:45.732265+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.732265+0000', 'last_undegraded': '2024-04-26T23:27:45.732265+0000', 'last_fullsized': '2024-04-26T23:27:45.732265+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-04-26T23:27:52.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.740040+0000', 'last_change': '2024-04-26T23:27:45.740040+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.740040+0000', 'last_undegraded': '2024-04-26T23:27:45.740040+0000', 'last_fullsized': '2024-04-26T23:27:45.740040+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.736709+0000', 'last_change': '2024-04-26T23:27:45.736709+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.736709+0000', 'last_undegraded': '2024-04-26T23:27:45.736709+0000', 'last_fullsized': '2024-04-26T23:27:45.736709+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.740034+0000', 'last_change': '2024-04-26T23:27:45.740034+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.740034+0000', 'last_undegraded': '2024-04-26T23:27:45.740034+0000', 'last_fullsized': '2024-04-26T23:27:45.740034+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.733892+0000', 'last_change': '2024-04-26T23:27:45.733892+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.733892+0000', 'last_undegraded': '2024-04-26T23:27:45.733892+0000', 'last_fullsized': '2024-04-26T23:27:45.733892+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.736745+0000', 'last_change': '2024-04-26T23:27:45.736745+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.736745+0000', 'last_undegraded': '2024-04-26T23:27:45.736745+0000', 'last_fullsized': '2024-04-26T23:27:45.736745+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.745351+0000', 'last_change': '2024-04-26T23:27:45.745351+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.745351+0000', 'last_undegraded': '2024-04-26T23:27:45.745351+0000', 'last_fullsized': '2024-04-26T23:27:45.745351+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:27:52.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.733808+0000', 'last_change': '2024-04-26T23:27:45.733808+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.733808+0000', 'last_undegraded': '2024-04-26T23:27:45.733808+0000', 'last_fullsized': '2024-04-26T23:27:45.733808+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.739930+0000', 'last_change': '2024-04-26T23:27:45.739930+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.739930+0000', 'last_undegraded': '2024-04-26T23:27:45.739930+0000', 'last_fullsized': '2024-04-26T23:27:45.739930+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-04-26T23:27:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.736501+0000', 'last_change': '2024-04-26T23:27:45.736501+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.736501+0000', 'last_undegraded': '2024-04-26T23:27:45.736501+0000', 'last_fullsized': '2024-04-26T23:27:45.736501+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.738292+0000', 'last_change': '2024-04-26T23:27:45.738292+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.738292+0000', 'last_undegraded': '2024-04-26T23:27:45.738292+0000', 'last_fullsized': '2024-04-26T23:27:45.738292+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.733804+0000', 'last_change': '2024-04-26T23:27:45.733804+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.733804+0000', 'last_undegraded': '2024-04-26T23:27:45.733804+0000', 'last_fullsized': '2024-04-26T23:27:45.733804+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.738280+0000', 'last_change': '2024-04-26T23:27:45.738280+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.738280+0000', 'last_undegraded': '2024-04-26T23:27:45.738280+0000', 'last_fullsized': '2024-04-26T23:27:45.738280+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.735930+0000', 'last_change': '2024-04-26T23:27:45.735930+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.735930+0000', 'last_undegraded': '2024-04-26T23:27:45.735930+0000', 'last_fullsized': '2024-04-26T23:27:45.735930+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.734363+0000', 'last_change': '2024-04-26T23:27:45.734363+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.734363+0000', 'last_undegraded': '2024-04-26T23:27:45.734363+0000', 'last_fullsized': '2024-04-26T23:27:45.734363+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:27:52.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.732255+0000', 'last_change': '2024-04-26T23:27:45.732255+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.732255+0000', 'last_undegraded': '2024-04-26T23:27:45.732255+0000', 'last_fullsized': '2024-04-26T23:27:45.732255+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.734384+0000', 'last_change': '2024-04-26T23:27:45.734384+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.734384+0000', 'last_undegraded': '2024-04-26T23:27:45.734384+0000', 'last_fullsized': '2024-04-26T23:27:45.734384+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-04-26T23:27:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.737835+0000', 'last_change': '2024-04-26T23:27:45.737835+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.737835+0000', 'last_undegraded': '2024-04-26T23:27:45.737835+0000', 'last_fullsized': '2024-04-26T23:27:45.737835+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.745492+0000', 'last_change': '2024-04-26T23:27:45.745492+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.745492+0000', 'last_undegraded': '2024-04-26T23:27:45.745492+0000', 'last_fullsized': '2024-04-26T23:27:45.745492+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.732381+0000', 'last_change': '2024-04-26T23:27:45.732381+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.732381+0000', 'last_undegraded': '2024-04-26T23:27:45.732381+0000', 'last_fullsized': '2024-04-26T23:27:45.732381+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-04-26T23:27:52.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.734831+0000', 'last_change': '2024-04-26T23:27:45.734831+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.734831+0000', 'last_undegraded': '2024-04-26T23:27:45.734831+0000', 'last_fullsized': '2024-04-26T23:27:45.734831+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.732392+0000', 'last_change': '2024-04-26T23:27:45.732392+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.732392+0000', 'last_undegraded': '2024-04-26T23:27:45.732392+0000', 'last_fullsized': '2024-04-26T23:27:45.732392+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.734381+0000', 'last_change': '2024-04-26T23:27:45.734381+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.734381+0000', 'last_undegraded': '2024-04-26T23:27:45.734381+0000', 'last_fullsized': '2024-04-26T23:27:45.734381+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-04-26T23:27:52.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.736050+0000', 'last_change': '2024-04-26T23:27:45.736050+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.736050+0000', 'last_undegraded': '2024-04-26T23:27:45.736050+0000', 'last_fullsized': '2024-04-26T23:27:45.736050+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:27:46.729001+0000', 'last_change': '2024-04-26T23:27:46.729001+0000', 'last_active': '2024-04-26T23:27:46.729001+0000', 'last_peered': '2024-04-26T23:27:46.729001+0000', 'last_clean': '2024-04-26T23:27:46.729001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:46.729001+0000', 'last_undegraded': '2024-04-26T23:27:46.729001+0000', 'last_fullsized': '2024-04-26T23:27:46.729001+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:46.729001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-04-26T23:27:52.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:27:45.745362+0000', 'last_change': '2024-04-26T23:27:45.745362+0000', 'last_active': '2024-04-26T23:27:45.721041+0000', 'last_peered': '2024-04-26T23:27:45.721041+0000', 'last_clean': '2024-04-26T23:27:45.721041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:27:45.745362+0000', 'last_undegraded': '2024-04-26T23:27:45.745362+0000', 'last_fullsized': '2024-04-26T23:27:45.745362+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'last_clean_scrub_stamp': '2024-04-26T23:27:45.721041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:27:52.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:27:52.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 Processor -- start 2024-04-26T23:27:52.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 -- start start 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 0x7f6c9406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c940b1280 0x7f6c940aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6c94161650 0x7f6c94161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.855+0000 7f6c9be00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6c940ce4f0 con 0x7f6c94161650 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c9be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6c9406ccf0 con 0x7f6c940b1280 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c9be00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c940b1740 con 0x7f6c9406c3d0 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6c94161650 0x7f6c94161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6c94161650 0x7f6c94161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54912/0 (socket says 172.21.15.39:54912) 2024-04-26T23:27:52.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 -- 172.21.15.39:0/727746100 learned_addr learned my addr 172.21.15.39:0/727746100 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99400640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 0x7f6c9406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c98a00640 1 --2- 172.21.15.39:0/727746100 >> v2:172.21.15.71:3300/0 conn(0x7f6c940b1280 0x7f6c940aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 -- 172.21.15.39:0/727746100 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 msgr2=0x7f6c9406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 0x7f6c9406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 -- 172.21.15.39:0/727746100 >> v2:172.21.15.71:3300/0 conn(0x7f6c940b1280 msgr2=0x7f6c940aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 --2- 172.21.15.39:0/727746100 >> v2:172.21.15.71:3300/0 conn(0x7f6c940b1280 0x7f6c940aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 -- 172.21.15.39:0/727746100 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c940cc530 con 0x7f6c94161650 2024-04-26T23:27:52.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99400640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 0x7f6c9406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:52.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c99e00640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c94161ac0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c94075f60 tx=0x7f6c8c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d841d54eb3328427 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c93e00640 1 -- 172.21.15.39:0/727746100 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0a57b0 con 0x7f6c94161650 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c93e00640 1 -- 172.21.15.39:0/727746100 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0a5950 con 0x7f6c94161650 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.859+0000 7f6c93e00640 1 -- 172.21.15.39:0/727746100 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0a5d20 con 0x7f6c94161650 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- 172.21.15.39:0/727746100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 msgr2=0x7f6c94161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c94161ac0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c94075f60 tx=0x7f6c8c01c930 comp rx=0 tx=0).stop 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- 172.21.15.39:0/727746100 shutdown_connections 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c94161ac0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- 172.21.15.39:0/727746100 >> v2:172.21.15.71:3300/0 conn(0x7f6c940b1280 0x7f6c940aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- 172.21.15.39:0/727746100 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c9406c3d0 0x7f6c9406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- 172.21.15.39:0/727746100 >> 172.21.15.39:0/727746100 conn(0x7f6c940d1ee0 msgr2=0x7f6c940d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- 172.21.15.39:0/727746100 shutdown_connections 2024-04-26T23:27:52.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- 172.21.15.39:0/727746100 wait complete. 2024-04-26T23:27:52.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 Processor -- start 2024-04-26T23:27:52.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- start start 2024-04-26T23:27:52.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c9406c3d0 0x7f6c9415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c940b1280 0x7f6c94153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940af3e0 con 0x7f6c94161650 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940af260 con 0x7f6c9406c3d0 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c9be00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9415e710 con 0x7f6c940b1280 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54924/0 (socket says 172.21.15.39:54924) 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 -- 172.21.15.39:0/1740805331 learned_addr learned my addr 172.21.15.39:0/1740805331 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 -- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c940b1280 msgr2=0x7f6c94153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c940b1280 0x7f6c94153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 -- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c9406c3d0 msgr2=0x7f6c9415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c9406c3d0 0x7f6c9415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.863+0000 7f6c99e00640 1 -- 172.21.15.39:0/1740805331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9415b6d0 con 0x7f6c94161650 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c99e00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c01d1d0 tx=0x7f6c8c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0bc020 con 0x7f6c94161650 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0b8670 con 0x7f6c94161650 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0b8a60 con 0x7f6c94161650 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9415b9b0 con 0x7f6c94161650 2024-04-26T23:27:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9415bf70 con 0x7f6c94161650 2024-04-26T23:27:52.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c94050740 con 0x7f6c94161650 2024-04-26T23:27:52.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c8c0bf020 con 0x7f6c94161650 2024-04-26T23:27:52.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 0x7f6c7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:52.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8c121bb0 con 0x7f6c94161650 2024-04-26T23:27:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.867+0000 7f6c99400640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 0x7f6c7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.871+0000 7f6c99400640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 0x7f6c7406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009710 tx=0x7f6c88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:52.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:52.871+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c8c0c6030 con 0x7f6c94161650 2024-04-26T23:27:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6c940d2a00 con 0x7f6c94161650 2024-04-26T23:27:53.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c91600640 1 -- 172.21.15.39:0/1740805331 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1528 (secure 0 0 0) 0x7f6c8c0165e0 con 0x7f6c94161650 2024-04-26T23:27:53.097 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:53.097 INFO:teuthology.orchestra.run.smithi039.stdout:{"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":124,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1714173960,"num_in_osds":8,"osd_in_since":1714173951,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":244187136,"bytes_avail":772849926144,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5490}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T23:27:35.675790+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 msgr2=0x7f6c7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 0x7f6c7406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009710 tx=0x7f6c88008040 comp rx=0 tx=0).stop 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 msgr2=0x7f6c9415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c01d1d0 tx=0x7f6c8c0196d0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 shutdown_connections 2024-04-26T23:27:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6c74068380 0x7f6c7406a840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c94161650 0x7f6c9415f320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c940b1280 0x7f6c94153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 --2- 172.21.15.39:0/1740805331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c9406c3d0 0x7f6c9415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 >> 172.21.15.39:0/1740805331 conn(0x7f6c940d1ee0 msgr2=0x7f6c940cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 shutdown_connections 2024-04-26T23:27:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.095+0000 7f6c9be00640 1 -- 172.21.15.39:0/1740805331 wait complete. 2024-04-26T23:27:53.118 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:27:53.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:53.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.255+0000 7f9278800640 1 Processor -- start 2024-04-26T23:27:53.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.255+0000 7f9278800640 1 -- start start 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9278800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f927006fc80 0x7f92700cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9278800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9270160060 con 0x7f9270145820 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9278800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9270160340 con 0x7f92700cf2a0 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9278800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f92700cd5c0 con 0x7f927006fc80 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9275e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9270145820 0x7f92700b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56856/0 (socket says 172.21.15.39:56856) 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9275e00640 1 -- 172.21.15.39:0/158577104 learned_addr learned my addr 172.21.15.39:0/158577104 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:53.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9276800640 1 --2- 172.21.15.39:0/158577104 >> v2:172.21.15.39:3300/0 conn(0x7f927006fc80 0x7f92700cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522767660 0 0) 0x7f9270160060 con 0x7f9270145820 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9258003530 con 0x7f9270145820 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543132927 0 0) 0x7f9270160340 con 0x7f92700cf2a0 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9270160060 con 0x7f92700cf2a0 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9276800640 1 -- 172.21.15.39:0/158577104 >> v1:172.21.15.71:6789/0 conn(0x7f92700cf2a0 legacy=0x7f927006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9276800640 1 -- 172.21.15.39:0/158577104 >> v1:172.21.15.39:6789/0 conn(0x7f9270145820 legacy=0x7f92700b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9276800640 1 -- 172.21.15.39:0/158577104 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9270160620 con 0x7f927006fc80 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.259+0000 7f9276800640 1 --2- 172.21.15.39:0/158577104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927006fc80 0x7f92700cda50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f926c009d90 tx=0x7f926c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede8d8686c0fcde1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0b2070 con 0x7f927006fc80 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0a5850 con 0x7f927006fc80 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9274a00640 1 -- 172.21.15.39:0/158577104 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a5c20 con 0x7f927006fc80 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- 172.21.15.39:0/158577104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927006fc80 msgr2=0x7f92700cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 --2- 172.21.15.39:0/158577104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927006fc80 0x7f92700cda50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f926c009d90 tx=0x7f926c01c970 comp rx=0 tx=0).stop 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- 172.21.15.39:0/158577104 shutdown_connections 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 --2- 172.21.15.39:0/158577104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927006fc80 0x7f92700cda50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- 172.21.15.39:0/158577104 >> 172.21.15.39:0/158577104 conn(0x7f92700b2af0 msgr2=0x7f92700b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:53.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- 172.21.15.39:0/158577104 shutdown_connections 2024-04-26T23:27:53.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- 172.21.15.39:0/158577104 wait complete. 2024-04-26T23:27:53.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 Processor -- start 2024-04-26T23:27:53.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- start start 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f927006fc80 0x7f92700b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92700cf2a0 0x7f9270140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f927015fdb0 con 0x7f9270145820 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f927015fc30 con 0x7f927006fc80 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9278800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f927006e460 con 0x7f92700cf2a0 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9276800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9276800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54932/0 (socket says 172.21.15.39:54932) 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9276800640 1 -- 172.21.15.39:0/2062072633 learned_addr learned my addr 172.21.15.39:0/2062072633 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9275e00640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f927006fc80 0x7f92700b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.263+0000 7f9275400640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92700cf2a0 0x7f9270140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 -- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92700cf2a0 msgr2=0x7f9270140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92700cf2a0 0x7f9270140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 -- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f927006fc80 msgr2=0x7f92700b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f927006fc80 0x7f92700b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 -- 172.21.15.39:0/2062072633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92700b1a50 con 0x7f9270145820 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9276800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b0040 tx=0x7f926c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0b2050 con 0x7f9270145820 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0be070 con 0x7f9270145820 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92700b1d30 con 0x7f9270145820 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0ad890 con 0x7f9270145820 2024-04-26T23:27:53.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92700b22f0 con 0x7f9270145820 2024-04-26T23:27:53.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9270050740 con 0x7f9270145820 2024-04-26T23:27:53.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f926c0ada30 con 0x7f9270145820 2024-04-26T23:27:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 0x7f925406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f926c121af0 con 0x7f9270145820 2024-04-26T23:27:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.267+0000 7f9275e00640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 0x7f925406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.271+0000 7f9275e00640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 0x7f925406a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9264000f70 tx=0x7f9264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:53.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.271+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f926c016560 con 0x7f9270145820 2024-04-26T23:27:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.435+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92701536c0 con 0x7f9254068380 2024-04-26T23:27:53.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.443+0000 7f926a000640 1 -- 172.21.15.39:0/2062072633 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239847 (secure 0 0 0) 0x7f92701536c0 con 0x7f9254068380 2024-04-26T23:27:53.447 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:53.449 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 msgr2=0x7f925406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 0x7f925406a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9264000f70 tx=0x7f9264009040 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 msgr2=0x7f927013fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b0040 tx=0x7f926c019710 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 shutdown_connections 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9254068380 0x7f925406a840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9270145820 0x7f927013fb00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92700cf2a0 0x7f9270140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 --2- 172.21.15.39:0/2062072633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f927006fc80 0x7f92700b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 >> 172.21.15.39:0/2062072633 conn(0x7f92700b2af0 msgr2=0x7f92700d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 shutdown_connections 2024-04-26T23:27:53.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:53.447+0000 7f9278800640 1 -- 172.21.15.39:0/2062072633 wait complete. 2024-04-26T23:27:53.468 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-04-26T23:27:51.679449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238464,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":5775360,"data_stored":3099480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948153"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737550+0000","last_change":"2024-04-26T23:27:45.737550+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737550+0000","last_undegraded":"2024-04-26T23:27:45.737550+0000","last_fullsized":"2024-04-26T23:27:45.737550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737171+0000","last_change":"2024-04-26T23:27:45.737171+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737171+0000","last_undegraded":"2024-04-26T23:27:45.737171+0000","last_fullsized":"2024-04-26T23:27:45.737171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738705+0000","last_change":"2024-04-26T23:27:45.738705+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738705+0000","last_undegraded":"2024-04-26T23:27:45.738705+0000","last_fullsized":"2024-04-26T23:27:45.738705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733907+0000","last_change":"2024-04-26T23:27:45.733907+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733907+0000","last_undegraded":"2024-04-26T23:27:45.733907+0000","last_fullsized":"2024-04-26T23:27:45.733907+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733878+0000","last_change":"2024-04-26T23:27:45.733878+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733878+0000","last_undegraded":"2024-04-26T23:27:45.733878+0000","last_fullsized":"2024-04-26T23:27:45.733878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737729+0000","last_change":"2024-04-26T23:27:45.737729+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737729+0000","last_undegraded":"2024-04-26T23:27:45.737729+0000","last_fullsized":"2024-04-26T23:27:45.737729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734269+0000","last_change":"2024-04-26T23:27:45.734269+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734269+0000","last_undegraded":"2024-04-26T23:27:45.734269+0000","last_fullsized":"2024-04-26T23:27:45.734269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732265+0000","last_change":"2024-04-26T23:27:45.732265+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732265+0000","last_undegraded":"2024-04-26T23:27:45.732265+0000","last_fullsized":"2024-04-26T23:27:45.732265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740040+0000","last_change":"2024-04-26T23:27:45.740040+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740040+0000","last_undegraded":"2024-04-26T23:27:45.740040+0000","last_fullsized":"2024-04-26T23:27:45.740040+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736709+0000","last_change":"2024-04-26T23:27:45.736709+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736709+0000","last_undegraded":"2024-04-26T23:27:45.736709+0000","last_fullsized":"2024-04-26T23:27:45.736709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.740034+0000","last_change":"2024-04-26T23:27:45.740034+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.740034+0000","last_undegraded":"2024-04-26T23:27:45.740034+0000","last_fullsized":"2024-04-26T23:27:45.740034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733892+0000","last_change":"2024-04-26T23:27:45.733892+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733892+0000","last_undegraded":"2024-04-26T23:27:45.733892+0000","last_fullsized":"2024-04-26T23:27:45.733892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736745+0000","last_change":"2024-04-26T23:27:45.736745+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736745+0000","last_undegraded":"2024-04-26T23:27:45.736745+0000","last_fullsized":"2024-04-26T23:27:45.736745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745351+0000","last_change":"2024-04-26T23:27:45.745351+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745351+0000","last_undegraded":"2024-04-26T23:27:45.745351+0000","last_fullsized":"2024-04-26T23:27:45.745351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733808+0000","last_change":"2024-04-26T23:27:45.733808+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733808+0000","last_undegraded":"2024-04-26T23:27:45.733808+0000","last_fullsized":"2024-04-26T23:27:45.733808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.739930+0000","last_change":"2024-04-26T23:27:45.739930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.739930+0000","last_undegraded":"2024-04-26T23:27:45.739930+0000","last_fullsized":"2024-04-26T23:27:45.739930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736501+0000","last_change":"2024-04-26T23:27:45.736501+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736501+0000","last_undegraded":"2024-04-26T23:27:45.736501+0000","last_fullsized":"2024-04-26T23:27:45.736501+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738292+0000","last_change":"2024-04-26T23:27:45.738292+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738292+0000","last_undegraded":"2024-04-26T23:27:45.738292+0000","last_fullsized":"2024-04-26T23:27:45.738292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.733804+0000","last_change":"2024-04-26T23:27:45.733804+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.733804+0000","last_undegraded":"2024-04-26T23:27:45.733804+0000","last_fullsized":"2024-04-26T23:27:45.733804+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.738280+0000","last_change":"2024-04-26T23:27:45.738280+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.738280+0000","last_undegraded":"2024-04-26T23:27:45.738280+0000","last_fullsized":"2024-04-26T23:27:45.738280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.735930+0000","last_change":"2024-04-26T23:27:45.735930+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.735930+0000","last_undegraded":"2024-04-26T23:27:45.735930+0000","last_fullsized":"2024-04-26T23:27:45.735930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734363+0000","last_change":"2024-04-26T23:27:45.734363+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734363+0000","last_undegraded":"2024-04-26T23:27:45.734363+0000","last_fullsized":"2024-04-26T23:27:45.734363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732255+0000","last_change":"2024-04-26T23:27:45.732255+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732255+0000","last_undegraded":"2024-04-26T23:27:45.732255+0000","last_fullsized":"2024-04-26T23:27:45.732255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734384+0000","last_change":"2024-04-26T23:27:45.734384+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734384+0000","last_undegraded":"2024-04-26T23:27:45.734384+0000","last_fullsized":"2024-04-26T23:27:45.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.737835+0000","last_change":"2024-04-26T23:27:45.737835+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.737835+0000","last_undegraded":"2024-04-26T23:27:45.737835+0000","last_fullsized":"2024-04-26T23:27:45.737835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745492+0000","last_change":"2024-04-26T23:27:45.745492+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745492+0000","last_undegraded":"2024-04-26T23:27:45.745492+0000","last_fullsized":"2024-04-26T23:27:45.745492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732381+0000","last_change":"2024-04-26T23:27:45.732381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732381+0000","last_undegraded":"2024-04-26T23:27:45.732381+0000","last_fullsized":"2024-04-26T23:27:45.732381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734831+0000","last_change":"2024-04-26T23:27:45.734831+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734831+0000","last_undegraded":"2024-04-26T23:27:45.734831+0000","last_fullsized":"2024-04-26T23:27:45.734831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.732392+0000","last_change":"2024-04-26T23:27:45.732392+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.732392+0000","last_undegraded":"2024-04-26T23:27:45.732392+0000","last_fullsized":"2024-04-26T23:27:45.732392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.734381+0000","last_change":"2024-04-26T23:27:45.734381+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.734381+0000","last_undegraded":"2024-04-26T23:27:45.734381+0000","last_fullsized":"2024-04-26T23:27:45.734381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.736050+0000","last_change":"2024-04-26T23:27:45.736050+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.736050+0000","last_undegraded":"2024-04-26T23:27:45.736050+0000","last_fullsized":"2024-04-26T23:27:45.736050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:27:46.729001+0000","last_change":"2024-04-26T23:27:46.729001+0000","last_active":"2024-04-26T23:27:46.729001+0000","last_peered":"2024-04-26T23:27:46.729001+0000","last_clean":"2024-04-26T23:27:46.729001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:46.729001+0000","last_undegraded":"2024-04-26T23:27:46.729001+0000","last_fullsized":"2024-04-26T23:27:46.729001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-26T23:27:45.745362+0000","last_change":"2024-04-26T23:27:45.745362+0000","last_active":"2024-04-26T23:27:45.721041+0000","last_peered":"2024-04-26T23:27:45.721041+0000","last_clean":"2024-04-26T23:27:45.721041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:27:45.745362+0000","last_undegraded":"2024-04-26T23:27:45.745362+0000","last_fullsized":"2024-04-26T23:27:45.745362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":221,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T23:27:45.740507+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:45.740507+0000","last_peered":"2024-04-26T23:27:45.740507+0000","last_clean":"2024-04-26T23:27:45.740507+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:45.740507+0000","last_undegraded":"2024-04-26T23:27:45.740507+0000","last_fullsized":"2024-04-26T23:27:45.740507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":239843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":830211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:56.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:27:56.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 Processor -- start 2024-04-26T23:27:56.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 -- start start 2024-04-26T23:27:56.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c15e860 0x7fe82c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe82c0b1d10 0x7fe82c0d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe82c0d3910 0x7fe82c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c0d1b70 con 0x7fe82c0d3910 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c0d1e50 con 0x7fe82c0b1d10 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe833000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c0ce660 con 0x7fe82c15e860 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe832600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe82c0d3910 0x7fe82c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe832600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe82c0d3910 0x7fe82c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54944/0 (socket says 172.21.15.39:54944) 2024-04-26T23:27:56.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe832600640 1 -- 172.21.15.39:0/173074694 learned_addr learned my addr 172.21.15.39:0/173074694 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe831200640 1 --2- 172.21.15.39:0/173074694 >> v2:172.21.15.71:3300/0 conn(0x7fe82c0b1d10 0x7fe82c0d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.623+0000 7fe831c00640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c15e860 0x7fe82c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 -- 172.21.15.39:0/173074694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c15e860 msgr2=0x7fe82c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c15e860 0x7fe82c0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 -- 172.21.15.39:0/173074694 >> v2:172.21.15.71:3300/0 conn(0x7fe82c0b1d10 msgr2=0x7fe82c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 --2- 172.21.15.39:0/173074694 >> v2:172.21.15.71:3300/0 conn(0x7fe82c0b1d10 0x7fe82c0d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 -- 172.21.15.39:0/173074694 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0ce940 con 0x7fe82c0d3910 2024-04-26T23:27:56.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe832600640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c0d3910 0x7fe82c0cf320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe82c06a190 tx=0x7fe82401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f52d952d329a2f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:56.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe82be00640 1 -- 172.21.15.39:0/173074694 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a55a0 con 0x7fe82c0d3910 2024-04-26T23:27:56.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe82be00640 1 -- 172.21.15.39:0/173074694 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8240a5740 con 0x7fe82c0d3910 2024-04-26T23:27:56.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe82be00640 1 -- 172.21.15.39:0/173074694 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a5b10 con 0x7fe82c0d3910 2024-04-26T23:27:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 -- 172.21.15.39:0/173074694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c0d3910 msgr2=0x7fe82c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c0d3910 0x7fe82c0cf320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe82c06a190 tx=0x7fe82401c700 comp rx=0 tx=0).stop 2024-04-26T23:27:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 -- 172.21.15.39:0/173074694 shutdown_connections 2024-04-26T23:27:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c0d3910 0x7fe82c0cf320 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 --2- 172.21.15.39:0/173074694 >> v2:172.21.15.71:3300/0 conn(0x7fe82c0b1d10 0x7fe82c0d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 --2- 172.21.15.39:0/173074694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c15e860 0x7fe82c0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 -- 172.21.15.39:0/173074694 >> 172.21.15.39:0/173074694 conn(0x7fe82c0d2df0 msgr2=0x7fe82c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 -- 172.21.15.39:0/173074694 shutdown_connections 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.627+0000 7fe833000640 1 -- 172.21.15.39:0/173074694 wait complete. 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 Processor -- start 2024-04-26T23:27:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 -- start start 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c0b1d10 0x7fe82c0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe82c0d3910 0x7fe82c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15f200 con 0x7fe82c15e860 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15f080 con 0x7fe82c0d3910 2024-04-26T23:27:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe833000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c15f380 con 0x7fe82c0b1d10 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54954/0 (socket says 172.21.15.39:54954) 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 -- 172.21.15.39:0/2363966316 learned_addr learned my addr 172.21.15.39:0/2363966316 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe831200640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe82c0d3910 0x7fe82c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe831c00640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c0b1d10 0x7fe82c0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 -- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c0b1d10 msgr2=0x7fe82c0c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c0b1d10 0x7fe82c0c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 -- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe82c0d3910 msgr2=0x7fe82c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe82c0d3910 0x7fe82c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 -- 172.21.15.39:0/2363966316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c15be10 con 0x7fe82c15e860 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe832600640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe82401adb0 tx=0x7fe8240194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824009510 con 0x7fe82c15e860 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.631+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8240be070 con 0x7fe82c15e860 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c15c0f0 con 0x7fe82c15e860 2024-04-26T23:27:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8240b88d0 con 0x7fe82c15e860 2024-04-26T23:27:56.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c15c6b0 con 0x7fe82c15e860 2024-04-26T23:27:56.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c0506d0 con 0x7fe82c15e860 2024-04-26T23:27:56.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8240b8a70 con 0x7fe82c15e860 2024-04-26T23:27:56.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe829600640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 0x7fe80c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:56.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fe824121910 con 0x7fe82c15e860 2024-04-26T23:27:56.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.635+0000 7fe831c00640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 0x7fe80c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:56.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.639+0000 7fe831c00640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 0x7fe80c06a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe8200079c0 tx=0x7fe820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:56.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.639+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe8240165e0 con 0x7fe82c15e860 2024-04-26T23:27:56.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.803+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe82c0ce350 con 0x7fe80c068380 2024-04-26T23:27:56.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.811+0000 7fe829600640 1 -- 172.21.15.39:0/2363966316 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7fe82c0ce350 con 0x7fe80c068380 2024-04-26T23:27:56.815 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:56.816 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 msgr2=0x7fe80c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 0x7fe80c06a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe8200079c0 tx=0x7fe820008040 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 msgr2=0x7fe82c154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe82401adb0 tx=0x7fe8240194a0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 shutdown_connections 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe80c068380 0x7fe80c06a840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe82c15e860 0x7fe82c154150 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe82c0d3910 0x7fe82c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 --2- 172.21.15.39:0/2363966316 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe82c0b1d10 0x7fe82c0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 >> 172.21.15.39:0/2363966316 conn(0x7fe82c0d2df0 msgr2=0x7fe82c0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:56.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 shutdown_connections 2024-04-26T23:27:56.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:56.815+0000 7fe833000640 1 -- 172.21.15.39:0/2363966316 wait complete. 2024-04-26T23:27:56.836 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-04-26T23:27:55.680306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238832,"kb_used_data":5992,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735888,"statfs":{"total":773094113280,"available":772849549312,"internally_reserved":0,"allocated":6135808,"data_stored":3259036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001850"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752511+0000","last_change":"2024-04-26T23:27:47.764688+0000","last_active":"2024-04-26T23:27:48.752511+0000","last_peered":"2024-04-26T23:27:48.752511+0000","last_clean":"2024-04-26T23:27:48.752511+0000","last_became_active":"2024-04-26T23:27:47.764427+0000","last_became_peered":"2024-04-26T23:27:47.764427+0000","last_unstale":"2024-04-26T23:27:48.752511+0000","last_undegraded":"2024-04-26T23:27:48.752511+0000","last_fullsized":"2024-04-26T23:27:48.752511+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:15.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810221+0000","last_change":"2024-04-26T23:27:47.759847+0000","last_active":"2024-04-26T23:27:48.810221+0000","last_peered":"2024-04-26T23:27:48.810221+0000","last_clean":"2024-04-26T23:27:48.810221+0000","last_became_active":"2024-04-26T23:27:47.759546+0000","last_became_peered":"2024-04-26T23:27:47.759546+0000","last_unstale":"2024-04-26T23:27:48.810221+0000","last_undegraded":"2024-04-26T23:27:48.810221+0000","last_fullsized":"2024-04-26T23:27:48.810221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:33.412877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809757+0000","last_change":"2024-04-26T23:27:47.774043+0000","last_active":"2024-04-26T23:27:48.809757+0000","last_peered":"2024-04-26T23:27:48.809757+0000","last_clean":"2024-04-26T23:27:48.809757+0000","last_became_active":"2024-04-26T23:27:47.773662+0000","last_became_peered":"2024-04-26T23:27:47.773662+0000","last_unstale":"2024-04-26T23:27:48.809757+0000","last_undegraded":"2024-04-26T23:27:48.809757+0000","last_fullsized":"2024-04-26T23:27:48.809757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:56:04.514052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753518+0000","last_change":"2024-04-26T23:27:47.770399+0000","last_active":"2024-04-26T23:27:48.753518+0000","last_peered":"2024-04-26T23:27:48.753518+0000","last_clean":"2024-04-26T23:27:48.753518+0000","last_became_active":"2024-04-26T23:27:47.769863+0000","last_became_peered":"2024-04-26T23:27:47.769863+0000","last_unstale":"2024-04-26T23:27:48.753518+0000","last_undegraded":"2024-04-26T23:27:48.753518+0000","last_fullsized":"2024-04-26T23:27:48.753518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:20.610791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752031+0000","last_change":"2024-04-26T23:27:47.772556+0000","last_active":"2024-04-26T23:27:48.752031+0000","last_peered":"2024-04-26T23:27:48.752031+0000","last_clean":"2024-04-26T23:27:48.752031+0000","last_became_active":"2024-04-26T23:27:47.772257+0000","last_became_peered":"2024-04-26T23:27:47.772257+0000","last_unstale":"2024-04-26T23:27:48.752031+0000","last_undegraded":"2024-04-26T23:27:48.752031+0000","last_fullsized":"2024-04-26T23:27:48.752031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:35.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777289+0000","last_change":"2024-04-26T23:27:47.773669+0000","last_active":"2024-04-26T23:27:48.777289+0000","last_peered":"2024-04-26T23:27:48.777289+0000","last_clean":"2024-04-26T23:27:48.777289+0000","last_became_active":"2024-04-26T23:27:47.773373+0000","last_became_peered":"2024-04-26T23:27:47.773373+0000","last_unstale":"2024-04-26T23:27:48.777289+0000","last_undegraded":"2024-04-26T23:27:48.777289+0000","last_fullsized":"2024-04-26T23:27:48.777289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:08.317397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752743+0000","last_change":"2024-04-26T23:27:47.764483+0000","last_active":"2024-04-26T23:27:48.752743+0000","last_peered":"2024-04-26T23:27:48.752743+0000","last_clean":"2024-04-26T23:27:48.752743+0000","last_became_active":"2024-04-26T23:27:47.764176+0000","last_became_peered":"2024-04-26T23:27:47.764176+0000","last_unstale":"2024-04-26T23:27:48.752743+0000","last_undegraded":"2024-04-26T23:27:48.752743+0000","last_fullsized":"2024-04-26T23:27:48.752743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:43.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809982+0000","last_change":"2024-04-26T23:27:47.760988+0000","last_active":"2024-04-26T23:27:48.809982+0000","last_peered":"2024-04-26T23:27:48.809982+0000","last_clean":"2024-04-26T23:27:48.809982+0000","last_became_active":"2024-04-26T23:27:47.760698+0000","last_became_peered":"2024-04-26T23:27:47.760698+0000","last_unstale":"2024-04-26T23:27:48.809982+0000","last_undegraded":"2024-04-26T23:27:48.809982+0000","last_fullsized":"2024-04-26T23:27:48.809982+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:58.939367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753657+0000","last_change":"2024-04-26T23:27:47.775914+0000","last_active":"2024-04-26T23:27:48.753657+0000","last_peered":"2024-04-26T23:27:48.753657+0000","last_clean":"2024-04-26T23:27:48.753657+0000","last_became_active":"2024-04-26T23:27:47.775655+0000","last_became_peered":"2024-04-26T23:27:47.775655+0000","last_unstale":"2024-04-26T23:27:48.753657+0000","last_undegraded":"2024-04-26T23:27:48.753657+0000","last_fullsized":"2024-04-26T23:27:48.753657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:59:43.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810118+0000","last_change":"2024-04-26T23:27:47.781373+0000","last_active":"2024-04-26T23:27:48.810118+0000","last_peered":"2024-04-26T23:27:48.810118+0000","last_clean":"2024-04-26T23:27:48.810118+0000","last_became_active":"2024-04-26T23:27:47.779239+0000","last_became_peered":"2024-04-26T23:27:47.779239+0000","last_unstale":"2024-04-26T23:27:48.810118+0000","last_undegraded":"2024-04-26T23:27:48.810118+0000","last_fullsized":"2024-04-26T23:27:48.810118+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:19.456637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810170+0000","last_change":"2024-04-26T23:27:47.770367+0000","last_active":"2024-04-26T23:27:48.810170+0000","last_peered":"2024-04-26T23:27:48.810170+0000","last_clean":"2024-04-26T23:27:48.810170+0000","last_became_active":"2024-04-26T23:27:47.770102+0000","last_became_peered":"2024-04-26T23:27:47.770102+0000","last_unstale":"2024-04-26T23:27:48.810170+0000","last_undegraded":"2024-04-26T23:27:48.810170+0000","last_fullsized":"2024-04-26T23:27:48.810170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:01.144480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753666+0000","last_change":"2024-04-26T23:27:47.770172+0000","last_active":"2024-04-26T23:27:48.753666+0000","last_peered":"2024-04-26T23:27:48.753666+0000","last_clean":"2024-04-26T23:27:48.753666+0000","last_became_active":"2024-04-26T23:27:47.769477+0000","last_became_peered":"2024-04-26T23:27:47.769477+0000","last_unstale":"2024-04-26T23:27:48.753666+0000","last_undegraded":"2024-04-26T23:27:48.753666+0000","last_fullsized":"2024-04-26T23:27:48.753666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:08.317397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.780325+0000","last_change":"2024-04-26T23:27:47.778772+0000","last_active":"2024-04-26T23:27:48.780325+0000","last_peered":"2024-04-26T23:27:48.780325+0000","last_clean":"2024-04-26T23:27:48.780325+0000","last_became_active":"2024-04-26T23:27:47.778004+0000","last_became_peered":"2024-04-26T23:27:47.778004+0000","last_unstale":"2024-04-26T23:27:48.780325+0000","last_undegraded":"2024-04-26T23:27:48.780325+0000","last_fullsized":"2024-04-26T23:27:48.780325+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:32:53.834429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753221+0000","last_change":"2024-04-26T23:27:47.764685+0000","last_active":"2024-04-26T23:27:48.753221+0000","last_peered":"2024-04-26T23:27:48.753221+0000","last_clean":"2024-04-26T23:27:48.753221+0000","last_became_active":"2024-04-26T23:27:47.764400+0000","last_became_peered":"2024-04-26T23:27:47.764400+0000","last_unstale":"2024-04-26T23:27:48.753221+0000","last_undegraded":"2024-04-26T23:27:48.753221+0000","last_fullsized":"2024-04-26T23:27:48.753221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:30.434354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752978+0000","last_change":"2024-04-26T23:27:47.762125+0000","last_active":"2024-04-26T23:27:48.752978+0000","last_peered":"2024-04-26T23:27:48.752978+0000","last_clean":"2024-04-26T23:27:48.752978+0000","last_became_active":"2024-04-26T23:27:47.761861+0000","last_became_peered":"2024-04-26T23:27:47.761861+0000","last_unstale":"2024-04-26T23:27:48.752978+0000","last_undegraded":"2024-04-26T23:27:48.752978+0000","last_fullsized":"2024-04-26T23:27:48.752978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:05.023919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777266+0000","last_change":"2024-04-26T23:27:47.780241+0000","last_active":"2024-04-26T23:27:48.777266+0000","last_peered":"2024-04-26T23:27:48.777266+0000","last_clean":"2024-04-26T23:27:48.777266+0000","last_became_active":"2024-04-26T23:27:47.779994+0000","last_became_peered":"2024-04-26T23:27:47.779994+0000","last_unstale":"2024-04-26T23:27:48.777266+0000","last_undegraded":"2024-04-26T23:27:48.777266+0000","last_fullsized":"2024-04-26T23:27:48.777266+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:20.610791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810492+0000","last_change":"2024-04-26T23:27:47.775393+0000","last_active":"2024-04-26T23:27:48.810492+0000","last_peered":"2024-04-26T23:27:48.810492+0000","last_clean":"2024-04-26T23:27:48.810492+0000","last_became_active":"2024-04-26T23:27:47.775194+0000","last_became_peered":"2024-04-26T23:27:47.775194+0000","last_unstale":"2024-04-26T23:27:48.810492+0000","last_undegraded":"2024-04-26T23:27:48.810492+0000","last_fullsized":"2024-04-26T23:27:48.810492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:17.394222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809857+0000","last_change":"2024-04-26T23:27:47.776563+0000","last_active":"2024-04-26T23:27:48.809857+0000","last_peered":"2024-04-26T23:27:48.809857+0000","last_clean":"2024-04-26T23:27:48.809857+0000","last_became_active":"2024-04-26T23:27:47.776261+0000","last_became_peered":"2024-04-26T23:27:47.776261+0000","last_unstale":"2024-04-26T23:27:48.809857+0000","last_undegraded":"2024-04-26T23:27:48.809857+0000","last_fullsized":"2024-04-26T23:27:48.809857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:37.991332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752287+0000","last_change":"2024-04-26T23:27:47.763946+0000","last_active":"2024-04-26T23:27:48.752287+0000","last_peered":"2024-04-26T23:27:48.752287+0000","last_clean":"2024-04-26T23:27:48.752287+0000","last_became_active":"2024-04-26T23:27:47.763696+0000","last_became_peered":"2024-04-26T23:27:47.763696+0000","last_unstale":"2024-04-26T23:27:48.752287+0000","last_undegraded":"2024-04-26T23:27:48.752287+0000","last_fullsized":"2024-04-26T23:27:48.752287+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:11.528028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809655+0000","last_change":"2024-04-26T23:27:47.762006+0000","last_active":"2024-04-26T23:27:48.809655+0000","last_peered":"2024-04-26T23:27:48.809655+0000","last_clean":"2024-04-26T23:27:48.809655+0000","last_became_active":"2024-04-26T23:27:47.761727+0000","last_became_peered":"2024-04-26T23:27:47.761727+0000","last_unstale":"2024-04-26T23:27:48.809655+0000","last_undegraded":"2024-04-26T23:27:48.809655+0000","last_fullsized":"2024-04-26T23:27:48.809655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:36.376765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809816+0000","last_change":"2024-04-26T23:27:47.775116+0000","last_active":"2024-04-26T23:27:48.809816+0000","last_peered":"2024-04-26T23:27:48.809816+0000","last_clean":"2024-04-26T23:27:48.809816+0000","last_became_active":"2024-04-26T23:27:47.774858+0000","last_became_peered":"2024-04-26T23:27:47.774858+0000","last_unstale":"2024-04-26T23:27:48.809816+0000","last_undegraded":"2024-04-26T23:27:48.809816+0000","last_fullsized":"2024-04-26T23:27:48.809816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:57.439546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810466+0000","last_change":"2024-04-26T23:27:47.764966+0000","last_active":"2024-04-26T23:27:48.810466+0000","last_peered":"2024-04-26T23:27:48.810466+0000","last_clean":"2024-04-26T23:27:48.810466+0000","last_became_active":"2024-04-26T23:27:47.764699+0000","last_became_peered":"2024-04-26T23:27:47.764699+0000","last_unstale":"2024-04-26T23:27:48.810466+0000","last_undegraded":"2024-04-26T23:27:48.810466+0000","last_fullsized":"2024-04-26T23:27:48.810466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:32.821157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809722+0000","last_change":"2024-04-26T23:27:47.784618+0000","last_active":"2024-04-26T23:27:48.809722+0000","last_peered":"2024-04-26T23:27:48.809722+0000","last_clean":"2024-04-26T23:27:48.809722+0000","last_became_active":"2024-04-26T23:27:47.783803+0000","last_became_peered":"2024-04-26T23:27:47.783803+0000","last_unstale":"2024-04-26T23:27:48.809722+0000","last_undegraded":"2024-04-26T23:27:48.809722+0000","last_fullsized":"2024-04-26T23:27:48.809722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:00.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.780138+0000","last_change":"2024-04-26T23:27:47.773658+0000","last_active":"2024-04-26T23:27:48.780138+0000","last_peered":"2024-04-26T23:27:48.780138+0000","last_clean":"2024-04-26T23:27:48.780138+0000","last_became_active":"2024-04-26T23:27:47.773310+0000","last_became_peered":"2024-04-26T23:27:47.773310+0000","last_unstale":"2024-04-26T23:27:48.780138+0000","last_undegraded":"2024-04-26T23:27:48.780138+0000","last_fullsized":"2024-04-26T23:27:48.780138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:16:56.369969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752586+0000","last_change":"2024-04-26T23:27:47.763731+0000","last_active":"2024-04-26T23:27:48.752586+0000","last_peered":"2024-04-26T23:27:48.752586+0000","last_clean":"2024-04-26T23:27:48.752586+0000","last_became_active":"2024-04-26T23:27:47.763424+0000","last_became_peered":"2024-04-26T23:27:47.763424+0000","last_unstale":"2024-04-26T23:27:48.752586+0000","last_undegraded":"2024-04-26T23:27:48.752586+0000","last_fullsized":"2024-04-26T23:27:48.752586+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:37.996895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753966+0000","last_change":"2024-04-26T23:27:47.766168+0000","last_active":"2024-04-26T23:27:48.753966+0000","last_peered":"2024-04-26T23:27:48.753966+0000","last_clean":"2024-04-26T23:27:48.753966+0000","last_became_active":"2024-04-26T23:27:47.765887+0000","last_became_peered":"2024-04-26T23:27:47.765887+0000","last_unstale":"2024-04-26T23:27:48.753966+0000","last_undegraded":"2024-04-26T23:27:48.753966+0000","last_fullsized":"2024-04-26T23:27:48.753966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:39.796129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777518+0000","last_change":"2024-04-26T23:27:47.780932+0000","last_active":"2024-04-26T23:27:48.777518+0000","last_peered":"2024-04-26T23:27:48.777518+0000","last_clean":"2024-04-26T23:27:48.777518+0000","last_became_active":"2024-04-26T23:27:47.780671+0000","last_became_peered":"2024-04-26T23:27:47.780671+0000","last_unstale":"2024-04-26T23:27:48.777518+0000","last_undegraded":"2024-04-26T23:27:48.777518+0000","last_fullsized":"2024-04-26T23:27:48.777518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:57.472612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752245+0000","last_change":"2024-04-26T23:27:47.769142+0000","last_active":"2024-04-26T23:27:48.752245+0000","last_peered":"2024-04-26T23:27:48.752245+0000","last_clean":"2024-04-26T23:27:48.752245+0000","last_became_active":"2024-04-26T23:27:47.768886+0000","last_became_peered":"2024-04-26T23:27:47.768886+0000","last_unstale":"2024-04-26T23:27:48.752245+0000","last_undegraded":"2024-04-26T23:27:48.752245+0000","last_fullsized":"2024-04-26T23:27:48.752245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.592695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809804+0000","last_change":"2024-04-26T23:27:47.769377+0000","last_active":"2024-04-26T23:27:48.809804+0000","last_peered":"2024-04-26T23:27:48.809804+0000","last_clean":"2024-04-26T23:27:48.809804+0000","last_became_active":"2024-04-26T23:27:47.769107+0000","last_became_peered":"2024-04-26T23:27:47.769107+0000","last_unstale":"2024-04-26T23:27:48.809804+0000","last_undegraded":"2024-04-26T23:27:48.809804+0000","last_fullsized":"2024-04-26T23:27:48.809804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:51.479511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809742+0000","last_change":"2024-04-26T23:27:47.778285+0000","last_active":"2024-04-26T23:27:48.809742+0000","last_peered":"2024-04-26T23:27:48.809742+0000","last_clean":"2024-04-26T23:27:48.809742+0000","last_became_active":"2024-04-26T23:27:47.777957+0000","last_became_peered":"2024-04-26T23:27:47.777957+0000","last_unstale":"2024-04-26T23:27:48.809742+0000","last_undegraded":"2024-04-26T23:27:48.809742+0000","last_fullsized":"2024-04-26T23:27:48.809742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:12.457849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752026+0000","last_change":"2024-04-26T23:27:47.762356+0000","last_active":"2024-04-26T23:27:48.752026+0000","last_peered":"2024-04-26T23:27:48.752026+0000","last_clean":"2024-04-26T23:27:48.752026+0000","last_became_active":"2024-04-26T23:27:47.761283+0000","last_became_peered":"2024-04-26T23:27:47.761283+0000","last_unstale":"2024-04-26T23:27:48.752026+0000","last_undegraded":"2024-04-26T23:27:48.752026+0000","last_fullsized":"2024-04-26T23:27:48.752026+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:18:25.234595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777248+0000","last_change":"2024-04-26T23:27:47.761646+0000","last_active":"2024-04-26T23:27:48.777248+0000","last_peered":"2024-04-26T23:27:48.777248+0000","last_clean":"2024-04-26T23:27:48.777248+0000","last_became_active":"2024-04-26T23:27:47.761377+0000","last_became_peered":"2024-04-26T23:27:47.761377+0000","last_unstale":"2024-04-26T23:27:48.777248+0000","last_undegraded":"2024-04-26T23:27:48.777248+0000","last_fullsized":"2024-04-26T23:27:48.777248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:28.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777725+0000","last_change":"2024-04-26T23:27:47.776166+0000","last_active":"2024-04-26T23:27:48.777725+0000","last_peered":"2024-04-26T23:27:48.777725+0000","last_clean":"2024-04-26T23:27:48.777725+0000","last_became_active":"2024-04-26T23:27:47.775806+0000","last_became_peered":"2024-04-26T23:27:47.775806+0000","last_unstale":"2024-04-26T23:27:48.777725+0000","last_undegraded":"2024-04-26T23:27:48.777725+0000","last_fullsized":"2024-04-26T23:27:48.777725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:37.991941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777698+0000","last_change":"2024-04-26T23:27:46.743507+0000","last_active":"2024-04-26T23:27:48.777698+0000","last_peered":"2024-04-26T23:27:48.777698+0000","last_clean":"2024-04-26T23:27:48.777698+0000","last_became_active":"2024-04-26T23:27:46.743184+0000","last_became_peered":"2024-04-26T23:27:46.743184+0000","last_unstale":"2024-04-26T23:27:48.777698+0000","last_undegraded":"2024-04-26T23:27:48.777698+0000","last_fullsized":"2024-04-26T23:27:48.777698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:59.534502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810374+0000","last_change":"2024-04-26T23:27:47.771103+0000","last_active":"2024-04-26T23:27:48.810374+0000","last_peered":"2024-04-26T23:27:48.810374+0000","last_clean":"2024-04-26T23:27:48.810374+0000","last_became_active":"2024-04-26T23:27:47.770275+0000","last_became_peered":"2024-04-26T23:27:47.770275+0000","last_unstale":"2024-04-26T23:27:48.810374+0000","last_undegraded":"2024-04-26T23:27:48.810374+0000","last_fullsized":"2024-04-26T23:27:48.810374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:08.328518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810194+0000","last_change":"2024-04-26T23:27:46.761419+0000","last_active":"2024-04-26T23:27:48.810194+0000","last_peered":"2024-04-26T23:27:48.810194+0000","last_clean":"2024-04-26T23:27:48.810194+0000","last_became_active":"2024-04-26T23:27:46.761074+0000","last_became_peered":"2024-04-26T23:27:46.761074+0000","last_unstale":"2024-04-26T23:27:48.810194+0000","last_undegraded":"2024-04-26T23:27:48.810194+0000","last_fullsized":"2024-04-26T23:27:48.810194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:38.788168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777589+0000","last_change":"2024-04-26T23:27:47.769519+0000","last_active":"2024-04-26T23:27:48.777589+0000","last_peered":"2024-04-26T23:27:48.777589+0000","last_clean":"2024-04-26T23:27:48.777589+0000","last_became_active":"2024-04-26T23:27:47.768815+0000","last_became_peered":"2024-04-26T23:27:47.768815+0000","last_unstale":"2024-04-26T23:27:48.777589+0000","last_undegraded":"2024-04-26T23:27:48.777589+0000","last_fullsized":"2024-04-26T23:27:48.777589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:48.707843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777692+0000","last_change":"2024-04-26T23:27:46.745103+0000","last_active":"2024-04-26T23:27:48.777692+0000","last_peered":"2024-04-26T23:27:48.777692+0000","last_clean":"2024-04-26T23:27:48.777692+0000","last_became_active":"2024-04-26T23:27:46.744832+0000","last_became_peered":"2024-04-26T23:27:46.744832+0000","last_unstale":"2024-04-26T23:27:48.777692+0000","last_undegraded":"2024-04-26T23:27:48.777692+0000","last_fullsized":"2024-04-26T23:27:48.777692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:00.136520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777638+0000","last_change":"2024-04-26T23:27:47.768394+0000","last_active":"2024-04-26T23:27:48.777638+0000","last_peered":"2024-04-26T23:27:48.777638+0000","last_clean":"2024-04-26T23:27:48.777638+0000","last_became_active":"2024-04-26T23:27:47.767835+0000","last_became_peered":"2024-04-26T23:27:47.767835+0000","last_unstale":"2024-04-26T23:27:48.777638+0000","last_undegraded":"2024-04-26T23:27:48.777638+0000","last_fullsized":"2024-04-26T23:27:48.777638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:25.455666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753637+0000","last_change":"2024-04-26T23:27:46.760807+0000","last_active":"2024-04-26T23:27:48.753637+0000","last_peered":"2024-04-26T23:27:48.753637+0000","last_clean":"2024-04-26T23:27:48.753637+0000","last_became_active":"2024-04-26T23:27:46.759991+0000","last_became_peered":"2024-04-26T23:27:46.759991+0000","last_unstale":"2024-04-26T23:27:48.753637+0000","last_undegraded":"2024-04-26T23:27:48.753637+0000","last_fullsized":"2024-04-26T23:27:48.753637+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:07.320558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810597+0000","last_change":"2024-04-26T23:27:47.759882+0000","last_active":"2024-04-26T23:27:48.810597+0000","last_peered":"2024-04-26T23:27:48.810597+0000","last_clean":"2024-04-26T23:27:48.810597+0000","last_became_active":"2024-04-26T23:27:47.759201+0000","last_became_peered":"2024-04-26T23:27:47.759201+0000","last_unstale":"2024-04-26T23:27:48.810597+0000","last_undegraded":"2024-04-26T23:27:48.810597+0000","last_fullsized":"2024-04-26T23:27:48.810597+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:20.481371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752744+0000","last_change":"2024-04-26T23:27:46.750433+0000","last_active":"2024-04-26T23:27:48.752744+0000","last_peered":"2024-04-26T23:27:48.752744+0000","last_clean":"2024-04-26T23:27:48.752744+0000","last_became_active":"2024-04-26T23:27:46.750170+0000","last_became_peered":"2024-04-26T23:27:46.750170+0000","last_unstale":"2024-04-26T23:27:48.752744+0000","last_undegraded":"2024-04-26T23:27:48.752744+0000","last_fullsized":"2024-04-26T23:27:48.752744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:28:22.774422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809665+0000","last_change":"2024-04-26T23:27:47.771818+0000","last_active":"2024-04-26T23:27:48.809665+0000","last_peered":"2024-04-26T23:27:48.809665+0000","last_clean":"2024-04-26T23:27:48.809665+0000","last_became_active":"2024-04-26T23:27:47.771530+0000","last_became_peered":"2024-04-26T23:27:47.771530+0000","last_unstale":"2024-04-26T23:27:48.809665+0000","last_undegraded":"2024-04-26T23:27:48.809665+0000","last_fullsized":"2024-04-26T23:27:48.809665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:45.146398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777276+0000","last_change":"2024-04-26T23:27:46.750946+0000","last_active":"2024-04-26T23:27:48.777276+0000","last_peered":"2024-04-26T23:27:48.777276+0000","last_clean":"2024-04-26T23:27:48.777276+0000","last_became_active":"2024-04-26T23:27:46.750395+0000","last_became_peered":"2024-04-26T23:27:46.750395+0000","last_unstale":"2024-04-26T23:27:48.777276+0000","last_undegraded":"2024-04-26T23:27:48.777276+0000","last_fullsized":"2024-04-26T23:27:48.777276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:29.426393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.780160+0000","last_change":"2024-04-26T23:27:47.774878+0000","last_active":"2024-04-26T23:27:48.780160+0000","last_peered":"2024-04-26T23:27:48.780160+0000","last_clean":"2024-04-26T23:27:48.780160+0000","last_became_active":"2024-04-26T23:27:47.774573+0000","last_became_peered":"2024-04-26T23:27:47.774573+0000","last_unstale":"2024-04-26T23:27:48.780160+0000","last_undegraded":"2024-04-26T23:27:48.780160+0000","last_fullsized":"2024-04-26T23:27:48.780160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:22.329255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752688+0000","last_change":"2024-04-26T23:27:46.746869+0000","last_active":"2024-04-26T23:27:48.752688+0000","last_peered":"2024-04-26T23:27:48.752688+0000","last_clean":"2024-04-26T23:27:48.752688+0000","last_became_active":"2024-04-26T23:27:46.744717+0000","last_became_peered":"2024-04-26T23:27:46.744717+0000","last_unstale":"2024-04-26T23:27:48.752688+0000","last_undegraded":"2024-04-26T23:27:48.752688+0000","last_fullsized":"2024-04-26T23:27:48.752688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:59:42.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809642+0000","last_change":"2024-04-26T23:27:47.776735+0000","last_active":"2024-04-26T23:27:48.809642+0000","last_peered":"2024-04-26T23:27:48.809642+0000","last_clean":"2024-04-26T23:27:48.809642+0000","last_became_active":"2024-04-26T23:27:47.775867+0000","last_became_peered":"2024-04-26T23:27:47.775867+0000","last_unstale":"2024-04-26T23:27:48.809642+0000","last_undegraded":"2024-04-26T23:27:48.809642+0000","last_fullsized":"2024-04-26T23:27:48.809642+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:51.513123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753452+0000","last_change":"2024-04-26T23:27:46.760611+0000","last_active":"2024-04-26T23:27:48.753452+0000","last_peered":"2024-04-26T23:27:48.753452+0000","last_clean":"2024-04-26T23:27:48.753452+0000","last_became_active":"2024-04-26T23:27:46.759743+0000","last_became_peered":"2024-04-26T23:27:46.759743+0000","last_unstale":"2024-04-26T23:27:48.753452+0000","last_undegraded":"2024-04-26T23:27:48.753452+0000","last_fullsized":"2024-04-26T23:27:48.753452+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:34.876255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.754079+0000","last_change":"2024-04-26T23:27:47.761477+0000","last_active":"2024-04-26T23:27:48.754079+0000","last_peered":"2024-04-26T23:27:48.754079+0000","last_clean":"2024-04-26T23:27:48.754079+0000","last_became_active":"2024-04-26T23:27:47.761207+0000","last_became_peered":"2024-04-26T23:27:47.761207+0000","last_unstale":"2024-04-26T23:27:48.754079+0000","last_undegraded":"2024-04-26T23:27:48.754079+0000","last_fullsized":"2024-04-26T23:27:48.754079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:19.456637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810488+0000","last_change":"2024-04-26T23:27:46.762352+0000","last_active":"2024-04-26T23:27:48.810488+0000","last_peered":"2024-04-26T23:27:48.810488+0000","last_clean":"2024-04-26T23:27:48.810488+0000","last_became_active":"2024-04-26T23:27:46.762076+0000","last_became_peered":"2024-04-26T23:27:46.762076+0000","last_unstale":"2024-04-26T23:27:48.810488+0000","last_undegraded":"2024-04-26T23:27:48.810488+0000","last_fullsized":"2024-04-26T23:27:48.810488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:52.054174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810540+0000","last_change":"2024-04-26T23:27:47.780797+0000","last_active":"2024-04-26T23:27:48.810540+0000","last_peered":"2024-04-26T23:27:48.810540+0000","last_clean":"2024-04-26T23:27:48.810540+0000","last_became_active":"2024-04-26T23:27:47.780497+0000","last_became_peered":"2024-04-26T23:27:47.780497+0000","last_unstale":"2024-04-26T23:27:48.810540+0000","last_undegraded":"2024-04-26T23:27:48.810540+0000","last_fullsized":"2024-04-26T23:27:48.810540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:22.563325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810265+0000","last_change":"2024-04-26T23:27:46.756617+0000","last_active":"2024-04-26T23:27:48.810265+0000","last_peered":"2024-04-26T23:27:48.810265+0000","last_clean":"2024-04-26T23:27:48.810265+0000","last_became_active":"2024-04-26T23:27:46.756346+0000","last_became_peered":"2024-04-26T23:27:46.756346+0000","last_unstale":"2024-04-26T23:27:48.810265+0000","last_undegraded":"2024-04-26T23:27:48.810265+0000","last_fullsized":"2024-04-26T23:27:48.810265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:56.464651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809711+0000","last_change":"2024-04-26T23:27:47.765098+0000","last_active":"2024-04-26T23:27:48.809711+0000","last_peered":"2024-04-26T23:27:48.809711+0000","last_clean":"2024-04-26T23:27:48.809711+0000","last_became_active":"2024-04-26T23:27:47.764479+0000","last_became_peered":"2024-04-26T23:27:47.764479+0000","last_unstale":"2024-04-26T23:27:48.809711+0000","last_undegraded":"2024-04-26T23:27:48.809711+0000","last_fullsized":"2024-04-26T23:27:48.809711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:27.280787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810178+0000","last_change":"2024-04-26T23:27:46.762596+0000","last_active":"2024-04-26T23:27:48.810178+0000","last_peered":"2024-04-26T23:27:48.810178+0000","last_clean":"2024-04-26T23:27:48.810178+0000","last_became_active":"2024-04-26T23:27:46.762349+0000","last_became_peered":"2024-04-26T23:27:46.762349+0000","last_unstale":"2024-04-26T23:27:48.810178+0000","last_undegraded":"2024-04-26T23:27:48.810178+0000","last_fullsized":"2024-04-26T23:27:48.810178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:20.615107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809927+0000","last_change":"2024-04-26T23:27:47.780859+0000","last_active":"2024-04-26T23:27:48.809927+0000","last_peered":"2024-04-26T23:27:48.809927+0000","last_clean":"2024-04-26T23:27:48.809927+0000","last_became_active":"2024-04-26T23:27:47.780572+0000","last_became_peered":"2024-04-26T23:27:47.780572+0000","last_unstale":"2024-04-26T23:27:48.809927+0000","last_undegraded":"2024-04-26T23:27:48.809927+0000","last_fullsized":"2024-04-26T23:27:48.809927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:27.553277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753257+0000","last_change":"2024-04-26T23:27:46.745185+0000","last_active":"2024-04-26T23:27:48.753257+0000","last_peered":"2024-04-26T23:27:48.753257+0000","last_clean":"2024-04-26T23:27:48.753257+0000","last_became_active":"2024-04-26T23:27:46.744764+0000","last_became_peered":"2024-04-26T23:27:46.744764+0000","last_unstale":"2024-04-26T23:27:48.753257+0000","last_undegraded":"2024-04-26T23:27:48.753257+0000","last_fullsized":"2024-04-26T23:27:48.753257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:04.906378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752975+0000","last_change":"2024-04-26T23:27:47.769139+0000","last_active":"2024-04-26T23:27:48.752975+0000","last_peered":"2024-04-26T23:27:48.752975+0000","last_clean":"2024-04-26T23:27:48.752975+0000","last_became_active":"2024-04-26T23:27:47.768864+0000","last_became_peered":"2024-04-26T23:27:47.768864+0000","last_unstale":"2024-04-26T23:27:48.752975+0000","last_undegraded":"2024-04-26T23:27:48.752975+0000","last_fullsized":"2024-04-26T23:27:48.752975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:28.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809642+0000","last_change":"2024-04-26T23:27:46.756591+0000","last_active":"2024-04-26T23:27:48.809642+0000","last_peered":"2024-04-26T23:27:48.809642+0000","last_clean":"2024-04-26T23:27:48.809642+0000","last_became_active":"2024-04-26T23:27:46.756282+0000","last_became_peered":"2024-04-26T23:27:46.756282+0000","last_unstale":"2024-04-26T23:27:48.809642+0000","last_undegraded":"2024-04-26T23:27:48.809642+0000","last_fullsized":"2024-04-26T23:27:48.809642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.447706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809860+0000","last_change":"2024-04-26T23:27:47.780140+0000","last_active":"2024-04-26T23:27:48.809860+0000","last_peered":"2024-04-26T23:27:48.809860+0000","last_clean":"2024-04-26T23:27:48.809860+0000","last_became_active":"2024-04-26T23:27:47.779864+0000","last_became_peered":"2024-04-26T23:27:47.779864+0000","last_unstale":"2024-04-26T23:27:48.809860+0000","last_undegraded":"2024-04-26T23:27:48.809860+0000","last_fullsized":"2024-04-26T23:27:48.809860+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:53:48.219384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.779978+0000","last_change":"2024-04-26T23:27:46.759961+0000","last_active":"2024-04-26T23:27:48.779978+0000","last_peered":"2024-04-26T23:27:48.779978+0000","last_clean":"2024-04-26T23:27:48.779978+0000","last_became_active":"2024-04-26T23:27:46.759319+0000","last_became_peered":"2024-04-26T23:27:46.759319+0000","last_unstale":"2024-04-26T23:27:48.779978+0000","last_undegraded":"2024-04-26T23:27:48.779978+0000","last_fullsized":"2024-04-26T23:27:48.779978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:27.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753409+0000","last_change":"2024-04-26T23:27:47.770730+0000","last_active":"2024-04-26T23:27:48.753409+0000","last_peered":"2024-04-26T23:27:48.753409+0000","last_clean":"2024-04-26T23:27:48.753409+0000","last_became_active":"2024-04-26T23:27:47.770419+0000","last_became_peered":"2024-04-26T23:27:47.770419+0000","last_unstale":"2024-04-26T23:27:48.753409+0000","last_undegraded":"2024-04-26T23:27:48.753409+0000","last_fullsized":"2024-04-26T23:27:48.753409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:27.280787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752786+0000","last_change":"2024-04-26T23:27:46.759768+0000","last_active":"2024-04-26T23:27:48.752786+0000","last_peered":"2024-04-26T23:27:48.752786+0000","last_clean":"2024-04-26T23:27:48.752786+0000","last_became_active":"2024-04-26T23:27:46.759473+0000","last_became_peered":"2024-04-26T23:27:46.759473+0000","last_unstale":"2024-04-26T23:27:48.752786+0000","last_undegraded":"2024-04-26T23:27:48.752786+0000","last_fullsized":"2024-04-26T23:27:48.752786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:18.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809829+0000","last_change":"2024-04-26T23:27:47.784867+0000","last_active":"2024-04-26T23:27:48.809829+0000","last_peered":"2024-04-26T23:27:48.809829+0000","last_clean":"2024-04-26T23:27:48.809829+0000","last_became_active":"2024-04-26T23:27:47.784270+0000","last_became_peered":"2024-04-26T23:27:47.784270+0000","last_unstale":"2024-04-26T23:27:48.809829+0000","last_undegraded":"2024-04-26T23:27:48.809829+0000","last_fullsized":"2024-04-26T23:27:48.809829+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:30.752766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809534+0000","last_change":"2024-04-26T23:27:46.762254+0000","last_active":"2024-04-26T23:27:48.809534+0000","last_peered":"2024-04-26T23:27:48.809534+0000","last_clean":"2024-04-26T23:27:48.809534+0000","last_became_active":"2024-04-26T23:27:46.762082+0000","last_became_peered":"2024-04-26T23:27:46.762082+0000","last_unstale":"2024-04-26T23:27:48.809534+0000","last_undegraded":"2024-04-26T23:27:48.809534+0000","last_fullsized":"2024-04-26T23:27:48.809534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:26.370922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810361+0000","last_change":"2024-04-26T23:27:47.780018+0000","last_active":"2024-04-26T23:27:48.810361+0000","last_peered":"2024-04-26T23:27:48.810361+0000","last_clean":"2024-04-26T23:27:48.810361+0000","last_became_active":"2024-04-26T23:27:47.779708+0000","last_became_peered":"2024-04-26T23:27:47.779708+0000","last_unstale":"2024-04-26T23:27:48.810361+0000","last_undegraded":"2024-04-26T23:27:48.810361+0000","last_fullsized":"2024-04-26T23:27:48.810361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:49.152774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810540+0000","last_change":"2024-04-26T23:27:46.760159+0000","last_active":"2024-04-26T23:27:48.810540+0000","last_peered":"2024-04-26T23:27:48.810540+0000","last_clean":"2024-04-26T23:27:48.810540+0000","last_became_active":"2024-04-26T23:27:46.759899+0000","last_became_peered":"2024-04-26T23:27:46.759899+0000","last_unstale":"2024-04-26T23:27:48.810540+0000","last_undegraded":"2024-04-26T23:27:48.810540+0000","last_fullsized":"2024-04-26T23:27:48.810540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:47.699883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753886+0000","last_change":"2024-04-26T23:27:47.769997+0000","last_active":"2024-04-26T23:27:48.753886+0000","last_peered":"2024-04-26T23:27:48.753886+0000","last_clean":"2024-04-26T23:27:48.753886+0000","last_became_active":"2024-04-26T23:27:47.769712+0000","last_became_peered":"2024-04-26T23:27:47.769712+0000","last_unstale":"2024-04-26T23:27:48.753886+0000","last_undegraded":"2024-04-26T23:27:48.753886+0000","last_fullsized":"2024-04-26T23:27:48.753886+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:33.797496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777674+0000","last_change":"2024-04-26T23:27:46.756739+0000","last_active":"2024-04-26T23:27:48.777674+0000","last_peered":"2024-04-26T23:27:48.777674+0000","last_clean":"2024-04-26T23:27:48.777674+0000","last_became_active":"2024-04-26T23:27:46.756472+0000","last_became_peered":"2024-04-26T23:27:46.756472+0000","last_unstale":"2024-04-26T23:27:48.777674+0000","last_undegraded":"2024-04-26T23:27:48.777674+0000","last_fullsized":"2024-04-26T23:27:48.777674+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:18.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809805+0000","last_change":"2024-04-26T23:27:47.761428+0000","last_active":"2024-04-26T23:27:48.809805+0000","last_peered":"2024-04-26T23:27:48.809805+0000","last_clean":"2024-04-26T23:27:48.809805+0000","last_became_active":"2024-04-26T23:27:47.761119+0000","last_became_peered":"2024-04-26T23:27:47.761119+0000","last_unstale":"2024-04-26T23:27:48.809805+0000","last_undegraded":"2024-04-26T23:27:48.809805+0000","last_fullsized":"2024-04-26T23:27:48.809805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:11.270812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753697+0000","last_change":"2024-04-26T23:27:46.760723+0000","last_active":"2024-04-26T23:27:48.753697+0000","last_peered":"2024-04-26T23:27:48.753697+0000","last_clean":"2024-04-26T23:27:48.753697+0000","last_became_active":"2024-04-26T23:27:46.760395+0000","last_became_peered":"2024-04-26T23:27:46.760395+0000","last_unstale":"2024-04-26T23:27:48.753697+0000","last_undegraded":"2024-04-26T23:27:48.753697+0000","last_fullsized":"2024-04-26T23:27:48.753697+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:00.136520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810062+0000","last_change":"2024-04-26T23:27:47.781074+0000","last_active":"2024-04-26T23:27:48.810062+0000","last_peered":"2024-04-26T23:27:48.810062+0000","last_clean":"2024-04-26T23:27:48.810062+0000","last_became_active":"2024-04-26T23:27:47.780778+0000","last_became_peered":"2024-04-26T23:27:47.780778+0000","last_unstale":"2024-04-26T23:27:48.810062+0000","last_undegraded":"2024-04-26T23:27:48.810062+0000","last_fullsized":"2024-04-26T23:27:48.810062+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:52.406790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777555+0000","last_change":"2024-04-26T23:27:46.754588+0000","last_active":"2024-04-26T23:27:48.777555+0000","last_peered":"2024-04-26T23:27:48.777555+0000","last_clean":"2024-04-26T23:27:48.777555+0000","last_became_active":"2024-04-26T23:27:46.754185+0000","last_became_peered":"2024-04-26T23:27:46.754185+0000","last_unstale":"2024-04-26T23:27:48.777555+0000","last_undegraded":"2024-04-26T23:27:48.777555+0000","last_fullsized":"2024-04-26T23:27:48.777555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:47.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752812+0000","last_change":"2024-04-26T23:27:47.768847+0000","last_active":"2024-04-26T23:27:48.752812+0000","last_peered":"2024-04-26T23:27:48.752812+0000","last_clean":"2024-04-26T23:27:48.752812+0000","last_became_active":"2024-04-26T23:27:47.768556+0000","last_became_peered":"2024-04-26T23:27:47.768556+0000","last_unstale":"2024-04-26T23:27:48.752812+0000","last_undegraded":"2024-04-26T23:27:48.752812+0000","last_fullsized":"2024-04-26T23:27:48.752812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:31.264016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809760+0000","last_change":"2024-04-26T23:27:46.753544+0000","last_active":"2024-04-26T23:27:48.809760+0000","last_peered":"2024-04-26T23:27:48.809760+0000","last_clean":"2024-04-26T23:27:48.809760+0000","last_became_active":"2024-04-26T23:27:46.753270+0000","last_became_peered":"2024-04-26T23:27:46.753270+0000","last_unstale":"2024-04-26T23:27:48.809760+0000","last_undegraded":"2024-04-26T23:27:48.809760+0000","last_fullsized":"2024-04-26T23:27:48.809760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:49.247366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777478+0000","last_change":"2024-04-26T23:27:47.781868+0000","last_active":"2024-04-26T23:27:48.777478+0000","last_peered":"2024-04-26T23:27:48.777478+0000","last_clean":"2024-04-26T23:27:48.777478+0000","last_became_active":"2024-04-26T23:27:47.781540+0000","last_became_peered":"2024-04-26T23:27:47.781540+0000","last_unstale":"2024-04-26T23:27:48.777478+0000","last_undegraded":"2024-04-26T23:27:48.777478+0000","last_fullsized":"2024-04-26T23:27:48.777478+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:33.797496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809520+0000","last_change":"2024-04-26T23:27:46.756862+0000","last_active":"2024-04-26T23:27:48.809520+0000","last_peered":"2024-04-26T23:27:48.809520+0000","last_clean":"2024-04-26T23:27:48.809520+0000","last_became_active":"2024-04-26T23:27:46.756605+0000","last_became_peered":"2024-04-26T23:27:46.756605+0000","last_unstale":"2024-04-26T23:27:48.809520+0000","last_undegraded":"2024-04-26T23:27:48.809520+0000","last_fullsized":"2024-04-26T23:27:48.809520+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:31.380598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777485+0000","last_change":"2024-04-26T23:27:47.770347+0000","last_active":"2024-04-26T23:27:48.777485+0000","last_peered":"2024-04-26T23:27:48.777485+0000","last_clean":"2024-04-26T23:27:48.777485+0000","last_became_active":"2024-04-26T23:27:47.770096+0000","last_became_peered":"2024-04-26T23:27:47.770096+0000","last_unstale":"2024-04-26T23:27:48.777485+0000","last_undegraded":"2024-04-26T23:27:48.777485+0000","last_fullsized":"2024-04-26T23:27:48.777485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:39.796129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.752825+0000","last_change":"2024-04-26T23:27:46.756673+0000","last_active":"2024-04-26T23:27:48.752825+0000","last_peered":"2024-04-26T23:27:48.752825+0000","last_clean":"2024-04-26T23:27:48.752825+0000","last_became_active":"2024-04-26T23:27:46.756325+0000","last_became_peered":"2024-04-26T23:27:46.756325+0000","last_unstale":"2024-04-26T23:27:48.752825+0000","last_undegraded":"2024-04-26T23:27:48.752825+0000","last_fullsized":"2024-04-26T23:27:48.752825+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:26.272826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753967+0000","last_change":"2024-04-26T23:27:47.774483+0000","last_active":"2024-04-26T23:27:48.753967+0000","last_peered":"2024-04-26T23:27:48.753967+0000","last_clean":"2024-04-26T23:27:48.753967+0000","last_became_active":"2024-04-26T23:27:47.774166+0000","last_became_peered":"2024-04-26T23:27:47.774166+0000","last_unstale":"2024-04-26T23:27:48.753967+0000","last_undegraded":"2024-04-26T23:27:48.753967+0000","last_fullsized":"2024-04-26T23:27:48.753967+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:57.472612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810402+0000","last_change":"2024-04-26T23:27:46.761617+0000","last_active":"2024-04-26T23:27:48.810402+0000","last_peered":"2024-04-26T23:27:48.810402+0000","last_clean":"2024-04-26T23:27:48.810402+0000","last_became_active":"2024-04-26T23:27:46.761331+0000","last_became_peered":"2024-04-26T23:27:46.761331+0000","last_unstale":"2024-04-26T23:27:48.810402+0000","last_undegraded":"2024-04-26T23:27:48.810402+0000","last_fullsized":"2024-04-26T23:27:48.810402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:38.503756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753992+0000","last_change":"2024-04-26T23:27:47.765705+0000","last_active":"2024-04-26T23:27:48.753992+0000","last_peered":"2024-04-26T23:27:48.753992+0000","last_clean":"2024-04-26T23:27:48.753992+0000","last_became_active":"2024-04-26T23:27:47.765308+0000","last_became_peered":"2024-04-26T23:27:47.765308+0000","last_unstale":"2024-04-26T23:27:48.753992+0000","last_undegraded":"2024-04-26T23:27:48.753992+0000","last_fullsized":"2024-04-26T23:27:48.753992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:48.707843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777831+0000","last_change":"2024-04-26T23:27:46.755155+0000","last_active":"2024-04-26T23:27:48.777831+0000","last_peered":"2024-04-26T23:27:48.777831+0000","last_clean":"2024-04-26T23:27:48.777831+0000","last_became_active":"2024-04-26T23:27:46.754885+0000","last_became_peered":"2024-04-26T23:27:46.754885+0000","last_unstale":"2024-04-26T23:27:48.777831+0000","last_undegraded":"2024-04-26T23:27:48.777831+0000","last_fullsized":"2024-04-26T23:27:48.777831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:07.320558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809843+0000","last_change":"2024-04-26T23:27:47.765299+0000","last_active":"2024-04-26T23:27:48.809843+0000","last_peered":"2024-04-26T23:27:48.809843+0000","last_clean":"2024-04-26T23:27:48.809843+0000","last_became_active":"2024-04-26T23:27:47.764834+0000","last_became_peered":"2024-04-26T23:27:47.764834+0000","last_unstale":"2024-04-26T23:27:48.809843+0000","last_undegraded":"2024-04-26T23:27:48.809843+0000","last_fullsized":"2024-04-26T23:27:48.809843+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:59:43.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.780160+0000","last_change":"2024-04-26T23:27:46.754689+0000","last_active":"2024-04-26T23:27:48.780160+0000","last_peered":"2024-04-26T23:27:48.780160+0000","last_clean":"2024-04-26T23:27:48.780160+0000","last_became_active":"2024-04-26T23:27:46.754411+0000","last_became_peered":"2024-04-26T23:27:46.754411+0000","last_unstale":"2024-04-26T23:27:48.780160+0000","last_undegraded":"2024-04-26T23:27:48.780160+0000","last_fullsized":"2024-04-26T23:27:48.780160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:24.010592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.777691+0000","last_change":"2024-04-26T23:27:47.768102+0000","last_active":"2024-04-26T23:27:48.777691+0000","last_peered":"2024-04-26T23:27:48.777691+0000","last_clean":"2024-04-26T23:27:48.777691+0000","last_became_active":"2024-04-26T23:27:47.767433+0000","last_became_peered":"2024-04-26T23:27:47.767433+0000","last_unstale":"2024-04-26T23:27:48.777691+0000","last_undegraded":"2024-04-26T23:27:48.777691+0000","last_fullsized":"2024-04-26T23:27:48.777691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:50.255326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753723+0000","last_change":"2024-04-26T23:27:46.749823+0000","last_active":"2024-04-26T23:27:48.753723+0000","last_peered":"2024-04-26T23:27:48.753723+0000","last_clean":"2024-04-26T23:27:48.753723+0000","last_became_active":"2024-04-26T23:27:46.745608+0000","last_became_peered":"2024-04-26T23:27:46.745608+0000","last_unstale":"2024-04-26T23:27:48.753723+0000","last_undegraded":"2024-04-26T23:27:48.753723+0000","last_fullsized":"2024-04-26T23:27:48.753723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:47.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810721+0000","last_change":"2024-04-26T23:27:47.760152+0000","last_active":"2024-04-26T23:27:48.810721+0000","last_peered":"2024-04-26T23:27:48.810721+0000","last_clean":"2024-04-26T23:27:48.810721+0000","last_became_active":"2024-04-26T23:27:47.759646+0000","last_became_peered":"2024-04-26T23:27:47.759646+0000","last_unstale":"2024-04-26T23:27:48.810721+0000","last_undegraded":"2024-04-26T23:27:48.810721+0000","last_fullsized":"2024-04-26T23:27:48.810721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:25.888264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809339+0000","last_change":"2024-04-26T23:27:46.759629+0000","last_active":"2024-04-26T23:27:48.809339+0000","last_peered":"2024-04-26T23:27:48.809339+0000","last_clean":"2024-04-26T23:27:48.809339+0000","last_became_active":"2024-04-26T23:27:46.759301+0000","last_became_peered":"2024-04-26T23:27:46.759301+0000","last_unstale":"2024-04-26T23:27:48.809339+0000","last_undegraded":"2024-04-26T23:27:48.809339+0000","last_fullsized":"2024-04-26T23:27:48.809339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:34.876255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809943+0000","last_change":"2024-04-26T23:27:47.782784+0000","last_active":"2024-04-26T23:27:48.809943+0000","last_peered":"2024-04-26T23:27:48.809943+0000","last_clean":"2024-04-26T23:27:48.809943+0000","last_became_active":"2024-04-26T23:27:47.782508+0000","last_became_peered":"2024-04-26T23:27:47.782508+0000","last_unstale":"2024-04-26T23:27:48.809943+0000","last_undegraded":"2024-04-26T23:27:48.809943+0000","last_fullsized":"2024-04-26T23:27:48.809943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:20.947000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.753257+0000","last_change":"2024-04-26T23:27:46.746757+0000","last_active":"2024-04-26T23:27:48.753257+0000","last_peered":"2024-04-26T23:27:48.753257+0000","last_clean":"2024-04-26T23:27:48.753257+0000","last_became_active":"2024-04-26T23:27:46.746463+0000","last_became_peered":"2024-04-26T23:27:46.746463+0000","last_unstale":"2024-04-26T23:27:48.753257+0000","last_undegraded":"2024-04-26T23:27:48.753257+0000","last_fullsized":"2024-04-26T23:27:48.753257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:50.856169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809572+0000","last_change":"2024-04-26T23:27:47.781382+0000","last_active":"2024-04-26T23:27:48.809572+0000","last_peered":"2024-04-26T23:27:48.809572+0000","last_clean":"2024-04-26T23:27:48.809572+0000","last_became_active":"2024-04-26T23:27:47.781133+0000","last_became_peered":"2024-04-26T23:27:47.781133+0000","last_unstale":"2024-04-26T23:27:48.809572+0000","last_undegraded":"2024-04-26T23:27:48.809572+0000","last_fullsized":"2024-04-26T23:27:48.809572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:30.434354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809348+0000","last_change":"2024-04-26T23:27:46.748180+0000","last_active":"2024-04-26T23:27:48.809348+0000","last_peered":"2024-04-26T23:27:48.809348+0000","last_clean":"2024-04-26T23:27:48.809348+0000","last_became_active":"2024-04-26T23:27:46.747056+0000","last_became_peered":"2024-04-26T23:27:46.747056+0000","last_unstale":"2024-04-26T23:27:48.809348+0000","last_undegraded":"2024-04-26T23:27:48.809348+0000","last_fullsized":"2024-04-26T23:27:48.809348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:29:00.631409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809797+0000","last_change":"2024-04-26T23:27:47.774622+0000","last_active":"2024-04-26T23:27:48.809797+0000","last_peered":"2024-04-26T23:27:48.809797+0000","last_clean":"2024-04-26T23:27:48.809797+0000","last_became_active":"2024-04-26T23:27:47.774355+0000","last_became_peered":"2024-04-26T23:27:47.774355+0000","last_unstale":"2024-04-26T23:27:48.809797+0000","last_undegraded":"2024-04-26T23:27:48.809797+0000","last_fullsized":"2024-04-26T23:27:48.809797+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:32.163004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810164+0000","last_change":"2024-04-26T23:27:46.763463+0000","last_active":"2024-04-26T23:27:48.810164+0000","last_peered":"2024-04-26T23:27:48.810164+0000","last_clean":"2024-04-26T23:27:48.810164+0000","last_became_active":"2024-04-26T23:27:46.763142+0000","last_became_peered":"2024-04-26T23:27:46.763142+0000","last_unstale":"2024-04-26T23:27:48.810164+0000","last_undegraded":"2024-04-26T23:27:48.810164+0000","last_fullsized":"2024-04-26T23:27:48.810164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:32.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.810118+0000","last_change":"2024-04-26T23:27:47.766914+0000","last_active":"2024-04-26T23:27:48.810118+0000","last_peered":"2024-04-26T23:27:48.810118+0000","last_clean":"2024-04-26T23:27:48.810118+0000","last_became_active":"2024-04-26T23:27:47.765853+0000","last_became_peered":"2024-04-26T23:27:47.765853+0000","last_unstale":"2024-04-26T23:27:48.810118+0000","last_undegraded":"2024-04-26T23:27:48.810118+0000","last_fullsized":"2024-04-26T23:27:48.810118+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:46.729001+0000","last_clean_scrub_stamp":"2024-04-26T23:27:46.729001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:55.805846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.780204+0000","last_change":"2024-04-26T23:27:46.752283+0000","last_active":"2024-04-26T23:27:48.780204+0000","last_peered":"2024-04-26T23:27:48.780204+0000","last_clean":"2024-04-26T23:27:48.780204+0000","last_became_active":"2024-04-26T23:27:46.752025+0000","last_became_peered":"2024-04-26T23:27:46.752025+0000","last_unstale":"2024-04-26T23:27:48.780204+0000","last_undegraded":"2024-04-26T23:27:48.780204+0000","last_fullsized":"2024-04-26T23:27:48.780204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:27:45.721041+0000","last_clean_scrub_stamp":"2024-04-26T23:27:45.721041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:57.918157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:27:48.809705+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:27:48.809705+0000","last_peered":"2024-04-26T23:27:48.809705+0000","last_clean":"2024-04-26T23:27:48.809705+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:27:48.809705+0000","last_undegraded":"2024-04-26T23:27:48.809705+0000","last_fullsized":"2024-04-26T23:27:48.809705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1212416,"data_stored":849713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":259185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":259837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":260797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":259241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":259241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":614400,"data_stored":259275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1220608,"data_stored":851747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:27:56.840 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:27:56.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:27:57.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.023+0000 7f2db3c00640 1 Processor -- start 2024-04-26T23:27:57.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.023+0000 7f2db3c00640 1 -- start start 2024-04-26T23:27:57.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db3c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2dac160530 0x7f2dac073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db3c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2dac06c3d0 0x7f2dac06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db3c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dac070200 con 0x7f2dac160150 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db3c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac073970 con 0x7f2dac06c3d0 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db3c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac073320 con 0x7f2dac160530 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2dac06c3d0 0x7f2dac06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2dac160150 0x7f2dac06f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56870/0 (socket says 172.21.15.39:56870) 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1200640 1 -- 172.21.15.39:0/2572928941 learned_addr learned my addr 172.21.15.39:0/2572928941 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2dabe00640 1 --2- 172.21.15.39:0/2572928941 >> v2:172.21.15.71:3300/0 conn(0x7f2dac160530 0x7f2dac073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 -- 172.21.15.39:0/2572928941 >> v2:172.21.15.71:3300/0 conn(0x7f2dac160530 msgr2=0x7f2dac073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:57.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 --2- 172.21.15.39:0/2572928941 >> v2:172.21.15.71:3300/0 conn(0x7f2dac160530 0x7f2dac073e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 -- 172.21.15.39:0/2572928941 >> v1:172.21.15.39:6789/0 conn(0x7f2dac160150 legacy=0x7f2dac06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 -- 172.21.15.39:0/2572928941 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac073600 con 0x7f2dac06c3d0 2024-04-26T23:27:57.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.027+0000 7f2db1c00640 1 --2- 172.21.15.39:0/2572928941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac06c880 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2dac06d4b0 tx=0x7f2da401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9066929c3b9fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2dab400640 1 -- 172.21.15.39:0/2572928941 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da40b2070 con 0x7f2dac06c3d0 2024-04-26T23:27:57.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2dab400640 1 -- 172.21.15.39:0/2572928941 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da40a57b0 con 0x7f2dac06c3d0 2024-04-26T23:27:57.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2dab400640 1 -- 172.21.15.39:0/2572928941 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da40a5b80 con 0x7f2dac06c3d0 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- 172.21.15.39:0/2572928941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 msgr2=0x7f2dac06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- 172.21.15.39:0/2572928941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac06c880 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2dac06d4b0 tx=0x7f2da401c8a0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- 172.21.15.39:0/2572928941 shutdown_connections 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- 172.21.15.39:0/2572928941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac06c880 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- 172.21.15.39:0/2572928941 >> v2:172.21.15.71:3300/0 conn(0x7f2dac160530 0x7f2dac073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- 172.21.15.39:0/2572928941 >> 172.21.15.39:0/2572928941 conn(0x7f2dac06dfd0 msgr2=0x7f2dac0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- 172.21.15.39:0/2572928941 shutdown_connections 2024-04-26T23:27:57.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- 172.21.15.39:0/2572928941 wait complete. 2024-04-26T23:27:57.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 Processor -- start 2024-04-26T23:27:57.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- start start 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 0x7f2dac155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2dac160530 0x7f2dac14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac0b5f80 con 0x7f2dac06c3d0 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac0b5e00 con 0x7f2dac160150 2024-04-26T23:27:57.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db3c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac0b6100 con 0x7f2dac160530 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54978/0 (socket says 172.21.15.39:54978) 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db1200640 1 -- 172.21.15.39:0/483221341 learned_addr learned my addr 172.21.15.39:0/483221341 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2dabe00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 0x7f2dac155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db1c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2dac160530 0x7f2dac14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.031+0000 7f2db1200640 1 -- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2dac160530 msgr2=0x7f2dac14d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db1200640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2dac160530 0x7f2dac14d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db1200640 1 -- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 msgr2=0x7f2dac155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db1200640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 0x7f2dac155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db1200640 1 -- 172.21.15.39:0/483221341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac154290 con 0x7f2dac06c3d0 2024-04-26T23:27:57.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2dabe00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 0x7f2dac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:57.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db1200640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c420 tx=0x7f2da000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0017070 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da0005cf0 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dac14f630 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da00072f0 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dac14fbf0 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dac06a720 con 0x7f2dac06c3d0 2024-04-26T23:27:57.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2da001a070 con 0x7f2dac06c3d0 2024-04-26T23:27:57.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 0x7f2d8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f2da0085e10 con 0x7f2dac06c3d0 2024-04-26T23:27:57.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.035+0000 7f2dabe00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 0x7f2d8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.039+0000 7f2dabe00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 0x7f2d8c06a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2dac16b160 tx=0x7f2d98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.039+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2da0089030 con 0x7f2dac06c3d0 2024-04-26T23:27:57.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.263+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2dac14f3e0 con 0x7f2dac06c3d0 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.267+0000 7f2da8c00640 1 -- 172.21.15.39:0/483221341 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f2da0056330 con 0x7f2dac06c3d0 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g== 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stdout: caps mds = "allow" 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stdout: caps mon = "allow r" 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:27:57.272 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 msgr2=0x7f2d8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 0x7f2d8c06a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2dac16b160 tx=0x7f2d98008040 comp rx=0 tx=0).stop 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 msgr2=0x7f2dac154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c420 tx=0x7f2da000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 shutdown_connections 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d8c068380 0x7f2d8c06a840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2dac160530 0x7f2dac14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dac160150 0x7f2dac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 --2- 172.21.15.39:0/483221341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac06c3d0 0x7f2dac154fd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 >> 172.21.15.39:0/483221341 conn(0x7f2dac06dfd0 msgr2=0x7f2dac0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:57.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 shutdown_connections 2024-04-26T23:27:57.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.271+0000 7f2db3c00640 1 -- 172.21.15.39:0/483221341 wait complete. 2024-04-26T23:27:57.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:27:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.431+0000 7f9e5fe00640 1 Processor -- start 2024-04-26T23:27:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.431+0000 7f9e5fe00640 1 -- start start 2024-04-26T23:27:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e600b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e600af430 0x7f9e601617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5fe00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e600720c0 con 0x7f9e600afdc0 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5fe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9e60160d60 con 0x7f9e600af430 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9e60072330 con 0x7f9e600af050 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5f400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9e600afdc0 0x7f9e600cc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56886/0 (socket says 172.21.15.39:56886) 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5f400640 1 -- 172.21.15.39:0/3816553801 learned_addr learned my addr 172.21.15.39:0/3816553801 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e600b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3816553801 >> v2:172.21.15.71:3300/0 conn(0x7f9e600af430 0x7f9e601617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5e000640 1 -- 172.21.15.39:0/3816553801 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845781213 0 0) 0x7f9e600720c0 con 0x7f9e600afdc0 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5e000640 1 -- 172.21.15.39:0/3816553801 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e44003530 con 0x7f9e600afdc0 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e57e00640 1 -- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 msgr2=0x7f9e600b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e600b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e57e00640 1 -- 172.21.15.39:0/3816553801 >> v1:172.21.15.39:6789/0 conn(0x7f9e600afdc0 legacy=0x7f9e600cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e57e00640 1 -- 172.21.15.39:0/3816553801 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e60160fb0 con 0x7f9e600af430 2024-04-26T23:27:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.435+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e600b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:57.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600af430 0x7f9e601617b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097c0 tx=0x7f9e4801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95964207213de23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5e000640 1 -- 172.21.15.39:0/3816553801 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b0070 con 0x7f9e600af430 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5e000640 1 -- 172.21.15.39:0/3816553801 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e480ab600 con 0x7f9e600af430 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5e000640 1 -- 172.21.15.39:0/3816553801 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480ab9d0 con 0x7f9e600af430 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600af430 msgr2=0x7f9e601617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600af430 0x7f9e601617b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097c0 tx=0x7f9e4801c350 comp rx=0 tx=0).stop 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3816553801 shutdown_connections 2024-04-26T23:27:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600af430 0x7f9e601617b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3816553801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e600b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3816553801 >> 172.21.15.39:0/3816553801 conn(0x7f9e600d0d80 msgr2=0x7f9e600d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3816553801 shutdown_connections 2024-04-26T23:27:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3816553801 wait complete. 2024-04-26T23:27:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 Processor -- start 2024-04-26T23:27:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- start start 2024-04-26T23:27:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e60158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600afdc0 0x7f9e6009dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6015d200 con 0x7f9e600af430 2024-04-26T23:27:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e600cd310 con 0x7f9e600afdc0 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e5fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6015d380 con 0x7f9e600af050 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e57e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e57e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54984/0 (socket says 172.21.15.39:54984) 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.439+0000 7f9e57e00640 1 -- 172.21.15.39:0/3155529755 learned_addr learned my addr 172.21.15.39:0/3155529755 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5f400640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600afdc0 0x7f9e6009dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e60158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 -- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 msgr2=0x7f9e60158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e60158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 -- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600afdc0 msgr2=0x7f9e6009dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600afdc0 0x7f9e6009dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 -- 172.21.15.39:0/3155529755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e60070270 con 0x7f9e600af430 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e60158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57e00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9e48019f80 tx=0x7f9e480190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b0040 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e480b9070 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e600cddc0 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b4650 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e600ce380 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e600690e0 con 0x7f9e600af430 2024-04-26T23:27:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e480b47f0 con 0x7f9e600af430 2024-04-26T23:27:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.443+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f9e48120580 con 0x7f9e600af430 2024-04-26T23:27:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.447+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.447+0000 7f9e5ea00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 0x7f9e3c06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e6015c1e0 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:57.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.451+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e48016090 con 0x7f9e600af430 2024-04-26T23:27:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e600506d0 con 0x7f9e600af430 2024-04-26T23:27:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e57400640 1 -- 172.21.15.39:0/3155529755 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5178 (secure 0 0 0) 0x7f9e480bb310 con 0x7f9e600af430 2024-04-26T23:27:57.654 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:27:57.654 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:27:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 msgr2=0x7f9e3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 0x7f9e3c06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e6015c1e0 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 msgr2=0x7f9e60157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9e48019f80 tx=0x7f9e480190f0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 shutdown_connections 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e600afdc0 0x7f9e6009dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e600af430 0x7f9e60157850 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 --2- 172.21.15.39:0/3155529755 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9e600af050 0x7f9e60158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:57.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 >> 172.21.15.39:0/3155529755 conn(0x7f9e600d0d80 msgr2=0x7f9e600d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:57.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 shutdown_connections 2024-04-26T23:27:57.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:57.651+0000 7f9e5fe00640 1 -- 172.21.15.39:0/3155529755 wait complete. 2024-04-26T23:27:58.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:27:47.140323+0000', 'modified': '2024-04-26T23:27:50.165896+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5490': {'gid': 5490, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6835/3842819351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 3842819351}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 3842819351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5490, 'qdb_cluster': [5490]} 2024-04-26T23:27:58.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:27:58.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:27:58.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 Processor -- start 2024-04-26T23:27:58.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 -- start start 2024-04-26T23:27:58.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1380d0f20 0x7ff1380d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1380d1d50 con 0x7ff1380d18c0 2024-04-26T23:27:58.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff13806e750 con 0x7ff1380d0f20 2024-04-26T23:27:58.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.223+0000 7ff13f800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff13806ea30 con 0x7ff13815f990 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13d800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff1380d18c0 0x7ff1380cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:51480/0 (socket says 172.21.15.39:51480) 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:34700/0 (socket says 172.21.15.39:34700) 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 -- 172.21.15.39:0/3898858398 learned_addr learned my addr 172.21.15.39:0/3898858398 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff137e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1380d0f20 0x7ff1380d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 -- 172.21.15.39:0/3898858398 >> v2:172.21.15.71:3300/0 conn(0x7ff1380d0f20 msgr2=0x7ff1380d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 --2- 172.21.15.39:0/3898858398 >> v2:172.21.15.71:3300/0 conn(0x7ff1380d0f20 0x7ff1380d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 -- 172.21.15.39:0/3898858398 >> v1:172.21.15.71:6789/0 conn(0x7ff1380d18c0 legacy=0x7ff1380cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 -- 172.21.15.39:0/3898858398 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13806ed10 con 0x7ff13815f990 2024-04-26T23:27:58.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.227+0000 7ff13ce00640 1 --2- 172.21.15.39:0/3898858398 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009870 tx=0x7ff12c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa855371846d533 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137400640 1 -- 172.21.15.39:0/3898858398 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0b1070 con 0x7ff13815f990 2024-04-26T23:27:58.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137400640 1 -- 172.21.15.39:0/3898858398 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c0a8050 con 0x7ff13815f990 2024-04-26T23:27:58.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137400640 1 -- 172.21.15.39:0/3898858398 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0ac660 con 0x7ff13815f990 2024-04-26T23:27:58.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- 172.21.15.39:0/3898858398 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 msgr2=0x7ff1380b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- 172.21.15.39:0/3898858398 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009870 tx=0x7ff12c01c560 comp rx=0 tx=0).stop 2024-04-26T23:27:58.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- 172.21.15.39:0/3898858398 shutdown_connections 2024-04-26T23:27:58.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- 172.21.15.39:0/3898858398 >> v2:172.21.15.71:3300/0 conn(0x7ff1380d0f20 0x7ff1380d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- 172.21.15.39:0/3898858398 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff1380b4530 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- 172.21.15.39:0/3898858398 >> 172.21.15.39:0/3898858398 conn(0x7ff1380d3020 msgr2=0x7ff1380d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- 172.21.15.39:0/3898858398 shutdown_connections 2024-04-26T23:27:58.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- 172.21.15.39:0/3898858398 wait complete. 2024-04-26T23:27:58.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 Processor -- start 2024-04-26T23:27:58.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- start start 2024-04-26T23:27:58.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1380d0f20 0x7ff1380cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff138157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff13816c760 con 0x7ff1380d18c0 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff13816c5e0 con 0x7ff1380d0f20 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13f800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff13816c8e0 con 0x7ff13815f990 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54988/0 (socket says 172.21.15.39:54988) 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff137e00640 1 -- 172.21.15.39:0/1507410155 learned_addr learned my addr 172.21.15.39:0/1507410155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1380d0f20 0x7ff1380cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.231+0000 7ff13d800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff138157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 -- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 msgr2=0x7ff138157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff138157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 -- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1380d0f20 msgr2=0x7ff1380cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1380d0f20 0x7ff1380cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 -- 172.21.15.39:0/1507410155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1380ca0f0 con 0x7ff1380d18c0 2024-04-26T23:27:58.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff137e00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff12400e870 tx=0x7ff12400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 -- 172.21.15.39:0/1507410155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124017070 con 0x7ff1380d18c0 2024-04-26T23:27:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 -- 172.21.15.39:0/1507410155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12400c940 con 0x7ff1380d18c0 2024-04-26T23:27:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1380ca390 con 0x7ff1380d18c0 2024-04-26T23:27:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 -- 172.21.15.39:0/1507410155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400ccf0 con 0x7ff1380d18c0 2024-04-26T23:27:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1380cac30 con 0x7ff1380d18c0 2024-04-26T23:27:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 -- 172.21.15.39:0/1507410155 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff12401a070 con 0x7ff1380d18c0 2024-04-26T23:27:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 0x7ff11806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.235+0000 7ff134c00640 1 -- 172.21.15.39:0/1507410155 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7ff124086880 con 0x7ff1380d18c0 2024-04-26T23:27:58.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 0x7ff11806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 Processor -- start 2024-04-26T23:27:58.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- start start 2024-04-26T23:27:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 0x7ff11806a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0ae000 tx=0x7ff12c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bf1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377bf1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563377aa9140 con 0x563377c3a700 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563377a3ee00 con 0x563377c3b020 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5633779f7a00 con 0x563377bf1740 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54998/0 (socket says 172.21.15.39:54998) 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 -- 172.21.15.39:0/2449758831 learned_addr learned my addr 172.21.15.39:0/2449758831 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff137e00640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bf1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13d800640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377bf1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 -- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 msgr2=0x563377bf1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377bf1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 -- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 msgr2=0x563377bf1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bf1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 -- 172.21.15.39:0/2449758831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633779fc0e0 con 0x563377c3a700 2024-04-26T23:27:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13d800640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377bf1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff137e00640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bf1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:27:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff13ce00640 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff12c01ac10 tx=0x7ff12c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fa74d1da2ea8e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff129600640 1 -- 172.21.15.39:0/2449758831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0c8070 con 0x563377c3a700 2024-04-26T23:27:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff129600640 1 -- 172.21.15.39:0/2449758831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c0a8040 con 0x563377c3a700 2024-04-26T23:27:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff129600640 1 -- 172.21.15.39:0/2449758831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0b1040 con 0x563377c3a700 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- 172.21.15.39:0/2449758831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 msgr2=0x563377c3aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff12c01ac10 tx=0x7ff12c004740 comp rx=0 tx=0).stop 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- 172.21.15.39:0/2449758831 shutdown_connections 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377bf1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bf1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2449758831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377c3aae0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- 172.21.15.39:0/2449758831 >> 172.21.15.39:0/2449758831 conn(0x563377bed6f0 msgr2=0x563377befae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- 172.21.15.39:0/2449758831 shutdown_connections 2024-04-26T23:27:58.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- 172.21.15.39:0/2449758831 wait complete. 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 -- start start 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.239+0000 7ff142c0f000 1 Processor -- start 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3a700 0x563377bfc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bfcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563377a4c200 con 0x563377bf1740 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5633779e2e80 con 0x563377c3b020 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x563377a39ae0 con 0x563377c3a700 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 10 client.0 _ll_register_callbacks cb 0x563377a4bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55010/0 (socket says 172.21.15.39:55010) 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 -- 172.21.15.39:0/415880268 learned_addr learned my addr 172.21.15.39:0/415880268 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13d800640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bfcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff137e00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3a700 0x563377bfc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 -- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3a700 msgr2=0x563377bfc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3a700 0x563377bfc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 -- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 msgr2=0x563377bfcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bfcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 -- 172.21.15.39:0/415880268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633779de4e0 con 0x563377bf1740 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13d800640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bfcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff13ce00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff12c01ca40 tx=0x7ff12c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3bff7d111897a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0d1060 con 0x563377bf1740 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff12c0a8040 con 0x563377bf1740 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7ff12c0b6430 con 0x563377bf1740 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff12c0d7050 con 0x563377bf1740 2024-04-26T23:27:58.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 10 client.5643 fetch_fsmap learned FSMap version 30 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5633779c4e80 con 0x563377bf1740 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c0a8040 con 0x563377bf1740 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7ff12c0da020 con 0x563377bf1740 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 10 client.5643 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 10 client.5643 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 20 client.5643 populate_metadata read hostname 'smithi039' 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377bfd530 0x563377c4c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 4 client.5643 mds_command: new command op to 5490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 --> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633779d7bc0 con 0x563377bfd530 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff137e00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377bfd530 0x563377c4c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff137e00640 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377bfd530 0x563377c4c7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc8fe95ca611e16 server_cookie=95a8272d4eaa00b5 in_seq=0 out_seq=0 2024-04-26T23:27:58.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.243+0000 7ff11e000640 10 client.5643 ms_handle_connect on v2:172.21.15.39:6832/3842819351 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff11e000640 1 -- 172.21.15.39:0/415880268 <== mds.0 v2:172.21.15.39:6832/3842819351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633779d7bc0 con 0x563377bfd530 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff11e000640 10 client.5643 handle_command_reply: tid=0 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 client.5643 shutdown 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 msgr2=0x563377bfc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff12c01ca40 tx=0x7ff12c01ada0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 shutdown_connections 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377bfd530 0x563377c4c7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3b020 0x563377bfcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3a700 0x563377bfc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 --2- 172.21.15.39:0/415880268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377bf1740 0x563377bfc0a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff11e000640 0 client.5643 ms_handle_reset on v2:172.21.15.39:6832/3842819351 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 >> 172.21.15.39:0/415880268 conn(0x563377bed6f0 msgr2=0x563377bf0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 shutdown_connections 2024-04-26T23:27:58.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 1 -- 172.21.15.39:0/415880268 wait complete. 2024-04-26T23:27:58.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.247+0000 7ff142c0f000 20 client.5643 trim_cache size 0 max 16384 2024-04-26T23:27:58.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.263+0000 7ff142c0f000 1 Processor -- start 2024-04-26T23:27:58.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.263+0000 7ff142c0f000 1 -- start start 2024-04-26T23:27:58.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377bf1740 0x563377ca5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3b020 0x563377ca61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff138203ca0 con 0x563377c3a700 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff138203180 con 0x563377bf1740 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff138203650 con 0x563377c3b020 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55018/0 (socket says 172.21.15.39:55018) 2024-04-26T23:27:58.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 -- 172.21.15.39:0/2879010099 learned_addr learned my addr 172.21.15.39:0/2879010099 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 -- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3b020 msgr2=0x563377ca61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3b020 0x563377ca61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 -- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377bf1740 msgr2=0x563377ca5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377bf1740 0x563377ca5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 -- 172.21.15.39:0/2879010099 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633779f7c50 con 0x563377c3a700 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff137e00640 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff1240566e0 tx=0x7ff1240090a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754de1a8c300c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff128c00640 1 -- 172.21.15.39:0/2879010099 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124082070 con 0x563377c3a700 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff128c00640 1 -- 172.21.15.39:0/2879010099 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12405f280 con 0x563377c3a700 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff128c00640 1 -- 172.21.15.39:0/2879010099 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124021040 con 0x563377c3a700 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- 172.21.15.39:0/2879010099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 msgr2=0x563377ca5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff1240566e0 tx=0x7ff1240090a0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- 172.21.15.39:0/2879010099 shutdown_connections 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377c3b020 0x563377ca61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3a700 0x563377ca5c70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- 172.21.15.39:0/2879010099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377bf1740 0x563377ca5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- 172.21.15.39:0/2879010099 >> 172.21.15.39:0/2879010099 conn(0x563377bed6f0 msgr2=0x563377bfc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- 172.21.15.39:0/2879010099 shutdown_connections 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- 172.21.15.39:0/2879010099 wait complete. 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- start start 2024-04-26T23:27:58.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 Processor -- start 2024-04-26T23:27:58.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377c4ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3a700 0x563377c4f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563377a3e110 con 0x563377c3b020 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5633779d47b0 con 0x563377c3a700 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x563377a43430 con 0x563377bf1740 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff142c0f000 10 client.0 _ll_register_callbacks cb 0x7ff12c0c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.267+0000 7ff13d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55022/0 (socket says 172.21.15.39:55022) 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 -- 172.21.15.39:0/1936163291 learned_addr learned my addr 172.21.15.39:0/1936163291 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff137e00640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3a700 0x563377c4f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377c4ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 -- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 msgr2=0x563377c4ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377c4ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 -- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3a700 msgr2=0x563377c4f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3a700 0x563377c4f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 -- 172.21.15.39:0/1936163291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563377ac1160 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13d800640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff130001da0 tx=0x7ff130004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b82a9b330c53da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130007a10 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7ff130010070 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff12405f280 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff130016440 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 10 client.5649 fetch_fsmap learned FSMap version 30 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5633776f80c0 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12405f280 con 0x563377c3b020 2024-04-26T23:27:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7ff1300165e0 con 0x563377c3b020 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 10 client.5649 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 10 client.5649 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 20 client.5649 populate_metadata read hostname 'smithi039' 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377caf7a0 0x563377cb1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 4 client.5649 mds_command: new command op to 5490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 --> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] -- command(tid 0: {"prefix": "status"}) -- 0x563377a4ca10 con 0x563377caf7a0 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377caf7a0 0x563377cb1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13ce00640 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377caf7a0 0x563377cb1b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fa3393aeb9b60e server_cookie=aafa0268db8329ec in_seq=0 out_seq=0 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 10 client.5649 ms_handle_connect on v2:172.21.15.39:6832/3842819351 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 1 -- 172.21.15.39:0/1936163291 <== mds.0 v2:172.21.15.39:6832/3842819351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563377a4ca10 con 0x563377caf7a0 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 10 client.5649 handle_command_reply: tid=0 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 client.5649 shutdown 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 msgr2=0x563377c66340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff130001da0 tx=0x7ff130004f80 comp rx=0 tx=0).stop 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 shutdown_connections 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563377c3b020 0x563377c66340 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.39:6832/3842819351,v1:172.21.15.39:6835/3842819351] conn(0x563377caf7a0 0x563377cb1b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563377c3a700 0x563377c4f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 --2- 172.21.15.39:0/1936163291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x563377bf1740 0x563377c4ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 >> 172.21.15.39:0/1936163291 conn(0x563377bed6f0 msgr2=0x563377c47460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff11e000640 0 client.5649 ms_handle_reset on v2:172.21.15.39:6832/3842819351 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 shutdown_connections 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 1 -- 172.21.15.39:0/1936163291 wait complete. 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff142c0f000 20 client.5649 trim_cache size 0 max 16384 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:27:58.279 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "65ff9fdb-1208-4558-966c-a36e641138f0", 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5490, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 10.509009313, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 30, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 51, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 51, 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 15.384887561999999 2024-04-26T23:27:58.280 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 msgr2=0x7ff11806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 0x7ff11806a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0ae000 tx=0x7ff12c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 msgr2=0x7ff138161d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.271+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff12400e870 tx=0x7ff12400ec70 comp rx=0 tx=0).stop 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 shutdown_connections 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff118068380 0x7ff11806a840 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff13815f990 0x7ff138157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1380d18c0 0x7ff138161d10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 --2- 172.21.15.39:0/1507410155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1380d0f20 0x7ff1380cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 >> 172.21.15.39:0/1507410155 conn(0x7ff1380d3020 msgr2=0x7ff1380753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 shutdown_connections 2024-04-26T23:27:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.275+0000 7ff13f800640 1 -- 172.21.15.39:0/1507410155 wait complete. 2024-04-26T23:27:58.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:27:58.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 Processor -- start 2024-04-26T23:27:58.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 -- start start 2024-04-26T23:27:58.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01dc0b5710 0x7f01dc09b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc0cd810 con 0x7f01dc15f340 2024-04-26T23:27:58.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc0cdaf0 con 0x7f01dc15f720 2024-04-26T23:27:58.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e2a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc0d26a0 con 0x7f01dc0b5710 2024-04-26T23:27:58.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01dbe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f01dc15f340 0x7f01dc0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56898/0 (socket says 172.21.15.39:56898) 2024-04-26T23:27:58.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01dbe00640 1 -- 172.21.15.39:0/3045783727 learned_addr learned my addr 172.21.15.39:0/3045783727 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:58.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01d3e00640 1 --2- 172.21.15.39:0/3045783727 >> v2:172.21.15.71:3300/0 conn(0x7f01dc0b5710 0x7f01dc09b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440105543 0 0) 0x7f01dc0cd810 con 0x7f01dc15f340 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c0003530 con 0x7f01dc15f340 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015537520 0 0) 0x7f01dc0cdaf0 con 0x7f01dc15f720 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01dc0cd810 con 0x7f01dc15f720 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1703324285 0 0) 0x7f01c0003530 con 0x7f01dc15f340 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 >> v2:172.21.15.71:3300/0 conn(0x7f01dc0b5710 msgr2=0x7f01dc09b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 --2- 172.21.15.39:0/3045783727 >> v2:172.21.15.71:3300/0 conn(0x7f01dc0b5710 0x7f01dc09b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 >> v1:172.21.15.71:6789/0 conn(0x7f01dc15f720 legacy=0x7f01dc0b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0cddd0 con 0x7f01dc15f340 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f01cc001680 con 0x7f01dc15f340 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01d3e00640 1 --2- 172.21.15.39:0/3045783727 >> v2:172.21.15.71:3300/0 conn(0x7f01dc0b5710 0x7f01dc09b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 >> v1:172.21.15.39:6789/0 conn(0x7f01dc15f340 legacy=0x7f01dc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c0003b50 0x7f01c0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c0004810 0x7f01c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 0x7f01c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0d26a0 con 0x7f01c00051d0 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01c000c100 con 0x7f01c0003b50 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f01c000c300 con 0x7f01c0004810 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 0x7f01c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01dbe00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c0003b50 0x7f01c0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01d3e00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c0004810 0x7f01c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 -- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c0004810 msgr2=0x7f01c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c0004810 0x7f01c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 -- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c0003b50 msgr2=0x7f01c0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:58.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c0003b50 0x7f01c0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.435+0000 7f01e0a00640 1 -- 172.21.15.39:0/3045783727 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0003530 con 0x7f01c00051d0 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e0a00640 1 -- 172.21.15.39:0/3045783727 reap_dead start 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e0a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 0x7f01c000b9d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f01d4001fd0 tx=0x7f01d401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81e59c020b6f1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4001c20 con 0x7f01c00051d0 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d40a8c90 con 0x7f01c00051d0 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01db400640 1 -- 172.21.15.39:0/3045783727 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4003bc0 con 0x7f01c00051d0 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 -- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 msgr2=0x7f01c000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 0x7f01c000b9d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f01d4001fd0 tx=0x7f01d401f070 comp rx=0 tx=0).stop 2024-04-26T23:27:58.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 -- 172.21.15.39:0/3045783727 shutdown_connections 2024-04-26T23:27:58.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 --2- 172.21.15.39:0/3045783727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01c00051d0 0x7f01c000b9d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 -- 172.21.15.39:0/3045783727 >> 172.21.15.39:0/3045783727 conn(0x7f01dc0b4b80 msgr2=0x7f01dc0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 -- 172.21.15.39:0/3045783727 shutdown_connections 2024-04-26T23:27:58.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.439+0000 7f01e2a00640 1 -- 172.21.15.39:0/3045783727 wait complete. 2024-04-26T23:27:58.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 Processor -- start 2024-04-26T23:27:58.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- start start 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c00051d0 0x7f01dc1f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01dc1554d0 0x7f01dc0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0ce140 con 0x7f01dc0b87d0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0d1de0 con 0x7f01dc1554d0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc0d1f60 con 0x7f01c00051d0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55042/0 (socket says 172.21.15.39:55042) 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 -- 172.21.15.39:0/234952237 learned_addr learned my addr 172.21.15.39:0/234952237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01dc1554d0 0x7f01dc0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01dbe00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c00051d0 0x7f01dc1f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 -- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c00051d0 msgr2=0x7f01dc1f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c00051d0 0x7f01dc1f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 -- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01dc1554d0 msgr2=0x7f01dc0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01dc1554d0 0x7f01dc0b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 -- 172.21.15.39:0/234952237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc1f91e0 con 0x7f01dc0b87d0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e0a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f01d401f910 tx=0x7f01c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4001c00 con 0x7f01dc0b87d0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d40050d0 con 0x7f01dc0b87d0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4005480 con 0x7f01dc0b87d0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc0c81c0 con 0x7f01dc0b87d0 2024-04-26T23:27:58.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.443+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc0c8780 con 0x7f01dc0b87d0 2024-04-26T23:27:58.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc050740 con 0x7f01dc0b87d0 2024-04-26T23:27:58.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01d4005620 con 0x7f01dc0b87d0 2024-04-26T23:27:58.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01d8c00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 0x7f01b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:58.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f01d4123610 con 0x7f01dc0b87d0 2024-04-26T23:27:58.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01dbe00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 0x7f01b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:58.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.447+0000 7f01dbe00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 0x7f01b806a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0b3fd0 tx=0x7f01cc001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:58.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.451+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01d40bf060 con 0x7f01dc0b87d0 2024-04-26T23:27:58.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f01dc15e930 con 0x7f01dc0b87d0 2024-04-26T23:27:58.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01d8c00640 1 -- 172.21.15.39:0/234952237 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7f01d4018d80 con 0x7f01dc0b87d0 2024-04-26T23:27:58.657 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:27:58.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 msgr2=0x7f01b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 0x7f01b806a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0b3fd0 tx=0x7f01cc001e50 comp rx=0 tx=0).stop 2024-04-26T23:27:58.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 msgr2=0x7f01dc160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:58.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f01d401f910 tx=0x7f01c0005840 comp rx=0 tx=0).stop 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 shutdown_connections 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f01b8068380 0x7f01b806a840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01dc0b87d0 0x7f01dc160b80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01dc1554d0 0x7f01dc0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 --2- 172.21.15.39:0/234952237 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01c00051d0 0x7f01dc1f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 >> 172.21.15.39:0/234952237 conn(0x7f01dc0b4b80 msgr2=0x7f01dc070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:58.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 shutdown_connections 2024-04-26T23:27:58.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58.655+0000 7f01e2a00640 1 -- 172.21.15.39:0/234952237 wait complete. 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:27:58.678 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:58.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:58.679 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.688 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42350sec preferred_lft 42350sec 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:23:a8:f7:18 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:27:58.689 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:58.690 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:27:58.691 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:27:58.691 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:58.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:58.692 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:27:58.754 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-04-26T23:27:58.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:58.756 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-04-26T23:27:58.813 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-04-26T23:27:58.813 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:27:58.814 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:27:58.814 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:27:58.814 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:27:58.814 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:27:58.814 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:27:58.814 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:27:58.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:27:58.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:27:58.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:27:58.815 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:27:58.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:27:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:58.956 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:27:58.965 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:27:58.965 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:27:58.966 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:58.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:58.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-04-26T23:27:59.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:59.032 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:59.085 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:27:59.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:27:59.085 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:59.135 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:27:59.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:59.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:59.226 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:59.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:59.226 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:59.241 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:59.241 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:59.241 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:59.241 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:59.242 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:27:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:27:59.257 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:27:59.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:59.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:27:59.277 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:27:59.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:27:59.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:27:59.383 INFO:teuthology.orchestra.run.smithi039.stdout:client5267 2024-04-26T23:27:59.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:27:59.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:27:59.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:27:59.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 Processor -- start 2024-04-26T23:27:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 -- start start 2024-04-26T23:27:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 0x7fcd8c0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0d1430 con 0x7fcd8c163760 2024-04-26T23:27:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8c0d1a60 con 0x7fcd8c073230 2024-04-26T23:27:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd92600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c0704d0 con 0x7fcd8c073610 2024-04-26T23:27:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd91c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcd8c163760 0x7fcd8c06c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56914/0 (socket says 172.21.15.39:56914) 2024-04-26T23:27:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd91c00640 1 -- 172.21.15.39:0/1725335190 learned_addr learned my addr 172.21.15.39:0/1725335190 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:27:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd91200640 1 --2- 172.21.15.39:0/1725335190 >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 0x7fcd8c0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1725335190 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187464947 0 0) 0x7fcd8c0d1430 con 0x7fcd8c163760 2024-04-26T23:27:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd74003530 con 0x7fcd8c163760 2024-04-26T23:27:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8be00640 1 -- 172.21.15.39:0/1725335190 >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 msgr2=0x7fcd8c0d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:27:59.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1725335190 >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 0x7fcd8c0d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8be00640 1 -- 172.21.15.39:0/1725335190 >> v1:172.21.15.39:6789/0 conn(0x7fcd8c163760 legacy=0x7fcd8c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1163644481 0 0) 0x7fcd74003530 con 0x7fcd8c163760 2024-04-26T23:27:59.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd8be00640 1 -- 172.21.15.39:0/1725335190 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c0707b0 con 0x7fcd8c073610 2024-04-26T23:27:59.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.579+0000 7fcd91200640 1 --2- 172.21.15.39:0/1725335190 >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 0x7fcd8c0d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:27:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1725335190 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c0cfb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097c0 tx=0x7fcd7801c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1923bb1c8d14072d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd780b0070 con 0x7fcd8c073610 2024-04-26T23:27:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd780ab400 con 0x7fcd8c073610 2024-04-26T23:27:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd8b400640 1 -- 172.21.15.39:0/1725335190 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84001a00 con 0x7fcd8c073610 2024-04-26T23:27:59.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 -- 172.21.15.39:0/1725335190 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 msgr2=0x7fcd8c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 --2- 172.21.15.39:0/1725335190 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c0cfb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097c0 tx=0x7fcd7801c270 comp rx=0 tx=0).stop 2024-04-26T23:27:59.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 -- 172.21.15.39:0/1725335190 shutdown_connections 2024-04-26T23:27:59.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 --2- 172.21.15.39:0/1725335190 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c0cfb40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 --2- 172.21.15.39:0/1725335190 >> v2:172.21.15.71:3300/0 conn(0x7fcd8c073230 0x7fcd8c0d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 -- 172.21.15.39:0/1725335190 >> 172.21.15.39:0/1725335190 conn(0x7fcd8c0d1c90 msgr2=0x7fcd8c0d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:59.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 -- 172.21.15.39:0/1725335190 shutdown_connections 2024-04-26T23:27:59.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.583+0000 7fcd92600640 1 -- 172.21.15.39:0/1725335190 wait complete. 2024-04-26T23:27:59.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 Processor -- start 2024-04-26T23:27:59.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- start start 2024-04-26T23:27:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8c163760 0x7fcd8c154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c16c480 con 0x7fcd8c073230 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c16c300 con 0x7fcd8c163760 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c16c600 con 0x7fcd8c073610 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55052/0 (socket says 172.21.15.39:55052) 2024-04-26T23:27:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 -- 172.21.15.39:0/1338243576 learned_addr learned my addr 172.21.15.39:0/1338243576 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:27:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91c00640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8c163760 0x7fcd8c154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 -- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 msgr2=0x7fcd8c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 -- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8c163760 msgr2=0x7fcd8c154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8c163760 0x7fcd8c154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 -- 172.21.15.39:0/1338243576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c155910 con 0x7fcd8c073230 2024-04-26T23:27:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd91200640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e980 tx=0x7fcd8000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80017070 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8000ca00 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c155bf0 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000cdd0 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c0c5960 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.587+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c0506d0 con 0x7fcd8c073230 2024-04-26T23:27:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.591+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd8001a070 con 0x7fcd8c073230 2024-04-26T23:27:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.591+0000 7fcd88c00640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 0x7fcd6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:27:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.591+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fcd80086c30 con 0x7fcd8c073230 2024-04-26T23:27:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.591+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 0x7fcd6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:27:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.591+0000 7fcd8be00640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 0x7fcd6c06a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ad000 tx=0x7fcd78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:27:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.595+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcd800571f0 con 0x7fcd8c073230 2024-04-26T23:27:59.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.795+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcd8c169ec0 con 0x7fcd8c073230 2024-04-26T23:27:59.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.795+0000 7fcd88c00640 1 -- 172.21.15.39:0/1338243576 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7fcd80056af0 con 0x7fcd8c073230 2024-04-26T23:27:59.800 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 msgr2=0x7fcd6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 0x7fcd6c06a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ad000 tx=0x7fcd78008040 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 msgr2=0x7fcd8c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e980 tx=0x7fcd8000ee40 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 shutdown_connections 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcd6c068380 0x7fcd6c06a840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8c163760 0x7fcd8c154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd8c073610 0x7fcd8c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 --2- 172.21.15.39:0/1338243576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd8c073230 0x7fcd8c0b6410 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 >> 172.21.15.39:0/1338243576 conn(0x7fcd8c0d1c90 msgr2=0x7fcd8c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 shutdown_connections 2024-04-26T23:27:59.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:27:59.799+0000 7fcd92600640 1 -- 172.21.15.39:0/1338243576 wait complete. 2024-04-26T23:27:59.820 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:27:59.820 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:27:59.821 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:27:59.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:59.821 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-26T23:27:59.831 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:27:59.831 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:27:59.831 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:27:59.831 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.831 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42318sec preferred_lft 42318sec 2024-04-26T23:27:59.832 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 02:42:96:98:d1:ab brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:27:59.833 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:27:59.834 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.834 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:27:59.834 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:27:59.834 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:27:59.834 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:27:59.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:59.835 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:27:59.899 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:27:59.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:27:59.901 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:59.956 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:59.957 INFO:teuthology.orchestra.run.smithi071.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:27:59.957 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:27:59.957 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:28:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:28:00.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:00.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:00.106 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:28:00.114 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:28:00.114 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:28:00.115 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:28:00.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:00.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-26T23:28:00.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:00.179 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:00.231 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:28:00.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:00.232 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:00.283 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:28:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:00.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:00.377 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:00.377 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:00.377 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:00.393 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:00.393 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:00.393 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:00.393 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:00.393 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:00.401 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:00.401 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:28:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:28:00.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:28:00.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:00.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:00.425 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:28:00.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:28:00.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:00.523 INFO:teuthology.orchestra.run.smithi071.stdout:client5626 2024-04-26T23:28:00.523 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:00.524 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:00.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-26T23:28:00.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.675+0000 7fe282000640 1 Processor -- start 2024-04-26T23:28:00.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 -- start start 2024-04-26T23:28:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe27c0b3df0 0x7fe27c0b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27c0b4280 con 0x7fe27c160cc0 2024-04-26T23:28:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe27c06edd0 con 0x7fe27c0b3df0 2024-04-26T23:28:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe282000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe27c072620 con 0x7fe27c1468a0 2024-04-26T23:28:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe273e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe27c0b3df0 0x7fe27c0b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe27c160cc0 0x7fe27c072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:52068/0 (socket says 172.21.15.39:52068) 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27be00640 1 -- 172.21.15.39:0/1985670165 learned_addr learned my addr 172.21.15.39:0/1985670165 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:49084/0 (socket says 172.21.15.39:49084) 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 -- 172.21.15.39:0/1985670165 >> v2:172.21.15.71:3300/0 conn(0x7fe27c0b3df0 msgr2=0x7fe27c0b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 --2- 172.21.15.39:0/1985670165 >> v2:172.21.15.71:3300/0 conn(0x7fe27c0b3df0 0x7fe27c0b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27aa00640 1 -- 172.21.15.39:0/1985670165 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694493822 0 0) 0x7fe27c0b4280 con 0x7fe27c160cc0 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 -- 172.21.15.39:0/1985670165 >> v1:172.21.15.71:6789/0 conn(0x7fe27c160cc0 legacy=0x7fe27c072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.679+0000 7fe27b400640 1 -- 172.21.15.39:0/1985670165 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27c06f020 con 0x7fe27c1468a0 2024-04-26T23:28:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe27b400640 1 --2- 172.21.15.39:0/1985670165 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7daefae2e2460 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe27aa00640 1 -- 172.21.15.39:0/1985670165 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0b0070 con 0x7fe27c1468a0 2024-04-26T23:28:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe27aa00640 1 -- 172.21.15.39:0/1985670165 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe26c0ab600 con 0x7fe27c1468a0 2024-04-26T23:28:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe27aa00640 1 -- 172.21.15.39:0/1985670165 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0ab9d0 con 0x7fe27c1468a0 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- 172.21.15.39:0/1985670165 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 msgr2=0x7fe27c074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 --2- 172.21.15.39:0/1985670165 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01c380 comp rx=0 tx=0).stop 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- 172.21.15.39:0/1985670165 shutdown_connections 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 --2- 172.21.15.39:0/1985670165 >> v2:172.21.15.71:3300/0 conn(0x7fe27c0b3df0 0x7fe27c0b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 --2- 172.21.15.39:0/1985670165 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c1468a0 0x7fe27c074180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- 172.21.15.39:0/1985670165 >> 172.21.15.39:0/1985670165 conn(0x7fe27c0b2cc0 msgr2=0x7fe27c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- 172.21.15.39:0/1985670165 shutdown_connections 2024-04-26T23:28:00.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- 172.21.15.39:0/1985670165 wait complete. 2024-04-26T23:28:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 Processor -- start 2024-04-26T23:28:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.683+0000 7fe282000640 1 -- start start 2024-04-26T23:28:00.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c160cc0 0x7fe27c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 0x7fe27c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c0735d0 con 0x7fe27c1468a0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c146c80 con 0x7fe27c157fd0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe27c073750 con 0x7fe27c160cc0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41392/0 (socket says 172.21.15.39:41392) 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 -- 172.21.15.39:0/4289473807 learned_addr learned my addr 172.21.15.39:0/4289473807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe273e00640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c160cc0 0x7fe27c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27be00640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 0x7fe27c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 -- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c160cc0 msgr2=0x7fe27c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c160cc0 0x7fe27c13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 -- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 msgr2=0x7fe27c15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:00.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 0x7fe27c15b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 -- 172.21.15.39:0/4289473807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27c0d1b70 con 0x7fe27c1468a0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27be00640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 0x7fe27c15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe27b400640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0ae040 tx=0x7fe26c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0b0050 con 0x7fe27c1468a0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe26c0bc070 con 0x7fe27c1468a0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0b5870 con 0x7fe27c1468a0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27c13d1b0 con 0x7fe27c1468a0 2024-04-26T23:28:00.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27c154010 con 0x7fe27c1468a0 2024-04-26T23:28:00.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.687+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe27c050740 con 0x7fe27c1468a0 2024-04-26T23:28:00.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.691+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe26c0b5a10 con 0x7fe27c1468a0 2024-04-26T23:28:00.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.691+0000 7fe273400640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 0x7fe25806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:00.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.691+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fe26c1211d0 con 0x7fe27c1468a0 2024-04-26T23:28:00.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.691+0000 7fe273e00640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 0x7fe25806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:00.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.691+0000 7fe273e00640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 0x7fe25806a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ce390 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:00.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.695+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe26c016090 con 0x7fe27c1468a0 2024-04-26T23:28:00.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:00.895+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe27c06ff60 con 0x7fe27c1468a0 2024-04-26T23:28:01.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.335+0000 7fe273400640 1 -- 172.21.15.39:0/4289473807 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v31) ==== 136+0+0 (secure 0 0 0) 0x7fe26c0f1780 con 0x7fe27c1468a0 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 msgr2=0x7fe25806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 0x7fe25806a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ce390 tx=0x7fe264008040 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 msgr2=0x7fe27c1535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0ae040 tx=0x7fe26c01abc0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 shutdown_connections 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe258068380 0x7fe25806a840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27c157fd0 0x7fe27c15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe27c160cc0 0x7fe27c13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 --2- 172.21.15.39:0/4289473807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe27c1468a0 0x7fe27c1535c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 >> 172.21.15.39:0/4289473807 conn(0x7fe27c0b2cc0 msgr2=0x7fe27c072ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:01.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 shutdown_connections 2024-04-26T23:28:01.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.339+0000 7fe282000640 1 -- 172.21.15.39:0/4289473807 wait complete. 2024-04-26T23:28:01.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:28:01.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.503+0000 7f8a5e200640 1 Processor -- start 2024-04-26T23:28:01.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a5e200640 1 -- start start 2024-04-26T23:28:01.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a5e200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8a5806d970 0x7f8a580b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a5e200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5806dfa0 con 0x7f8a5806d4e0 2024-04-26T23:28:01.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a5e200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5806e280 con 0x7f8a580cf8c0 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a5e200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5806dd80 con 0x7f8a5806d970 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a57e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8a5806d970 0x7f8a580b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a4ea00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8a5806d4e0 0x7f8a580d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33162/0 (socket says 172.21.15.39:33162) 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a4ea00640 1 -- 172.21.15.39:0/3093166177 learned_addr learned my addr 172.21.15.39:0/3093166177 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a57e00640 1 -- 172.21.15.39:0/3093166177 >> v1:172.21.15.71:6789/0 conn(0x7f8a580cf8c0 legacy=0x7f8a580cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a57e00640 1 -- 172.21.15.39:0/3093166177 >> v1:172.21.15.39:6789/0 conn(0x7f8a5806d4e0 legacy=0x7f8a580d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a57e00640 1 -- 172.21.15.39:0/3093166177 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5806e560 con 0x7f8a5806d970 2024-04-26T23:28:01.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.507+0000 7f8a56a00640 1 -- 172.21.15.39:0/3093166177 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531694674 0 0) 0x7f8a5806dfa0 con 0x7f8a5806d4e0 2024-04-26T23:28:01.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a57e00640 1 --2- 172.21.15.39:0/3093166177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a5806d970 0x7f8a580b37f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a5001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432008f4cbd8ffa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a56a00640 1 -- 172.21.15.39:0/3093166177 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500b2070 con 0x7f8a5806d970 2024-04-26T23:28:01.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a56a00640 1 -- 172.21.15.39:0/3093166177 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500a5a00 con 0x7f8a5806d970 2024-04-26T23:28:01.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a56a00640 1 -- 172.21.15.39:0/3093166177 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500a5dd0 con 0x7f8a5806d970 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- 172.21.15.39:0/3093166177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a5806d970 msgr2=0x7f8a580b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 --2- 172.21.15.39:0/3093166177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a5806d970 0x7f8a580b37f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a5001c940 comp rx=0 tx=0).stop 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- 172.21.15.39:0/3093166177 shutdown_connections 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 --2- 172.21.15.39:0/3093166177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a5806d970 0x7f8a580b37f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- 172.21.15.39:0/3093166177 >> 172.21.15.39:0/3093166177 conn(0x7f8a580d3040 msgr2=0x7f8a580d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- 172.21.15.39:0/3093166177 shutdown_connections 2024-04-26T23:28:01.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- 172.21.15.39:0/3093166177 wait complete. 2024-04-26T23:28:01.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 Processor -- start 2024-04-26T23:28:01.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.511+0000 7f8a5e200640 1 -- start start 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 0x7f8a580ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8a5806d970 0x7f8a5815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580d17e0 con 0x7f8a580cf8c0 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580b4730 con 0x7f8a5806d4e0 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580d1960 con 0x7f8a5806d970 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41414/0 (socket says 172.21.15.39:41414) 2024-04-26T23:28:01.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 -- 172.21.15.39:0/2397904358 learned_addr learned my addr 172.21.15.39:0/2397904358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57400640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 0x7f8a580ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a4ea00640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8a5806d970 0x7f8a5815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 -- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8a5806d970 msgr2=0x7f8a5815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8a5806d970 0x7f8a5815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 -- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 msgr2=0x7f8a580ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 0x7f8a580ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 -- 172.21.15.39:0/2397904358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580ce980 con 0x7f8a580cf8c0 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57400640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 0x7f8a580ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:01.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a57e00640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8a5001a570 tx=0x7f8a500196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500b2050 con 0x7f8a580cf8c0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500be070 con 0x7f8a580cf8c0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a580cec60 con 0x7f8a580cf8c0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500adbd0 con 0x7f8a580cf8c0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a580cf220 con 0x7f8a580cf8c0 2024-04-26T23:28:01.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5806a720 con 0x7f8a580cf8c0 2024-04-26T23:28:01.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.515+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a500b9450 con 0x7f8a580cf8c0 2024-04-26T23:28:01.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.519+0000 7f8a4fe00640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 0x7f8a3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.519+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f8a501216b0 con 0x7f8a580cf8c0 2024-04-26T23:28:01.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.519+0000 7f8a57400640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 0x7f8a3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.519+0000 7f8a57400640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 0x7f8a3406a870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000f70 tx=0x7f8a48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.523+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a500c7020 con 0x7f8a580cf8c0 2024-04-26T23:28:01.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.711+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f8a580d2740 con 0x7f8a340683b0 2024-04-26T23:28:01.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.711+0000 7f8a4fe00640 1 -- 172.21.15.39:0/2397904358 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f8a580d2740 con 0x7f8a340683b0 2024-04-26T23:28:01.716 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:28:01.716 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:01.716 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs" 2024-04-26T23:28:01.716 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:01.716 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 msgr2=0x7f8a3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 0x7f8a3406a870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000f70 tx=0x7f8a48009040 comp rx=0 tx=0).stop 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 msgr2=0x7f8a5814f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8a5001a570 tx=0x7f8a500196e0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 shutdown_connections 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8a340683b0 0x7f8a3406a870 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a580cf8c0 0x7f8a5814f050 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8a5806d970 0x7f8a5815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 --2- 172.21.15.39:0/2397904358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a5806d4e0 0x7f8a580ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 >> 172.21.15.39:0/2397904358 conn(0x7f8a580d3040 msgr2=0x7f8a580d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 shutdown_connections 2024-04-26T23:28:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.715+0000 7f8a5e200640 1 -- 172.21.15.39:0/2397904358 wait complete. 2024-04-26T23:28:01.738 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:28:01.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 Processor -- start 2024-04-26T23:28:01.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 -- start start 2024-04-26T23:28:01.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbce006def0 0x7fbce009c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbce006d760 0x7fbce006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbce00d1e20 con 0x7fbce006def0 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbce00d14f0 con 0x7fbce006d760 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce8200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbce00d17d0 con 0x7fbce015f810 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbce006def0 0x7fbce009c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbce006def0 0x7fbce009c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41420/0 (socket says 172.21.15.39:41420) 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 -- 172.21.15.39:0/520220479 learned_addr learned my addr 172.21.15.39:0/520220479 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce6200640 1 --2- 172.21.15.39:0/520220479 >> v2:172.21.15.71:3300/0 conn(0x7fbce006d760 0x7fbce006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce4e00640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 -- 172.21.15.39:0/520220479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 msgr2=0x7fbce00d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 -- 172.21.15.39:0/520220479 >> v2:172.21.15.71:3300/0 conn(0x7fbce006d760 msgr2=0x7fbce006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 --2- 172.21.15.39:0/520220479 >> v2:172.21.15.71:3300/0 conn(0x7fbce006d760 0x7fbce006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce5800640 1 -- 172.21.15.39:0/520220479 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce00d1ab0 con 0x7fbce006def0 2024-04-26T23:28:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.879+0000 7fbce4e00640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:01.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce5800640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006def0 0x7fbce009c3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d0e00 tx=0x7fbcd401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a089a5955787cdee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbcdfe00640 1 -- 172.21.15.39:0/520220479 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a7070 con 0x7fbce006def0 2024-04-26T23:28:01.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbcdfe00640 1 -- 172.21.15.39:0/520220479 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd40b0070 con 0x7fbce006def0 2024-04-26T23:28:01.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbcdfe00640 1 -- 172.21.15.39:0/520220479 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab890 con 0x7fbce006def0 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 -- 172.21.15.39:0/520220479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006def0 msgr2=0x7fbce009c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006def0 0x7fbce009c3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d0e00 tx=0x7fbcd401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 -- 172.21.15.39:0/520220479 shutdown_connections 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 --2- 172.21.15.39:0/520220479 >> v2:172.21.15.71:3300/0 conn(0x7fbce006d760 0x7fbce006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 --2- 172.21.15.39:0/520220479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006def0 0x7fbce009c3c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 -- 172.21.15.39:0/520220479 >> 172.21.15.39:0/520220479 conn(0x7fbce00b4c20 msgr2=0x7fbce00b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 -- 172.21.15.39:0/520220479 shutdown_connections 2024-04-26T23:28:01.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.883+0000 7fbce8200640 1 -- 172.21.15.39:0/520220479 wait complete. 2024-04-26T23:28:01.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 Processor -- start 2024-04-26T23:28:01.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- start start 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 0x7fbce00b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00cdf90 con 0x7fbce006d760 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00b5740 con 0x7fbce006def0 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbce00ce110 con 0x7fbce015f810 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41422/0 (socket says 172.21.15.39:41422) 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 -- 172.21.15.39:0/3965976280 learned_addr learned my addr 172.21.15.39:0/3965976280 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce4e00640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 0x7fbce00b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce6200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 -- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 msgr2=0x7fbce00b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 -- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 msgr2=0x7fbce00b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 0x7fbce00b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 -- 172.21.15.39:0/3965976280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce01548e0 con 0x7fbce006d760 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce6200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce4e00640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 0x7fbce00b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce5800640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbcd401ab90 tx=0x7fbcd401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40be5f0 con 0x7fbce006d760 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd40be790 con 0x7fbce006d760 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40beb80 con 0x7fbce006d760 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce00b6df0 con 0x7fbce006d760 2024-04-26T23:28:01.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.887+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce0158bf0 con 0x7fbce006d760 2024-04-26T23:28:01.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce006a720 con 0x7fbce006d760 2024-04-26T23:28:01.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcd40b43f0 con 0x7fbce006d760 2024-04-26T23:28:01.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbcdd600640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:01.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fbcd41214c0 con 0x7fbce006d760 2024-04-26T23:28:01.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbce4e00640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:01.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.891+0000 7fbce4e00640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 0x7fbcc006a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbce00c95f0 tx=0x7fbccc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:01.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:01.895+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbcd40160d0 con 0x7fbce006d760 2024-04-26T23:28:02.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbce00c9ca0 con 0x7fbce006d760 2024-04-26T23:28:02.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbcdd600640 1 -- 172.21.15.39:0/3965976280 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fbcd40f1420 con 0x7fbce006d760 2024-04-26T23:28:02.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 msgr2=0x7fbcc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 0x7fbcc006a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbce00c95f0 tx=0x7fbccc008040 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 msgr2=0x7fbce01543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbcd401ab90 tx=0x7fbcd401ad20 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 shutdown_connections 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbce015f810 0x7fbce00b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbce006def0 0x7fbce00b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 --2- 172.21.15.39:0/3965976280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbce006d760 0x7fbce01543a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 >> 172.21.15.39:0/3965976280 conn(0x7fbce00b4c20 msgr2=0x7fbce00cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 shutdown_connections 2024-04-26T23:28:02.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.063+0000 7fbce8200640 1 -- 172.21.15.39:0/3965976280 wait complete. 2024-04-26T23:28:02.087 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp78640 2024-04-26T23:28:02.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 Processor -- start 2024-04-26T23:28:02.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 -- start start 2024-04-26T23:28:02.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf34140170 0x7faf3415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3406e500 con 0x7faf340d18f0 2024-04-26T23:28:02.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3406e7e0 con 0x7faf3415e340 2024-04-26T23:28:02.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf3bc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7faf3406f110 con 0x7faf34140170 2024-04-26T23:28:02.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf39c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7faf340d18f0 0x7faf340cf6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33164/0 (socket says 172.21.15.39:33164) 2024-04-26T23:28:02.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf39c00640 1 -- 172.21.15.39:0/680631942 learned_addr learned my addr 172.21.15.39:0/680631942 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.227+0000 7faf39200640 1 --2- 172.21.15.39:0/680631942 >> v2:172.21.15.71:3300/0 conn(0x7faf34140170 0x7faf3415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847899178 0 0) 0x7faf3406e500 con 0x7faf340d18f0 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf1c003530 con 0x7faf340d18f0 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf39200640 1 -- 172.21.15.39:0/680631942 >> v1:172.21.15.71:6789/0 conn(0x7faf3415e340 legacy=0x7faf340d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224483572 0 0) 0x7faf3406e7e0 con 0x7faf3415e340 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf39200640 1 -- 172.21.15.39:0/680631942 >> v1:172.21.15.39:6789/0 conn(0x7faf340d18f0 legacy=0x7faf340cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf39200640 1 -- 172.21.15.39:0/680631942 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3406eac0 con 0x7faf34140170 2024-04-26T23:28:02.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf39200640 1 --2- 172.21.15.39:0/680631942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34140170 0x7faf3415de00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf280097c0 tx=0x7faf2801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999f80d207091bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf280ab600 con 0x7faf34140170 2024-04-26T23:28:02.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf280b0070 con 0x7faf34140170 2024-04-26T23:28:02.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.231+0000 7faf33400640 1 -- 172.21.15.39:0/680631942 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf280ab9a0 con 0x7faf34140170 2024-04-26T23:28:02.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- 172.21.15.39:0/680631942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34140170 msgr2=0x7faf3415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 --2- 172.21.15.39:0/680631942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34140170 0x7faf3415de00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf280097c0 tx=0x7faf2801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- 172.21.15.39:0/680631942 shutdown_connections 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 --2- 172.21.15.39:0/680631942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34140170 0x7faf3415de00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- 172.21.15.39:0/680631942 >> 172.21.15.39:0/680631942 conn(0x7faf3406c7d0 msgr2=0x7faf3406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- 172.21.15.39:0/680631942 shutdown_connections 2024-04-26T23:28:02.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- 172.21.15.39:0/680631942 wait complete. 2024-04-26T23:28:02.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 Processor -- start 2024-04-26T23:28:02.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- start start 2024-04-26T23:28:02.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 0x7faf3413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf3415e340 0x7faf34140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faf340d09a0 con 0x7faf34140170 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf340d0820 con 0x7faf340d18f0 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf3bc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7faf3416afc0 con 0x7faf3415e340 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf39200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 0x7faf3413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41434/0 (socket says 172.21.15.39:41434) 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 -- 172.21.15.39:0/638896231 learned_addr learned my addr 172.21.15.39:0/638896231 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf39c00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf3415e340 0x7faf34140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 -- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf3415e340 msgr2=0x7faf34140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf3415e340 0x7faf34140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 -- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 msgr2=0x7faf3413f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 0x7faf3413f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 -- 172.21.15.39:0/638896231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf340aa5e0 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf39200640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 0x7faf3413f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.235+0000 7faf33e00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf20001ec0 tx=0x7faf2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20017070 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20003600 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf340aa880 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf200039f0 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3413d9d0 con 0x7faf34140170 2024-04-26T23:28:02.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf341419c0 con 0x7faf34140170 2024-04-26T23:28:02.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf2001a070 con 0x7faf34140170 2024-04-26T23:28:02.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 0x7faf1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7faf20085cd0 con 0x7faf34140170 2024-04-26T23:28:02.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.239+0000 7faf39200640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 0x7faf1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.243+0000 7faf39200640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 0x7faf1406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faf280af000 tx=0x7faf280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.243+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faf20055c30 con 0x7faf34140170 2024-04-26T23:28:02.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.435+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp78640", "target": ["mon-mgr", ""]}) -- 0x7faf3406a720 con 0x7faf14068380 2024-04-26T23:28:02.442 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:02.435+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:02.443 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:02.435+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:02.443 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:02.435+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:02.443 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:02.435+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:02.443 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:02.435+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:02.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.455+0000 7faf30c00640 1 -- 172.21.15.39:0/638896231 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf3406a720 con 0x7faf14068380 2024-04-26T23:28:02.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 msgr2=0x7faf1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 0x7faf1406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faf280af000 tx=0x7faf280a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:02.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 msgr2=0x7faf34156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf20001ec0 tx=0x7faf2000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 shutdown_connections 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7faf14068380 0x7faf1406a840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf3415e340 0x7faf34140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf34140170 0x7faf34156c60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 --2- 172.21.15.39:0/638896231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf340d18f0 0x7faf3413f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 >> 172.21.15.39:0/638896231 conn(0x7faf3406c7d0 msgr2=0x7faf340cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 shutdown_connections 2024-04-26T23:28:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.459+0000 7faf3bc00640 1 -- 172.21.15.39:0/638896231 wait complete. 2024-04-26T23:28:02.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2024-04-26T23:28:02.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 Processor -- start 2024-04-26T23:28:02.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 -- start start 2024-04-26T23:28:02.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa0b006cae0 0x7fa0b0070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa0b00b1520 0x7fa0b00730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b00ce640 con 0x7fa0b01628c0 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b0162ca0 con 0x7fa0b006cae0 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b5400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b00d2d10 con 0x7fa0b00b1520 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0afe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa0b01628c0 0x7fa0b006c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33180/0 (socket says 172.21.15.39:33180) 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0afe00640 1 -- 172.21.15.39:0/1103450067 learned_addr learned my addr 172.21.15.39:0/1103450067 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0a7e00640 1 --2- 172.21.15.39:0/1103450067 >> v2:172.21.15.39:3300/0 conn(0x7fa0b006cae0 0x7fa0b0070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0b4a00640 1 --2- 172.21.15.39:0/1103450067 >> v2:172.21.15.71:3300/0 conn(0x7fa0b00b1520 0x7fa0b00730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0a7e00640 1 -- 172.21.15.39:0/1103450067 >> v2:172.21.15.71:3300/0 conn(0x7fa0b00b1520 msgr2=0x7fa0b00730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:02.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0a7e00640 1 --2- 172.21.15.39:0/1103450067 >> v2:172.21.15.71:3300/0 conn(0x7fa0b00b1520 0x7fa0b00730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0a7e00640 1 -- 172.21.15.39:0/1103450067 >> v1:172.21.15.39:6789/0 conn(0x7fa0b01628c0 legacy=0x7fa0b006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0a7e00640 1 -- 172.21.15.39:0/1103450067 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b00ce080 con 0x7fa0b006cae0 2024-04-26T23:28:02.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.623+0000 7fa0af400640 1 -- 172.21.15.39:0/1103450067 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487657975 0 0) 0x7fa0b00ce640 con 0x7fa0b01628c0 2024-04-26T23:28:02.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0a7e00640 1 --2- 172.21.15.39:0/1103450067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b006cae0 0x7fa0b0070aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0071c70 tx=0x7fa09801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228bd0fd085c86de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0af400640 1 -- 172.21.15.39:0/1103450067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0980b0070 con 0x7fa0b006cae0 2024-04-26T23:28:02.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0af400640 1 -- 172.21.15.39:0/1103450067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa098004230 con 0x7fa0b006cae0 2024-04-26T23:28:02.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0af400640 1 -- 172.21.15.39:0/1103450067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098003620 con 0x7fa0b006cae0 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 -- 172.21.15.39:0/1103450067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b006cae0 msgr2=0x7fa0b0070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 --2- 172.21.15.39:0/1103450067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b006cae0 0x7fa0b0070aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0071c70 tx=0x7fa09801c3f0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 -- 172.21.15.39:0/1103450067 shutdown_connections 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 --2- 172.21.15.39:0/1103450067 >> v2:172.21.15.71:3300/0 conn(0x7fa0b00b1520 0x7fa0b00730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 --2- 172.21.15.39:0/1103450067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b006cae0 0x7fa0b0070aa0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 -- 172.21.15.39:0/1103450067 >> 172.21.15.39:0/1103450067 conn(0x7fa0b00d1e70 msgr2=0x7fa0b00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 -- 172.21.15.39:0/1103450067 shutdown_connections 2024-04-26T23:28:02.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.627+0000 7fa0b5400640 1 -- 172.21.15.39:0/1103450067 wait complete. 2024-04-26T23:28:02.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 Processor -- start 2024-04-26T23:28:02.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- start start 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 0x7fa0b014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0b00b1520 0x7fa0b015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b016c0a0 con 0x7fa0b01628c0 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b016bf20 con 0x7fa0b006cae0 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b016c220 con 0x7fa0b00b1520 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41458/0 (socket says 172.21.15.39:41458) 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 -- 172.21.15.39:0/2340773206 learned_addr learned my addr 172.21.15.39:0/2340773206 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:02.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0a7e00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0b00b1520 0x7fa0b015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0afe00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 0x7fa0b014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 -- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0b00b1520 msgr2=0x7fa0b015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0b00b1520 0x7fa0b015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 -- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 msgr2=0x7fa0b014f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 0x7fa0b014f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 -- 172.21.15.39:0/2340773206 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b014f8f0 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0afe00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 0x7fa0b014f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b4a00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009d30 tx=0x7fa0a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8018020 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a8014480 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b014fbd0 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8014870 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b0150190 con 0x7fa0b01628c0 2024-04-26T23:28:02.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.631+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b00506d0 con 0x7fa0b01628c0 2024-04-26T23:28:02.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.635+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0a801b020 con 0x7fa0b01628c0 2024-04-26T23:28:02.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.635+0000 7fa0acc00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 0x7fa08c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:02.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.635+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fa0a80873a0 con 0x7fa0b01628c0 2024-04-26T23:28:02.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.635+0000 7fa0afe00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 0x7fa08c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:02.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.635+0000 7fa0afe00640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 0x7fa08c06a870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000f70 tx=0x7fa0a0007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:02.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.639+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa0a8022070 con 0x7fa0b01628c0 2024-04-26T23:28:02.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.831+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7fa0b014f670 con 0x7fa08c0683b0 2024-04-26T23:28:02.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0acc00640 1 -- 172.21.15.39:0/2340773206 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+528 (secure 0 0 0) 0x7fa0a00072f0 con 0x7fa08c0683b0 2024-04-26T23:28:02.838 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:28:02.838 INFO:teuthology.orchestra.run.smithi039.stdout: "mon_addrs": [ 2024-04-26T23:28:02.838 INFO:teuthology.orchestra.run.smithi039.stdout: "172.21.15.39:6789", 2024-04-26T23:28:02.838 INFO:teuthology.orchestra.run.smithi039.stdout: "172.21.15.71:6789", 2024-04-26T23:28:02.838 INFO:teuthology.orchestra.run.smithi039.stdout: "172.21.15.71:6790" 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "pending_subvolume_deletions": 0, 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "pools": { 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "data": [ 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "avail": 367087058944, 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs_data", 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "used": 0 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": [ 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "avail": 367087058944, 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs_metadata", 2024-04-26T23:28:02.839 INFO:teuthology.orchestra.run.smithi039.stdout: "used": 65536 2024-04-26T23:28:02.840 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:02.840 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-04-26T23:28:02.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:02.840 INFO:teuthology.orchestra.run.smithi039.stdout: "used_size": 0 2024-04-26T23:28:02.840 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 msgr2=0x7fa08c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 0x7fa08c06a870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000f70 tx=0x7fa0a0007cd0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 msgr2=0x7fa0b015a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009d30 tx=0x7fa0a800c490 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 shutdown_connections 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa08c0683b0 0x7fa08c06a870 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0b01628c0 0x7fa0b015a470 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0b00b1520 0x7fa0b015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 --2- 172.21.15.39:0/2340773206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0b006cae0 0x7fa0b014f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 >> 172.21.15.39:0/2340773206 conn(0x7fa0b00d1e70 msgr2=0x7fa0b00d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 shutdown_connections 2024-04-26T23:28:02.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:02.835+0000 7fa0b5400640 1 -- 172.21.15.39:0/2340773206 wait complete. 2024-04-26T23:28:02.859 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:28:02.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:28:02.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:28:03.054 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:28:03.054 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:28:03.055 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:03.055 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:03.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:03.064 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:03.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 Processor -- start 2024-04-26T23:28:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 -- start start 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f90380b5b40 0x7f903806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f903815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9038148e60 con 0x7f90380b1180 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9038071560 con 0x7f90380b5b40 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f903e200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9038071840 con 0x7f903806c910 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f90380b5b40 0x7f903806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f90380b5b40 0x7f903806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41466/0 (socket says 172.21.15.39:41466) 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 -- 172.21.15.39:0/3691824082 learned_addr learned my addr 172.21.15.39:0/3691824082 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 -- 172.21.15.39:0/3691824082 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 msgr2=0x7f903815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9037e00640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f903815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f903815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 -- 172.21.15.39:0/3691824082 >> v1:172.21.15.71:6789/0 conn(0x7f90380b1180 legacy=0x7f90380709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9036a00640 1 -- 172.21.15.39:0/3691824082 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380b5060 con 0x7f90380b5b40 2024-04-26T23:28:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.299+0000 7f9037e00640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f903815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f9036a00640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b5b40 0x7f903806c3d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9024009870 tx=0x7f902401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b557e4d3e583687c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f9036000640 1 -- 172.21.15.39:0/3691824082 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240b1070 con 0x7f90380b5b40 2024-04-26T23:28:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f9036000640 1 -- 172.21.15.39:0/3691824082 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240ac630 con 0x7f90380b5b40 2024-04-26T23:28:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f9036000640 1 -- 172.21.15.39:0/3691824082 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240a8050 con 0x7f90380b5b40 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 -- 172.21.15.39:0/3691824082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b5b40 msgr2=0x7f903806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b5b40 0x7f903806c3d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9024009870 tx=0x7f902401c520 comp rx=0 tx=0).stop 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 -- 172.21.15.39:0/3691824082 shutdown_connections 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f903815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 --2- 172.21.15.39:0/3691824082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b5b40 0x7f903806c3d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 -- 172.21.15.39:0/3691824082 >> 172.21.15.39:0/3691824082 conn(0x7f903806f550 msgr2=0x7f903806f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 -- 172.21.15.39:0/3691824082 shutdown_connections 2024-04-26T23:28:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 -- 172.21.15.39:0/3691824082 wait complete. 2024-04-26T23:28:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.303+0000 7f903e200640 1 Processor -- start 2024-04-26T23:28:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- start start 2024-04-26T23:28:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f90381638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90380b5b40 0x7f90381437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f903816c420 con 0x7f90380b1180 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f903816c2a0 con 0x7f90380b5b40 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f903816c5a0 con 0x7f903806c910 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41470/0 (socket says 172.21.15.39:41470) 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9037e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90380b5b40 0x7f90381437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 -- 172.21.15.39:0/2981820261 learned_addr learned my addr 172.21.15.39:0/2981820261 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9037400640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f90381638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 -- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 msgr2=0x7f90381638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f90381638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 -- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90380b5b40 msgr2=0x7f90381437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90380b5b40 0x7f90381437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 -- 172.21.15.39:0/2981820261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380d1c50 con 0x7f90380b1180 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f9036a00640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90240af040 tx=0x7f90240192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240bc070 con 0x7f90380b1180 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240b7630 con 0x7f90380b1180 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240b1040 con 0x7f90380b1180 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9038163f30 con 0x7f90380b1180 2024-04-26T23:28:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90381644f0 con 0x7f90380b1180 2024-04-26T23:28:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.307+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9038050740 con 0x7f90380b1180 2024-04-26T23:28:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.311+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90240b63d0 con 0x7f90380b1180 2024-04-26T23:28:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.311+0000 7f902f400640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 0x7f901806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.311+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f9024120310 con 0x7f90380b1180 2024-04-26T23:28:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.311+0000 7f9037400640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 0x7f901806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.311+0000 7f9037400640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 0x7f901806a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f90280098e0 tx=0x7f9028009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.315+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9024016110 con 0x7f90380b1180 2024-04-26T23:28:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90380707d0 con 0x7f90380b1180 2024-04-26T23:28:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f902f400640 1 -- 172.21.15.39:0/2981820261 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f90240f01e0 con 0x7f90380b1180 2024-04-26T23:28:03.486 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:03.486 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 msgr2=0x7f901806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 0x7f901806a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f90280098e0 tx=0x7f9028009060 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 msgr2=0x7f90380d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.483+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90240af040 tx=0x7f90240192c0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 shutdown_connections 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9018068380 0x7f901806a840 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90380b5b40 0x7f90381437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90380b1180 0x7f90380d07c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 --2- 172.21.15.39:0/2981820261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f903806c910 0x7f90381638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 >> 172.21.15.39:0/2981820261 conn(0x7f903806f550 msgr2=0x7f9038148340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 shutdown_connections 2024-04-26T23:28:03.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.487+0000 7f903e200640 1 -- 172.21.15.39:0/2981820261 wait complete. 2024-04-26T23:28:03.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:45.529505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:46.096938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:28:03.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:28:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.647+0000 7f1bcb000640 1 Processor -- start 2024-04-26T23:28:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.647+0000 7f1bcb000640 1 -- start start 2024-04-26T23:28:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bcb000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bcb000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 0x7f1bc40cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bcb000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc406e500 con 0x7f1bc415e340 2024-04-26T23:28:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bcb000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc406f110 con 0x7f1bc40d18f0 2024-04-26T23:28:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bcb000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc406e7e0 con 0x7f1bc4140170 2024-04-26T23:28:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 0x7f1bc40cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 0x7f1bc40cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:38320/0 (socket says 172.21.15.39:38320) 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:49164/0 (socket says 172.21.15.39:49164) 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 -- 172.21.15.39:0/2480502854 learned_addr learned my addr 172.21.15.39:0/2480502854 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1bc415e340 0x7f1bc40d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:52104/0 (socket says 172.21.15.39:52104) 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 -- 172.21.15.39:0/2480502854 >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 msgr2=0x7f1bc40cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 --2- 172.21.15.39:0/2480502854 >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 0x7f1bc40cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 -- 172.21.15.39:0/2480502854 >> v1:172.21.15.71:6789/0 conn(0x7f1bc415e340 legacy=0x7f1bc40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc3e00640 1 -- 172.21.15.39:0/2480502854 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc406eac0 con 0x7f1bc4140170 2024-04-26T23:28:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.651+0000 7f1bc2a00640 1 -- 172.21.15.39:0/2480502854 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418647578 0 0) 0x7f1bc406e500 con 0x7f1bc415e340 2024-04-26T23:28:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bc3e00640 1 --2- 172.21.15.39:0/2480502854 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=debed6ef0b2a24b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bc2a00640 1 -- 172.21.15.39:0/2480502854 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40aa620 con 0x7f1bc4140170 2024-04-26T23:28:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bc2a00640 1 -- 172.21.15.39:0/2480502854 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb40af070 con 0x7f1bc4140170 2024-04-26T23:28:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bc2a00640 1 -- 172.21.15.39:0/2480502854 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40aa9e0 con 0x7f1bc4140170 2024-04-26T23:28:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- 172.21.15.39:0/2480502854 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 msgr2=0x7f1bc415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 --2- 172.21.15.39:0/2480502854 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c460 comp rx=0 tx=0).stop 2024-04-26T23:28:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- 172.21.15.39:0/2480502854 shutdown_connections 2024-04-26T23:28:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 --2- 172.21.15.39:0/2480502854 >> v2:172.21.15.71:3300/0 conn(0x7f1bc40d18f0 0x7f1bc40cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 --2- 172.21.15.39:0/2480502854 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc4140170 0x7f1bc415de00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- 172.21.15.39:0/2480502854 >> 172.21.15.39:0/2480502854 conn(0x7f1bc406c7d0 msgr2=0x7f1bc406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- 172.21.15.39:0/2480502854 shutdown_connections 2024-04-26T23:28:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- 172.21.15.39:0/2480502854 wait complete. 2024-04-26T23:28:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 Processor -- start 2024-04-26T23:28:03.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.655+0000 7f1bcb000640 1 -- start start 2024-04-26T23:28:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bc4140170 0x7f1bc4152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc415e340 0x7f1bc4136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40d07d0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40d0650 con 0x7f1bc4140170 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40d0950 con 0x7f1bc415e340 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41482/0 (socket says 172.21.15.39:41482) 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 -- 172.21.15.39:0/1864637787 learned_addr learned my addr 172.21.15.39:0/1864637787 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3400640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bc4140170 0x7f1bc4152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc9000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc415e340 0x7f1bc4136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 -- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc415e340 msgr2=0x7f1bc4136d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc415e340 0x7f1bc4136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 -- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bc4140170 msgr2=0x7f1bc4152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bc4140170 0x7f1bc4152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 -- 172.21.15.39:0/1864637787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4153430 con 0x7f1bc40d18f0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bc3e00640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ac040 tx=0x7f1bb401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40bd3f0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb40bd5b0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40bd9a0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc414fe50 con 0x7f1bc40d18f0 2024-04-26T23:28:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc4150490 con 0x7f1bc40d18f0 2024-04-26T23:28:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc406a720 con 0x7f1bc40d18f0 2024-04-26T23:28:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.659+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bb40c6440 con 0x7f1bc40d18f0 2024-04-26T23:28:03.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.663+0000 7f1bbbe00640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 0x7f1ba406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:03.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.663+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb4120ff0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.663+0000 7f1bc3400640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 0x7f1ba406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.663+0000 7f1bc3400640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 0x7f1ba406a870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1bc413fee0 tx=0x7f1bb0007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:03.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.667+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1bb4016110 con 0x7f1bc40d18f0 2024-04-26T23:28:03.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.835+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bc4137280 con 0x7f1bc40d18f0 2024-04-26T23:28:03.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.835+0000 7f1bbbe00640 1 -- 172.21.15.39:0/1864637787 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f1bb40f0ef0 con 0x7f1bc40d18f0 2024-04-26T23:28:03.839 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:28:03.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 msgr2=0x7f1ba406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 0x7f1ba406a870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1bc413fee0 tx=0x7f1bb0007df0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 msgr2=0x7f1bc414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ac040 tx=0x7f1bb401aca0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 shutdown_connections 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ba40683b0 0x7f1ba406a870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bc415e340 0x7f1bc4136d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bc4140170 0x7f1bc4152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 --2- 172.21.15.39:0/1864637787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bc40d18f0 0x7f1bc414f870 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 >> 172.21.15.39:0/1864637787 conn(0x7f1bc406c7d0 msgr2=0x7f1bc40d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 shutdown_connections 2024-04-26T23:28:03.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:03.839+0000 7f1bcb000640 1 -- 172.21.15.39:0/1864637787 wait complete. 2024-04-26T23:28:03.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:28:04.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 Processor -- start 2024-04-26T23:28:04.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 -- start start 2024-04-26T23:28:04.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f10580cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1058072180 con 0x7f1058073400 2024-04-26T23:28:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10580739a0 con 0x7f10581458d0 2024-04-26T23:28:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f105d800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1058073c80 con 0x7f10580ce5e0 2024-04-26T23:28:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f104e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1058073400 0x7f1058072910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33196/0 (socket says 172.21.15.39:33196) 2024-04-26T23:28:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f104e000640 1 -- 172.21.15.39:0/2502522983 learned_addr learned my addr 172.21.15.39:0/2502522983 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1057400640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f10580cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413418618 0 0) 0x7f1058072180 con 0x7f1058073400 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f103c005740 con 0x7f1058073400 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005779921 0 0) 0x7f10580739a0 con 0x7f10581458d0 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1058072180 con 0x7f10581458d0 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 914613941 0 0) 0x7f103c005740 con 0x7f1058073400 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 msgr2=0x7f10580cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f10580cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 >> v1:172.21.15.71:6789/0 conn(0x7f10581458d0 legacy=0x7f10580b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1058145cb0 con 0x7f1058073400 2024-04-26T23:28:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f1040001680 con 0x7f1058073400 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 >> v1:172.21.15.39:6789/0 conn(0x7f1058073400 legacy=0x7f1058072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f103c005d90 0x7f103c006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f103c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c006f60 0x7f103c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1058073c80 con 0x7f103c005d90 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f103c00dd10 con 0x7f103c006f60 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f103c00df10 con 0x7f10580ce5e0 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f103c005d90 0x7f103c006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f104e000640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f103c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1057400640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c006f60 0x7f103c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 -- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 msgr2=0x7f103c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10580ce5e0 0x7f103c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 -- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c006f60 msgr2=0x7f103c0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c006f60 0x7f103c0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.003+0000 7f1056a00640 1 -- 172.21.15.39:0/2502522983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c005740 con 0x7f103c005d90 2024-04-26T23:28:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f1056a00640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f103c005d90 0x7f103c006190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f10480018d0 tx=0x7f104801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab596e364b4c7c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048001520 con 0x7f103c005d90 2024-04-26T23:28:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10480050d0 con 0x7f103c005d90 2024-04-26T23:28:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f1056000640 1 -- 172.21.15.39:0/2502522983 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10480054a0 con 0x7f103c005d90 2024-04-26T23:28:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 -- 172.21.15.39:0/2502522983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f103c005d90 msgr2=0x7f103c006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 --2- 172.21.15.39:0/2502522983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f103c005d90 0x7f103c006190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f10480018d0 tx=0x7f104801c580 comp rx=0 tx=0).stop 2024-04-26T23:28:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f1057400640 1 -- 172.21.15.39:0/2502522983 reap_dead start 2024-04-26T23:28:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 -- 172.21.15.39:0/2502522983 shutdown_connections 2024-04-26T23:28:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 -- 172.21.15.39:0/2502522983 >> 172.21.15.39:0/2502522983 conn(0x7f105806c7d0 msgr2=0x7f105806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 -- 172.21.15.39:0/2502522983 shutdown_connections 2024-04-26T23:28:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.007+0000 7f105d800640 1 -- 172.21.15.39:0/2502522983 wait complete. 2024-04-26T23:28:04.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 Processor -- start 2024-04-26T23:28:04.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- start start 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c005d90 0x7f1058144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1058143a60 0x7f10580cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f105806ec70 con 0x7f1058163ce0 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1058073230 con 0x7f103c005d90 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f105806edf0 con 0x7f1058143a60 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1056a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c005d90 0x7f1058144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41506/0 (socket says 172.21.15.39:41506) 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 -- 172.21.15.39:0/757914217 learned_addr learned my addr 172.21.15.39:0/757914217 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f104e000640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1058143a60 0x7f10580cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 -- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1058143a60 msgr2=0x7f10580cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1058143a60 0x7f10580cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 -- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c005d90 msgr2=0x7f1058144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c005d90 0x7f1058144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 -- 172.21.15.39:0/757914217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10580ccbf0 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f1057400640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1058070200 tx=0x7f105000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105000fde0 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1050015430 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050015820 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10580cc360 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.011+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10580cc910 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105806a720 con 0x7f1058163ce0 2024-04-26T23:28:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10500159c0 con 0x7f1058163ce0 2024-04-26T23:28:04.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f104f400640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 0x7f103406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f1050087350 con 0x7f1058163ce0 2024-04-26T23:28:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f1056a00640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 0x7f103406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.015+0000 7f1056a00640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 0x7f103406a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f10480ad000 tx=0x7f10480a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.019+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1050024030 con 0x7f1058163ce0 2024-04-26T23:28:04.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.179+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f10580b50b0 con 0x7f1058163ce0 2024-04-26T23:28:04.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f104f400640 1 -- 172.21.15.39:0/757914217 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f10580ccbf0 con 0x7f1058163ce0 2024-04-26T23:28:04.185 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 msgr2=0x7f103406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 0x7f103406a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f10480ad000 tx=0x7f10480a6040 comp rx=0 tx=0).stop 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 msgr2=0x7f1058164160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1058070200 tx=0x7f105000f580 comp rx=0 tx=0).stop 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 shutdown_connections 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10340683b0 0x7f103406a870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1058163ce0 0x7f1058164160 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1058143a60 0x7f10580cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 --2- 172.21.15.39:0/757914217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f103c005d90 0x7f1058144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 >> 172.21.15.39:0/757914217 conn(0x7f105806c7d0 msgr2=0x7f105806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 shutdown_connections 2024-04-26T23:28:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.183+0000 7f105d800640 1 -- 172.21.15.39:0/757914217 wait complete. 2024-04-26T23:28:04.206 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:28:04.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 Processor -- start 2024-04-26T23:28:04.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 -- start start 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6d540cfd60 0x7f6d540d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d540cdbc0 con 0x7f6d540d38c0 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5415b010 con 0x7f6d540cfd60 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6d540cdea0 con 0x7f6d5415ac30 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6d540cfd60 0x7f6d540d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d4b400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6d540d38c0 0x7f6d540cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33206/0 (socket says 172.21.15.39:33206) 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d4b400640 1 -- 172.21.15.39:0/3910190658 learned_addr learned my addr 172.21.15.39:0/3910190658 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:04.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d53e00640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59000640 1 -- 172.21.15.39:0/3910190658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 msgr2=0x7f6d5415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59000640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5415e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59000640 1 -- 172.21.15.39:0/3910190658 >> v1:172.21.15.39:6789/0 conn(0x7f6d540d38c0 legacy=0x7f6d540cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.347+0000 7f6d59000640 1 -- 172.21.15.39:0/3910190658 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d540ce180 con 0x7f6d540cfd60 2024-04-26T23:28:04.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59000640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d540d0970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d90 tx=0x7f6d4c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49512fc6bcebb4ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d53400640 1 -- 172.21.15.39:0/3910190658 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0b2070 con 0x7f6d540cfd60 2024-04-26T23:28:04.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d53400640 1 -- 172.21.15.39:0/3910190658 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0a58b0 con 0x7f6d540cfd60 2024-04-26T23:28:04.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d53400640 1 -- 172.21.15.39:0/3910190658 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0a5c80 con 0x7f6d540cfd60 2024-04-26T23:28:04.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 -- 172.21.15.39:0/3910190658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 msgr2=0x7f6d540d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d540d0970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d90 tx=0x7f6d4c01c8e0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 -- 172.21.15.39:0/3910190658 shutdown_connections 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d540d0970 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3910190658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 -- 172.21.15.39:0/3910190658 >> 172.21.15.39:0/3910190658 conn(0x7f6d540d2da0 msgr2=0x7f6d540d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 -- 172.21.15.39:0/3910190658 shutdown_connections 2024-04-26T23:28:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.351+0000 7f6d59a00640 1 -- 172.21.15.39:0/3910190658 wait complete. 2024-04-26T23:28:04.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 Processor -- start 2024-04-26T23:28:04.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 -- start start 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d54149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 0x7f6d540c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d540d1840 con 0x7f6d540cfd60 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d540d16c0 con 0x7f6d540d38c0 2024-04-26T23:28:04.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6d54169d80 con 0x7f6d5415ac30 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d4b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 0x7f6d540c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d4b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 0x7f6d540c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:38350/0 (socket says 172.21.15.39:38350) 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d4b400640 1 -- 172.21.15.39:0/3587243519 learned_addr learned my addr 172.21.15.39:0/3587243519 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 -- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 msgr2=0x7f6d540c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 0x7f6d540c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 -- 172.21.15.39:0/3587243519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 msgr2=0x7f6d54149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d54149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.355+0000 7f6d59000640 1 -- 172.21.15.39:0/3587243519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d540c8410 con 0x7f6d5415ac30 2024-04-26T23:28:04.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.359+0000 7f6d59000640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5406e530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0ac000 tx=0x7f6d4c019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.363+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0b2050 con 0x7f6d5415ac30 2024-04-26T23:28:04.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.363+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0b3040 con 0x7f6d5415ac30 2024-04-26T23:28:04.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.363+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0ad650 con 0x7f6d5415ac30 2024-04-26T23:28:04.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.363+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d540c86f0 con 0x7f6d5415ac30 2024-04-26T23:28:04.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.363+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d540c8cb0 con 0x7f6d5415ac30 2024-04-26T23:28:04.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d540506d0 con 0x7f6d5415ac30 2024-04-26T23:28:04.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f6d4c0c0020 con 0x7f6d5415ac30 2024-04-26T23:28:04.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d50c00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 0x7f6d3006a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f6d4c121070 con 0x7f6d5415ac30 2024-04-26T23:28:04.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d53e00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 0x7f6d3006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.367+0000 7f6d53e00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 0x7f6d3006a920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d44006aa0 tx=0x7f6d44006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.371+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6d4c016560 con 0x7f6d5415ac30 2024-04-26T23:28:04.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6d54075ef0 con 0x7f6d5415ac30 2024-04-26T23:28:04.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d50c00640 1 -- 172.21.15.39:0/3587243519 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f6d4c0f1650 con 0x7f6d5415ac30 2024-04-26T23:28:04.541 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:28:04.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 msgr2=0x7f6d3006a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 0x7f6d3006a920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d44006aa0 tx=0x7f6d44006a30 comp rx=0 tx=0).stop 2024-04-26T23:28:04.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 msgr2=0x7f6d5406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5406e530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0ac000 tx=0x7f6d4c019680 comp rx=0 tx=0).stop 2024-04-26T23:28:04.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 shutdown_connections 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6d30068460 0x7f6d3006a920 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d5415ac30 0x7f6d5406e530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d540d38c0 0x7f6d540c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 --2- 172.21.15.39:0/3587243519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d540cfd60 0x7f6d54149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 >> 172.21.15.39:0/3587243519 conn(0x7f6d540d2da0 msgr2=0x7f6d540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 shutdown_connections 2024-04-26T23:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.539+0000 7f6d59a00640 1 -- 172.21.15.39:0/3587243519 wait complete. 2024-04-26T23:28:04.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:28:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.699+0000 7f09cc200640 1 Processor -- start 2024-04-26T23:28:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.699+0000 7f09cc200640 1 -- start start 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09cc200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09c4073400 0x7f09c4072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09cc200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09c40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09cc200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c4072180 con 0x7f09c41458d0 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09cc200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40739a0 con 0x7f09c4073400 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09cc200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09c4073c80 con 0x7f09c4072e50 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c9800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f09c41458d0 0x7f09c40b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33214/0 (socket says 172.21.15.39:33214) 2024-04-26T23:28:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c9800640 1 -- 172.21.15.39:0/1331469170 learned_addr learned my addr 172.21.15.39:0/1331469170 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032115731 0 0) 0x7f09c4072180 con 0x7f09c41458d0 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09ac003530 con 0x7f09c41458d0 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09ca200640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09c40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 --2- 172.21.15.39:0/1331469170 >> v2:172.21.15.71:3300/0 conn(0x7f09c4073400 0x7f09c4072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3379373977 0 0) 0x7f09ac003530 con 0x7f09c41458d0 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 msgr2=0x7f09c40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09c40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 >> v2:172.21.15.71:3300/0 conn(0x7f09c4073400 msgr2=0x7f09c4072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 --2- 172.21.15.39:0/1331469170 >> v2:172.21.15.71:3300/0 conn(0x7f09c4073400 0x7f09c4072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c4145cb0 con 0x7f09c41458d0 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f09b8001680 con 0x7f09c41458d0 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 >> v1:172.21.15.39:6789/0 conn(0x7f09c41458d0 legacy=0x7f09c40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09ac0039c0 0x7f09ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40739a0 con 0x7f09ac004810 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4073c80 con 0x7f09ac0039c0 2024-04-26T23:28:04.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09ac0099f0 con 0x7f09c4072e50 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c9800640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09ac0039c0 0x7f09ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09ca200640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 -- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 msgr2=0x7f09ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c4072e50 0x7f09ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 -- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09ac0039c0 msgr2=0x7f09ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09ac0039c0 0x7f09ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.703+0000 7f09c8e00640 1 -- 172.21.15.39:0/1331469170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac003530 con 0x7f09ac004810 2024-04-26T23:28:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09c8e00640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09ac004c90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009ae0 tx=0x7f09b001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1f31daa18a497d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00096b0 con 0x7f09ac004810 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b00a64c0 con 0x7f09ac004810 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09c3e00640 1 -- 172.21.15.39:0/1331469170 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a68b0 con 0x7f09ac004810 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- 172.21.15.39:0/1331469170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 msgr2=0x7f09ac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 --2- 172.21.15.39:0/1331469170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09ac004c90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009ae0 tx=0x7f09b001ca50 comp rx=0 tx=0).stop 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09ca200640 1 -- 172.21.15.39:0/1331469170 reap_dead start 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- 172.21.15.39:0/1331469170 shutdown_connections 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- 172.21.15.39:0/1331469170 >> 172.21.15.39:0/1331469170 conn(0x7f09c406c7d0 msgr2=0x7f09c406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- 172.21.15.39:0/1331469170 shutdown_connections 2024-04-26T23:28:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- 172.21.15.39:0/1331469170 wait complete. 2024-04-26T23:28:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 Processor -- start 2024-04-26T23:28:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.707+0000 7f09cc200640 1 -- start start 2024-04-26T23:28:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c40aa5d0 0x7f09c40aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c415ed20 0x7f09c415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09c406ee80 con 0x7f09ac004810 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4073260 con 0x7f09c415ed20 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09c406f000 con 0x7f09c40aa5d0 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41542/0 (socket says 172.21.15.39:41542) 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 -- 172.21.15.39:0/4035003516 learned_addr learned my addr 172.21.15.39:0/4035003516 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c8e00640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c40aa5d0 0x7f09c40aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09ca200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c415ed20 0x7f09c415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 -- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c40aa5d0 msgr2=0x7f09c40aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c40aa5d0 0x7f09c40aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 -- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c415ed20 msgr2=0x7f09c415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c415ed20 0x7f09c415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 -- 172.21.15.39:0/4035003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c415fb70 con 0x7f09ac004810 2024-04-26T23:28:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c9800640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f09b8007310 tx=0x7f09b80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b800f9c0 con 0x7f09ac004810 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8018070 con 0x7f09ac004810 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c415fe50 con 0x7f09ac004810 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b800fda0 con 0x7f09ac004810 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c415f6e0 con 0x7f09ac004810 2024-04-26T23:28:04.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.711+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c406a720 con 0x7f09ac004810 2024-04-26T23:28:04.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.715+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f09b801c410 con 0x7f09ac004810 2024-04-26T23:28:04.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.715+0000 7f09c1600640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 0x7f09a406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:04.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.715+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f09b80868e0 con 0x7f09ac004810 2024-04-26T23:28:04.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.715+0000 7f09c8e00640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 0x7f09a406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:04.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.715+0000 7f09c8e00640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 0x7f09a406a900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09b00af000 tx=0x7f09b00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:04.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.719+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f09b8056db0 con 0x7f09ac004810 2024-04-26T23:28:04.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f09c40b50b0 con 0x7f09ac004810 2024-04-26T23:28:04.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09c1600640 1 -- 172.21.15.39:0/4035003516 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f09b80566b0 con 0x7f09ac004810 2024-04-26T23:28:04.897 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 msgr2=0x7f09a406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 0x7f09a406a900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09b00af000 tx=0x7f09b00046d0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 msgr2=0x7f09c40aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f09b8007310 tx=0x7f09b80077d0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 shutdown_connections 2024-04-26T23:28:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f09a4068440 0x7f09a406a900 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c415ed20 0x7f09c415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09c40aa5d0 0x7f09c40aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 --2- 172.21.15.39:0/4035003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09ac004810 0x7f09c40aea90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 >> 172.21.15.39:0/4035003516 conn(0x7f09c406c7d0 msgr2=0x7f09c40afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 shutdown_connections 2024-04-26T23:28:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:04.895+0000 7f09cc200640 1 -- 172.21.15.39:0/4035003516 wait complete. 2024-04-26T23:28:04.919 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:28:04.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:04.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T23:28:04.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:28:04.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:04.946 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:28:04.996 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:28:04.997 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:04.997 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:05.007 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:05.007 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:05.058 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:05.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 Processor -- start 2024-04-26T23:28:05.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 -- start start 2024-04-26T23:28:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7974160060 con 0x7f797406f570 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f79740cd5c0 con 0x7f7974145820 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.195+0000 7f7979400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7974160340 con 0x7f79740b4950 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7972800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:49232/0 (socket says 172.21.15.39:49232) 2024-04-26T23:28:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7972800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:38378/0 (socket says 172.21.15.39:38378) 2024-04-26T23:28:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 -- 172.21.15.39:0/3626623466 learned_addr learned my addr 172.21.15.39:0/3626623466 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7973200640 1 --1- 172.21.15.39:0/3626623466 >> v1:172.21.15.71:6789/0 conn(0x7f797406f570 0x7f79740cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:52136/0 (socket says 172.21.15.39:52136) 2024-04-26T23:28:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 -- 172.21.15.39:0/3626623466 >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 msgr2=0x7f79740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 --2- 172.21.15.39:0/3626623466 >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 -- 172.21.15.39:0/3626623466 >> v1:172.21.15.71:6789/0 conn(0x7f797406f570 legacy=0x7f79740cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 -- 172.21.15.39:0/3626623466 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7974160620 con 0x7f79740b4950 2024-04-26T23:28:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7972800640 1 --2- 172.21.15.39:0/3626623466 >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:05.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7969e00640 1 --2- 172.21.15.39:0/3626623466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f795c00bb10 tx=0x7f795c01ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fd172e6a07f2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.199+0000 7f7971e00640 1 -- 172.21.15.39:0/3626623466 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b4070 con 0x7f79740b4950 2024-04-26T23:28:05.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7971e00640 1 -- 172.21.15.39:0/3626623466 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0a7af0 con 0x7f79740b4950 2024-04-26T23:28:05.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7971e00640 1 -- 172.21.15.39:0/3626623466 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0af440 con 0x7f79740b4950 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- 172.21.15.39:0/3626623466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 msgr2=0x7f79740b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- 172.21.15.39:0/3626623466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f795c00bb10 tx=0x7f795c01ec00 comp rx=0 tx=0).stop 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- 172.21.15.39:0/3626623466 shutdown_connections 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- 172.21.15.39:0/3626623466 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79740b4950 0x7f79740b4d70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- 172.21.15.39:0/3626623466 >> v2:172.21.15.71:3300/0 conn(0x7f7974145820 0x7f79740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- 172.21.15.39:0/3626623466 >> 172.21.15.39:0/3626623466 conn(0x7f79740b2af0 msgr2=0x7f79740b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- 172.21.15.39:0/3626623466 shutdown_connections 2024-04-26T23:28:05.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- 172.21.15.39:0/3626623466 wait complete. 2024-04-26T23:28:05.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 Processor -- start 2024-04-26T23:28:05.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- start start 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79740b4950 0x7f79740735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7974145820 0x7f797415df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f797415fdb0 con 0x7f797406f570 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f797415fc30 con 0x7f79740b4950 2024-04-26T23:28:05.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7979400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f79740ce570 con 0x7f7974145820 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7972800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7972800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41544/0 (socket says 172.21.15.39:41544) 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7972800640 1 -- 172.21.15.39:0/3838183858 learned_addr learned my addr 172.21.15.39:0/3838183858 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7969e00640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79740b4950 0x7f79740735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.203+0000 7f7973200640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7974145820 0x7f797415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 -- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7974145820 msgr2=0x7f797415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7974145820 0x7f797415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 -- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79740b4950 msgr2=0x7f79740735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79740b4950 0x7f79740735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 -- 172.21.15.39:0/3838183858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7974153820 con 0x7f797406f570 2024-04-26T23:28:05.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7972800640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f796400e9b0 tx=0x7f796400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964017070 con 0x7f797406f570 2024-04-26T23:28:05.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796400ca00 con 0x7f797406f570 2024-04-26T23:28:05.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7974153b00 con 0x7f797406f570 2024-04-26T23:28:05.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796400cdd0 con 0x7f797406f570 2024-04-26T23:28:05.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79741540c0 con 0x7f797406f570 2024-04-26T23:28:05.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7974075c00 con 0x7f797406f570 2024-04-26T23:28:05.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f796401a070 con 0x7f797406f570 2024-04-26T23:28:05.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 0x7f795006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.207+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f7964086c80 con 0x7f797406f570 2024-04-26T23:28:05.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.211+0000 7f7969e00640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 0x7f795006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.211+0000 7f7969e00640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 0x7f795006a8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b1000 tx=0x7f795c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.211+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7964056b00 con 0x7f797406f570 2024-04-26T23:28:05.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.379+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f797413bb60 con 0x7f797406f570 2024-04-26T23:28:05.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.379+0000 7f796b400640 1 -- 172.21.15.39:0/3838183858 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f796405ae00 con 0x7f797406f570 2024-04-26T23:28:05.383 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:05.384 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:05.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 msgr2=0x7f795006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 0x7f795006a8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b1000 tx=0x7f795c008040 comp rx=0 tx=0).stop 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 msgr2=0x7f7974139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f796400e9b0 tx=0x7f796400ee70 comp rx=0 tx=0).stop 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 shutdown_connections 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7950068410 0x7f795006a8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7974145820 0x7f797415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79740b4950 0x7f79740735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 --2- 172.21.15.39:0/3838183858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f797406f570 0x7f7974139aa0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 >> 172.21.15.39:0/3838183858 conn(0x7f79740b2af0 msgr2=0x7f7974158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 shutdown_connections 2024-04-26T23:28:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.383+0000 7f7979400640 1 -- 172.21.15.39:0/3838183858 wait complete. 2024-04-26T23:28:05.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:45.529505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:46.096938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:28:05.405 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:28:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 Processor -- start 2024-04-26T23:28:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 -- start start 2024-04-26T23:28:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8400cf8c0 0x7fc8400cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc84006d4e0 0x7fc84006d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8400d01e0 con 0x7fc8400d10d0 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc84006dfa0 con 0x7fc84006d4e0 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc846600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc84006e280 con 0x7fc8400cf8c0 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc84006d4e0 0x7fc84006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc84006d4e0 0x7fc84006d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41550/0 (socket says 172.21.15.39:41550) 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 -- 172.21.15.39:0/161505091 learned_addr learned my addr 172.21.15.39:0/161505091 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83f400640 1 --2- 172.21.15.39:0/161505091 >> v2:172.21.15.71:3300/0 conn(0x7fc8400cf8c0 0x7fc8400cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 -- 172.21.15.39:0/161505091 >> v2:172.21.15.71:3300/0 conn(0x7fc8400cf8c0 msgr2=0x7fc8400cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 --2- 172.21.15.39:0/161505091 >> v2:172.21.15.71:3300/0 conn(0x7fc8400cf8c0 0x7fc8400cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 -- 172.21.15.39:0/161505091 >> v1:172.21.15.71:6789/0 conn(0x7fc8400d10d0 legacy=0x7fc8400b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.547+0000 7fc83ea00640 1 -- 172.21.15.39:0/161505091 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84006e560 con 0x7fc84006d4e0 2024-04-26T23:28:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc83ea00640 1 --2- 172.21.15.39:0/161505091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84006d4e0 0x7fc84006d970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc8400d3ca0 tx=0x7fc82c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fb121bd6d9a058 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc83e000640 1 -- 172.21.15.39:0/161505091 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0aa650 con 0x7fc84006d4e0 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc83e000640 1 -- 172.21.15.39:0/161505091 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0af070 con 0x7fc84006d4e0 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc83e000640 1 -- 172.21.15.39:0/161505091 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0aaa10 con 0x7fc84006d4e0 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 -- 172.21.15.39:0/161505091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84006d4e0 msgr2=0x7fc84006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 --2- 172.21.15.39:0/161505091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84006d4e0 0x7fc84006d970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc8400d3ca0 tx=0x7fc82c01c4f0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 -- 172.21.15.39:0/161505091 shutdown_connections 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 --2- 172.21.15.39:0/161505091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84006d4e0 0x7fc84006d970 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 --2- 172.21.15.39:0/161505091 >> v2:172.21.15.71:3300/0 conn(0x7fc8400cf8c0 0x7fc8400cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 -- 172.21.15.39:0/161505091 >> 172.21.15.39:0/161505091 conn(0x7fc8400d3040 msgr2=0x7fc8400d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 -- 172.21.15.39:0/161505091 shutdown_connections 2024-04-26T23:28:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.551+0000 7fc846600640 1 -- 172.21.15.39:0/161505091 wait complete. 2024-04-26T23:28:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 Processor -- start 2024-04-26T23:28:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- start start 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84006d4e0 0x7fc84014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8400cf8c0 0x7fc8401533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc84015f570 con 0x7fc8400d10d0 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400b4730 con 0x7fc8400cf8c0 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc84015f6f0 con 0x7fc84006d4e0 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8400cf8c0 0x7fc8401533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41554/0 (socket says 172.21.15.39:41554) 2024-04-26T23:28:05.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 -- 172.21.15.39:0/1739424216 learned_addr learned my addr 172.21.15.39:0/1739424216 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83f400640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84006d4e0 0x7fc84014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 -- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84006d4e0 msgr2=0x7fc84014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84006d4e0 0x7fc84014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 -- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8400cf8c0 msgr2=0x7fc8401533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8400cf8c0 0x7fc8401533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 -- 172.21.15.39:0/1739424216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc840157f90 con 0x7fc8400d10d0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc83fe00640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c6c0 tx=0x7fc83800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838003b80 con 0x7fc8400d10d0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc838003d20 con 0x7fc8400d10d0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc840158270 con 0x7fc8400d10d0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8380052f0 con 0x7fc8400d10d0 2024-04-26T23:28:05.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8401597f0 con 0x7fc8400d10d0 2024-04-26T23:28:05.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.555+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84006a720 con 0x7fc8400d10d0 2024-04-26T23:28:05.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.559+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc838005490 con 0x7fc8400d10d0 2024-04-26T23:28:05.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.559+0000 7fc837400640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 0x7fc82006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.559+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fc838086750 con 0x7fc8400d10d0 2024-04-26T23:28:05.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.559+0000 7fc83f400640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 0x7fc82006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.559+0000 7fc83f400640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 0x7fc82006a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8300079c0 tx=0x7fc830008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.563+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc838056660 con 0x7fc8400d10d0 2024-04-26T23:28:05.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.727+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8400760f0 con 0x7fc8400d10d0 2024-04-26T23:28:05.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.727+0000 7fc837400640 1 -- 172.21.15.39:0/1739424216 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fc83805a960 con 0x7fc8400d10d0 2024-04-26T23:28:05.732 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:28:05.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 msgr2=0x7fc82006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 0x7fc82006a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8300079c0 tx=0x7fc830008040 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 msgr2=0x7fc8401538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c6c0 tx=0x7fc83800cb80 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 shutdown_connections 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc820068410 0x7fc82006a8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8400d10d0 0x7fc8401538f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8400cf8c0 0x7fc8401533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 --2- 172.21.15.39:0/1739424216 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84006d4e0 0x7fc84014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 >> 172.21.15.39:0/1739424216 conn(0x7fc8400d3040 msgr2=0x7fc840071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 shutdown_connections 2024-04-26T23:28:05.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.731+0000 7fc846600640 1 -- 172.21.15.39:0/1739424216 wait complete. 2024-04-26T23:28:05.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:28:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 Processor -- start 2024-04-26T23:28:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 -- start start 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0654140170 0x7f065415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06540d18f0 0x7f06540cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065406e500 con 0x7f065415e340 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f065406f110 con 0x7f0654140170 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f065b000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f065406e7e0 con 0x7f06540d18f0 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0654140170 0x7f065415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0654140170 0x7f065415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41560/0 (socket says 172.21.15.39:41560) 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 -- 172.21.15.39:0/747591242 learned_addr learned my addr 172.21.15.39:0/747591242 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0659000640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06540d18f0 0x7f06540cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 -- 172.21.15.39:0/747591242 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06540d18f0 msgr2=0x7f06540cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06540d18f0 0x7f06540cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 -- 172.21.15.39:0/747591242 >> v1:172.21.15.71:6789/0 conn(0x7f065415e340 legacy=0x7f06540d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.895+0000 7f0653e00640 1 -- 172.21.15.39:0/747591242 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065406eac0 con 0x7f0654140170 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f0653e00640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0654140170 0x7f065415de00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0644009870 tx=0x7f064401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b92c0aab104a75f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f0653400640 1 -- 172.21.15.39:0/747591242 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440aa620 con 0x7f0654140170 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f0653400640 1 -- 172.21.15.39:0/747591242 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06440af070 con 0x7f0654140170 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f0653400640 1 -- 172.21.15.39:0/747591242 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440aa9e0 con 0x7f0654140170 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 -- 172.21.15.39:0/747591242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0654140170 msgr2=0x7f065415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0654140170 0x7f065415de00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0644009870 tx=0x7f064401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 -- 172.21.15.39:0/747591242 shutdown_connections 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06540d18f0 0x7f06540cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 --2- 172.21.15.39:0/747591242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0654140170 0x7f065415de00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 -- 172.21.15.39:0/747591242 >> 172.21.15.39:0/747591242 conn(0x7f065406c7d0 msgr2=0x7f065406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 -- 172.21.15.39:0/747591242 shutdown_connections 2024-04-26T23:28:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.899+0000 7f065b000640 1 -- 172.21.15.39:0/747591242 wait complete. 2024-04-26T23:28:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 Processor -- start 2024-04-26T23:28:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- start start 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06540d18f0 0x7f065413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 0x7f0654140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06540d07d0 con 0x7f065415e340 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06540d0650 con 0x7f06540d18f0 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f06540d0950 con 0x7f0654140170 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41576/0 (socket says 172.21.15.39:41576) 2024-04-26T23:28:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 -- 172.21.15.39:0/1509939885 learned_addr learned my addr 172.21.15.39:0/1509939885 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0653e00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06540d18f0 0x7f065413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f064be00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 0x7f0654140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 -- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 msgr2=0x7f0654140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 0x7f0654140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 -- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06540d18f0 msgr2=0x7f065413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06540d18f0 0x7f065413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 -- 172.21.15.39:0/1509939885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0654140ab0 con 0x7f065415e340 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f064be00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 0x7f0654140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0659000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f064c007e40 tx=0x7f064c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c014620 con 0x7f065415e340 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c019070 con 0x7f065415e340 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c014a20 con 0x7f065415e340 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0654141010 con 0x7f065415e340 2024-04-26T23:28:05.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06541415d0 con 0x7f065415e340 2024-04-26T23:28:05.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.903+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065406a720 con 0x7f065415e340 2024-04-26T23:28:05.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.907+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f064c014bc0 con 0x7f065415e340 2024-04-26T23:28:05.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.907+0000 7f0650c00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 0x7f063006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:05.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.907+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f064c087340 con 0x7f065415e340 2024-04-26T23:28:05.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.907+0000 7f0653e00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 0x7f063006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:05.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.907+0000 7f0653e00640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 0x7f063006a8d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06440ae000 tx=0x7f06440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:05.911+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0654140ab0 con 0x7f065415e340 2024-04-26T23:28:06.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.075+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f065406fdc0 con 0x7f065415e340 2024-04-26T23:28:06.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.075+0000 7f0650c00640 1 -- 172.21.15.39:0/1509939885 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f064c057810 con 0x7f065415e340 2024-04-26T23:28:06.079 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 msgr2=0x7f063006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 0x7f063006a8d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06440ae000 tx=0x7f06440a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 msgr2=0x7f065413e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f064c007e40 tx=0x7f064c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 shutdown_connections 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0630068410 0x7f063006a8d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065415e340 0x7f065413e2e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0654140170 0x7f0654140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 --2- 172.21.15.39:0/1509939885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06540d18f0 0x7f065413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 >> 172.21.15.39:0/1509939885 conn(0x7f065406c7d0 msgr2=0x7f0654073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:06.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 shutdown_connections 2024-04-26T23:28:06.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.079+0000 7f065b000640 1 -- 172.21.15.39:0/1509939885 wait complete. 2024-04-26T23:28:06.101 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:28:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.239+0000 7f7e88c00640 1 Processor -- start 2024-04-26T23:28:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 -- start start 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e840b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7e84073400 0x7f7e84072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e84072180 con 0x7f7e84072e50 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7e840739a0 con 0x7f7e84073400 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e88c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7e84073c80 con 0x7f7e841458d0 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e82800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7e84072e50 0x7f7e840ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33222/0 (socket says 172.21.15.39:33222) 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e82800640 1 -- 172.21.15.39:0/3836464885 learned_addr learned my addr 172.21.15.39:0/3836464885 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:06.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 --2- 172.21.15.39:0/3836464885 >> v2:172.21.15.71:3300/0 conn(0x7f7e84073400 0x7f7e84072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81e00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e840b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046426272 0 0) 0x7f7e84072180 con 0x7f7e84072e50 2024-04-26T23:28:06.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e68003530 con 0x7f7e84072e50 2024-04-26T23:28:06.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1558972918 0 0) 0x7f7e68003530 con 0x7f7e84072e50 2024-04-26T23:28:06.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 msgr2=0x7f7e840b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e840b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 >> v2:172.21.15.71:3300/0 conn(0x7f7e84073400 msgr2=0x7f7e84072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 --2- 172.21.15.39:0/3836464885 >> v2:172.21.15.71:3300/0 conn(0x7f7e84073400 0x7f7e84072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e84145cb0 con 0x7f7e84072e50 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f7e7c001a00 con 0x7f7e84072e50 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 >> v1:172.21.15.39:6789/0 conn(0x7f7e84072e50 legacy=0x7f7e840ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e680039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e68004d50 0x7f7e680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e840739a0 con 0x7f7e68003f40 2024-04-26T23:28:06.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84073c80 con 0x7f7e68004d50 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6800ba20 con 0x7f7e841458d0 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e82800640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e68004d50 0x7f7e680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81e00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e680039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 -- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 msgr2=0x7f7e680039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841458d0 0x7f7e680039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 -- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e68004d50 msgr2=0x7f7e680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e68004d50 0x7f7e680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.243+0000 7f7e81400640 1 -- 172.21.15.39:0/3836464885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e68003530 con 0x7f7e68003f40 2024-04-26T23:28:06.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e81400640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e68004810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009670 tx=0x7f7e7001ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cc3f68397d8c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b4070 con 0x7f7e68003f40 2024-04-26T23:28:06.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e700a77b0 con 0x7f7e68003f40 2024-04-26T23:28:06.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e80a00640 1 -- 172.21.15.39:0/3836464885 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700096b0 con 0x7f7e68003f40 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 -- 172.21.15.39:0/3836464885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 msgr2=0x7f7e68004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 --2- 172.21.15.39:0/3836464885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e68004810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009670 tx=0x7f7e7001ecc0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e82800640 1 -- 172.21.15.39:0/3836464885 reap_dead start 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 -- 172.21.15.39:0/3836464885 shutdown_connections 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 -- 172.21.15.39:0/3836464885 >> 172.21.15.39:0/3836464885 conn(0x7f7e8406c7d0 msgr2=0x7f7e8406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 -- 172.21.15.39:0/3836464885 shutdown_connections 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.247+0000 7f7e88c00640 1 -- 172.21.15.39:0/3836464885 wait complete. 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 Processor -- start 2024-04-26T23:28:06.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- start start 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84142cd0 0x7f7e840c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841eaf10 0x7f7e841eb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406e670 con 0x7f7e68003f40 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84073260 con 0x7f7e84142cd0 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8406e7f0 con 0x7f7e841eaf10 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41596/0 (socket says 172.21.15.39:41596) 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 -- 172.21.15.39:0/4183529201 learned_addr learned my addr 172.21.15.39:0/4183529201 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e82800640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841eaf10 0x7f7e841eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81400640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84142cd0 0x7f7e840c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 -- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841eaf10 msgr2=0x7f7e841eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841eaf10 0x7f7e841eb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 -- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84142cd0 msgr2=0x7f7e840c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84142cd0 0x7f7e840c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 -- 172.21.15.39:0/4183529201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e841ebc20 con 0x7f7e68003f40 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e81e00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7e74011610 tx=0x7f7e74011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74015870 con 0x7f7e68003f40 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e74015a10 con 0x7f7e68003f40 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841ebf00 con 0x7f7e68003f40 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74015dc0 con 0x7f7e68003f40 2024-04-26T23:28:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841ec4c0 con 0x7f7e68003f40 2024-04-26T23:28:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.251+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8406a720 con 0x7f7e68003f40 2024-04-26T23:28:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.255+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7e74013400 con 0x7f7e68003f40 2024-04-26T23:28:06.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.255+0000 7f7e7a000640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 0x7f7e6406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.255+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f7e74087070 con 0x7f7e68003f40 2024-04-26T23:28:06.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.255+0000 7f7e81400640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 0x7f7e6406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.255+0000 7f7e81400640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 0x7f7e6406a8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7e700b1000 tx=0x7f7e70010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.259+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e74019030 con 0x7f7e68003f40 2024-04-26T23:28:06.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.423+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7e8415f420 con 0x7f7e68003f40 2024-04-26T23:28:06.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.423+0000 7f7e7a000640 1 -- 172.21.15.39:0/4183529201 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f7e740576d0 con 0x7f7e68003f40 2024-04-26T23:28:06.427 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:28:06.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 msgr2=0x7f7e6406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 0x7f7e6406a8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7e700b1000 tx=0x7f7e70010040 comp rx=0 tx=0).stop 2024-04-26T23:28:06.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 msgr2=0x7f7e840c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7e74011610 tx=0x7f7e74011a10 comp rx=0 tx=0).stop 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 shutdown_connections 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7e64068410 0x7f7e6406a8d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e841eaf10 0x7f7e841eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84142cd0 0x7f7e840c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 --2- 172.21.15.39:0/4183529201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e68003f40 0x7f7e840c5d60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 >> 172.21.15.39:0/4183529201 conn(0x7f7e8406c7d0 msgr2=0x7f7e840754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 shutdown_connections 2024-04-26T23:28:06.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.427+0000 7f7e88c00640 1 -- 172.21.15.39:0/4183529201 wait complete. 2024-04-26T23:28:06.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:28:06.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.587+0000 7fda6a400640 1 Processor -- start 2024-04-26T23:28:06.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 -- start start 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fda640d0740 0x7fda64074030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 0x7fda6415f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda64145af0 con 0x7fda64145710 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fda640cf440 con 0x7fda640d0740 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda6a400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fda640cf6a0 con 0x7fda640b4420 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fda640d0740 0x7fda64074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fda640d0740 0x7fda64074030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41602/0 (socket says 172.21.15.39:41602) 2024-04-26T23:28:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 -- 172.21.15.39:0/178375115 learned_addr learned my addr 172.21.15.39:0/178375115 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda69a00640 1 --2- 172.21.15.39:0/178375115 >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 0x7fda6415f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 -- 172.21.15.39:0/178375115 >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 msgr2=0x7fda6415f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 --2- 172.21.15.39:0/178375115 >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 0x7fda6415f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 -- 172.21.15.39:0/178375115 >> v1:172.21.15.71:6789/0 conn(0x7fda64145710 legacy=0x7fda640b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda5be00640 1 -- 172.21.15.39:0/178375115 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda640cf980 con 0x7fda640d0740 2024-04-26T23:28:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.591+0000 7fda69a00640 1 --2- 172.21.15.39:0/178375115 >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 0x7fda6415f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda5be00640 1 --2- 172.21.15.39:0/178375115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda640d0740 0x7fda64074030 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fda64073c70 tx=0x7fda4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c6a08fb1968c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda63e00640 1 -- 172.21.15.39:0/178375115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0b1070 con 0x7fda640d0740 2024-04-26T23:28:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda63e00640 1 -- 172.21.15.39:0/178375115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c0ac630 con 0x7fda640d0740 2024-04-26T23:28:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda63e00640 1 -- 172.21.15.39:0/178375115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0a8050 con 0x7fda640d0740 2024-04-26T23:28:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- 172.21.15.39:0/178375115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda640d0740 msgr2=0x7fda64074030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 --2- 172.21.15.39:0/178375115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda640d0740 0x7fda64074030 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fda64073c70 tx=0x7fda4c01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- 172.21.15.39:0/178375115 shutdown_connections 2024-04-26T23:28:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 --2- 172.21.15.39:0/178375115 >> v2:172.21.15.71:3300/0 conn(0x7fda640b4420 0x7fda6415f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 --2- 172.21.15.39:0/178375115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda640d0740 0x7fda64074030 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- 172.21.15.39:0/178375115 >> 172.21.15.39:0/178375115 conn(0x7fda6406c3d0 msgr2=0x7fda6406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:06.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- 172.21.15.39:0/178375115 shutdown_connections 2024-04-26T23:28:06.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- 172.21.15.39:0/178375115 wait complete. 2024-04-26T23:28:06.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 Processor -- start 2024-04-26T23:28:06.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.595+0000 7fda6a400640 1 -- start start 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda640b4420 0x7fda6415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda640d0740 0x7fda64165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda64168e80 con 0x7fda64145710 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda64168d00 con 0x7fda640d0740 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fda64169000 con 0x7fda640b4420 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41604/0 (socket says 172.21.15.39:41604) 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 -- 172.21.15.39:0/1574751042 learned_addr learned my addr 172.21.15.39:0/1574751042 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69000640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda640b4420 0x7fda6415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda5be00640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda640d0740 0x7fda64165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 -- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda640b4420 msgr2=0x7fda6415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda640b4420 0x7fda6415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 -- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda640d0740 msgr2=0x7fda64165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda640d0740 0x7fda64165750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 -- 172.21.15.39:0/1574751042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6415e8b0 con 0x7fda64145710 2024-04-26T23:28:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda69a00640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00cd50 tx=0x7fda5c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00f680 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c00f840 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00fc30 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6413d200 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6413d7c0 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.599+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda640506d0 con 0x7fda64145710 2024-04-26T23:28:06.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.603+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fda5c00e3e0 con 0x7fda64145710 2024-04-26T23:28:06.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.603+0000 7fda61600640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 0x7fda4006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:06.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.603+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fda5c087810 con 0x7fda64145710 2024-04-26T23:28:06.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.603+0000 7fda69000640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 0x7fda4006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:06.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.603+0000 7fda69000640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 0x7fda4006a8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda6413df90 tx=0x7fda54007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.607+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fda5c014030 con 0x7fda64145710 2024-04-26T23:28:06.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda640b2460 con 0x7fda64145710 2024-04-26T23:28:06.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda61600640 1 -- 172.21.15.39:0/1574751042 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7fda5c057580 con 0x7fda64145710 2024-04-26T23:28:06.786 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:28:06.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 msgr2=0x7fda4006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 0x7fda4006a8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda6413df90 tx=0x7fda54007e40 comp rx=0 tx=0).stop 2024-04-26T23:28:06.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 msgr2=0x7fda64165c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00cd50 tx=0x7fda5c00a650 comp rx=0 tx=0).stop 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.783+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 shutdown_connections 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fda40068410 0x7fda4006a8d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda64145710 0x7fda64165c90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda640d0740 0x7fda64165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 --2- 172.21.15.39:0/1574751042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda640b4420 0x7fda6415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 >> 172.21.15.39:0/1574751042 conn(0x7fda6406c3d0 msgr2=0x7fda640753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 shutdown_connections 2024-04-26T23:28:06.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:06.787+0000 7fda6a400640 1 -- 172.21.15.39:0/1574751042 wait complete. 2024-04-26T23:28:06.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T23:28:06.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:06.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:06.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:28:06.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:06.840 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:28:06.897 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:28:06.897 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:06.897 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:06.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:28:06.906 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:28:06.907 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:06.907 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:06.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:28:06.952 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:07.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 Processor -- start 2024-04-26T23:28:07.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 -- start start 2024-04-26T23:28:07.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa65415cf60 0x7fa6540d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa654160b60 0x7fa654160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa654161980 con 0x7fa654161530 2024-04-26T23:28:07.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa6540b6220 con 0x7fa65415cf60 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa653e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa6540d1a20 con 0x7fa654160b60 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa65415cf60 0x7fa6540d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa65415cf60 0x7fa6540d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41618/0 (socket says 172.21.15.39:41618) 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 -- 172.21.15.39:0/2036657318 learned_addr learned my addr 172.21.15.39:0/2036657318 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652000640 1 --2- 172.21.15.39:0/2036657318 >> v2:172.21.15.71:3300/0 conn(0x7fa654160b60 0x7fa654160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 -- 172.21.15.39:0/2036657318 >> v2:172.21.15.71:3300/0 conn(0x7fa654160b60 msgr2=0x7fa654160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 --2- 172.21.15.39:0/2036657318 >> v2:172.21.15.71:3300/0 conn(0x7fa654160b60 0x7fa654160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 -- 172.21.15.39:0/2036657318 >> v1:172.21.15.71:6789/0 conn(0x7fa654161530 legacy=0x7fa6540cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.091+0000 7fa652a00640 1 -- 172.21.15.39:0/2036657318 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6540d1d00 con 0x7fa65415cf60 2024-04-26T23:28:07.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa652a00640 1 --2- 172.21.15.39:0/2036657318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65415cf60 0x7fa6540d12d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa6540b6190 tx=0x7fa64401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ffc1b6a4116fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa651600640 1 -- 172.21.15.39:0/2036657318 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b0070 con 0x7fa65415cf60 2024-04-26T23:28:07.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa651600640 1 -- 172.21.15.39:0/2036657318 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6440ab600 con 0x7fa65415cf60 2024-04-26T23:28:07.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa651600640 1 -- 172.21.15.39:0/2036657318 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6440ab9d0 con 0x7fa65415cf60 2024-04-26T23:28:07.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- 172.21.15.39:0/2036657318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65415cf60 msgr2=0x7fa6540d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 --2- 172.21.15.39:0/2036657318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65415cf60 0x7fa6540d12d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa6540b6190 tx=0x7fa64401c490 comp rx=0 tx=0).stop 2024-04-26T23:28:07.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- 172.21.15.39:0/2036657318 shutdown_connections 2024-04-26T23:28:07.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 --2- 172.21.15.39:0/2036657318 >> v2:172.21.15.71:3300/0 conn(0x7fa654160b60 0x7fa654160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 --2- 172.21.15.39:0/2036657318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65415cf60 0x7fa6540d12d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- 172.21.15.39:0/2036657318 >> 172.21.15.39:0/2036657318 conn(0x7fa6540d2d80 msgr2=0x7fa6540d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:07.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- 172.21.15.39:0/2036657318 shutdown_connections 2024-04-26T23:28:07.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- 172.21.15.39:0/2036657318 wait complete. 2024-04-26T23:28:07.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 Processor -- start 2024-04-26T23:28:07.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.095+0000 7fa653e00640 1 -- start start 2024-04-26T23:28:07.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa65415cf60 0x7fa6541533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa654160b60 0x7fa6540cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa65416a020 con 0x7fa654161530 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa654169ea0 con 0x7fa65415cf60 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa65416a1a0 con 0x7fa654160b60 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41626/0 (socket says 172.21.15.39:41626) 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 -- 172.21.15.39:0/3653828063 learned_addr learned my addr 172.21.15.39:0/3653828063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa652a00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa65415cf60 0x7fa6541533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa652000640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa654160b60 0x7fa6540cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 -- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa654160b60 msgr2=0x7fa6540cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa654160b60 0x7fa6540cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 -- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa65415cf60 msgr2=0x7fa6541533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa65415cf60 0x7fa6541533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 -- 172.21.15.39:0/3653828063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6540cc3f0 con 0x7fa654161530 2024-04-26T23:28:07.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653400640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c730 tx=0x7fa64c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c003b80 con 0x7fa654161530 2024-04-26T23:28:07.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c003d20 con 0x7fa654161530 2024-04-26T23:28:07.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00aa30 con 0x7fa654161530 2024-04-26T23:28:07.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6540c8110 con 0x7fa654161530 2024-04-26T23:28:07.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6540c86d0 con 0x7fa654161530 2024-04-26T23:28:07.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.099+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6540c7f40 con 0x7fa654161530 2024-04-26T23:28:07.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.103+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa64c00abd0 con 0x7fa654161530 2024-04-26T23:28:07.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.103+0000 7fa64aa00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 0x7fa63406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.103+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fa64c086720 con 0x7fa654161530 2024-04-26T23:28:07.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.103+0000 7fa652a00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 0x7fa63406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.103+0000 7fa652a00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 0x7fa63406a8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa6440ad000 tx=0x7fa6440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.107+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa64c0566a0 con 0x7fa654161530 2024-04-26T23:28:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6540506d0 con 0x7fa654161530 2024-04-26T23:28:07.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa64aa00640 1 -- 172.21.15.39:0/3653828063 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5178 (secure 0 0 0) 0x7fa64c05a9a0 con 0x7fa654161530 2024-04-26T23:28:07.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:07.311 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:28:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-04-26T23:28:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 msgr2=0x7fa63406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 0x7fa63406a8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa6440ad000 tx=0x7fa6440a6000 comp rx=0 tx=0).stop 2024-04-26T23:28:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 msgr2=0x7fa6540b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c730 tx=0x7fa64c00cbf0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 shutdown_connections 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa634068410 0x7fa63406a8d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa654161530 0x7fa6540b3de0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa654160b60 0x7fa6540cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 --2- 172.21.15.39:0/3653828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa65415cf60 0x7fa6541533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 >> 172.21.15.39:0/3653828063 conn(0x7fa6540d2d80 msgr2=0x7fa6540cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:07.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 shutdown_connections 2024-04-26T23:28:07.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.307+0000 7fa653e00640 1 -- 172.21.15.39:0/3653828063 wait complete. 2024-04-26T23:28:07.333 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:07.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 Processor -- start 2024-04-26T23:28:07.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 -- start start 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f79380b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79380d1640 0x7f793809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793809c7a0 con 0x7f793815d550 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f79380c6be0 con 0x7f79380d1640 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f793ce00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f79380d1b70 con 0x7f793815d170 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7936800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f793815d550 0x7f79380cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33228/0 (socket says 172.21.15.39:33228) 2024-04-26T23:28:07.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7936800640 1 -- 172.21.15.39:0/2661673663 learned_addr learned my addr 172.21.15.39:0/2661673663 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688994181 0 0) 0x7f793809c7a0 con 0x7f793815d550 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f792fe00640 1 --2- 172.21.15.39:0/2661673663 >> v2:172.21.15.71:3300/0 conn(0x7f79380d1640 0x7f793809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f791c003530 con 0x7f793815d550 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935e00640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f79380b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 377777863 0 0) 0x7f791c003530 con 0x7f793815d550 2024-04-26T23:28:07.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 msgr2=0x7f79380b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f79380b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 >> v2:172.21.15.71:3300/0 conn(0x7f79380d1640 msgr2=0x7f793809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 --2- 172.21.15.39:0/2661673663 >> v2:172.21.15.71:3300/0 conn(0x7f79380d1640 0x7f793809b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380d1e50 con 0x7f793815d550 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f7930001a00 con 0x7f793815d550 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 >> v1:172.21.15.39:6789/0 conn(0x7f793815d550 legacy=0x7f79380cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f791c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f791c003f40 0x7f791c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f791c004d50 0x7f791c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79380c6be0 con 0x7f791c004d50 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79380d1b70 con 0x7f791c003f40 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.471+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f791c00b9d0 con 0x7f793815d170 2024-04-26T23:28:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f791c004d50 0x7f791c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f792fe00640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f791c003f40 0x7f791c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7935e00640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f791c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 -- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 msgr2=0x7f791c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815d170 0x7f791c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 -- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f791c003f40 msgr2=0x7f791c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f791c003f40 0x7f791c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 -- 172.21.15.39:0/2661673663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c003530 con 0x7f791c004d50 2024-04-26T23:28:07.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f792fe00640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f791c003f40 0x7f791c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:07.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7936800640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f791c004d50 0x7f791c0051d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f793000a8a0 tx=0x7f793001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7a19e40c8de4fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793000a4c0 con 0x7f791c004d50 2024-04-26T23:28:07.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79300a9020 con 0x7f791c004d50 2024-04-26T23:28:07.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.475+0000 7f7935400640 1 -- 172.21.15.39:0/2661673663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79300072d0 con 0x7f791c004d50 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- 172.21.15.39:0/2661673663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f791c004d50 msgr2=0x7f791c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 --2- 172.21.15.39:0/2661673663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f791c004d50 0x7f791c0051d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f793000a8a0 tx=0x7f793001d360 comp rx=0 tx=0).stop 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f7936800640 1 -- 172.21.15.39:0/2661673663 reap_dead start 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- 172.21.15.39:0/2661673663 shutdown_connections 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- 172.21.15.39:0/2661673663 >> 172.21.15.39:0/2661673663 conn(0x7f79380b4b80 msgr2=0x7f79380b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- 172.21.15.39:0/2661673663 shutdown_connections 2024-04-26T23:28:07.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- 172.21.15.39:0/2661673663 wait complete. 2024-04-26T23:28:07.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 Processor -- start 2024-04-26T23:28:07.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- start start 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 0x7f793815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815e610 0x7f793815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79380c8640 con 0x7f7938158bb0 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79380c7110 con 0x7f793815a1d0 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f793ce00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f79380c87c0 con 0x7f793815e610 2024-04-26T23:28:07.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41646/0 (socket says 172.21.15.39:41646) 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 -- 172.21.15.39:0/376920659 learned_addr learned my addr 172.21.15.39:0/376920659 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f7935e00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 0x7f793815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f7936800640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815e610 0x7f793815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 -- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815e610 msgr2=0x7f793815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815e610 0x7f793815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 -- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 msgr2=0x7f793815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 0x7f793815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f792fe00640 1 -- 172.21.15.39:0/376920659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793815aaf0 con 0x7f7938158bb0 2024-04-26T23:28:07.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.479+0000 7f7935e00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 0x7f793815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:07.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792fe00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7920011cd0 tx=0x7f792000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792000fcc0 con 0x7f7938158bb0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792000fe60 con 0x7f7938158bb0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920004250 con 0x7f7938158bb0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79380cb930 con 0x7f7938158bb0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793815de10 con 0x7f7938158bb0 2024-04-26T23:28:07.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7938050740 con 0x7f7938158bb0 2024-04-26T23:28:07.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7920012040 con 0x7f7938158bb0 2024-04-26T23:28:07.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 0x7f791406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.483+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f7920086f70 con 0x7f7938158bb0 2024-04-26T23:28:07.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.487+0000 7f7935e00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 0x7f791406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.487+0000 7f7935e00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 0x7f791406a900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7928009be0 tx=0x7f7928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.487+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7920019070 con 0x7f7938158bb0 2024-04-26T23:28:07.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79380d0a50 con 0x7f7938158bb0 2024-04-26T23:28:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f792e000640 1 -- 172.21.15.39:0/376920659 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f79200574d0 con 0x7f7938158bb0 2024-04-26T23:28:07.658 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:07.658 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 msgr2=0x7f791406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 0x7f791406a900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7928009be0 tx=0x7f7928008040 comp rx=0 tx=0).stop 2024-04-26T23:28:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 msgr2=0x7f79380cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7920011cd0 tx=0x7f792000f610 comp rx=0 tx=0).stop 2024-04-26T23:28:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 shutdown_connections 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7914068440 0x7f791406a900 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f793815e610 0x7f793815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7938158bb0 0x7f79380cafc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 --2- 172.21.15.39:0/376920659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f793815a1d0 0x7f793815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 >> 172.21.15.39:0/376920659 conn(0x7f79380b4b80 msgr2=0x7f79380704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 shutdown_connections 2024-04-26T23:28:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.655+0000 7f793ce00640 1 -- 172.21.15.39:0/376920659 wait complete. 2024-04-26T23:28:07.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:27:45.529505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:27:46.096938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:28:07.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:28:07.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 Processor -- start 2024-04-26T23:28:07.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 -- start start 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6e01458d0 0x7fb6e00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e0072180 con 0x7fb6e0073400 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e00739a0 con 0x7fb6e01458d0 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e6a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0073c80 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6dfe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6e01458d0 0x7fb6e00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:49356/0 (socket says 172.21.15.39:49356) 2024-04-26T23:28:07.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 -- 172.21.15.39:0/1449321513 learned_addr learned my addr 172.21.15.39:0/1449321513 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:07.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 -- 172.21.15.39:0/1449321513 >> v2:172.21.15.71:3300/0 conn(0x7fb6e01458d0 msgr2=0x7fb6e00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:07.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 --2- 172.21.15.39:0/1449321513 >> v2:172.21.15.71:3300/0 conn(0x7fb6e01458d0 0x7fb6e00b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 -- 172.21.15.39:0/1449321513 >> v1:172.21.15.71:6789/0 conn(0x7fb6e0073400 legacy=0x7fb6e0072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.823+0000 7fb6e4a00640 1 -- 172.21.15.39:0/1449321513 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e0145cb0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e4a00640 1 --2- 172.21.15.39:0/1449321513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b265102cc8807830 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6df400640 1 -- 172.21.15.39:0/1449321513 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80a5770 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6df400640 1 -- 172.21.15.39:0/1449321513 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d80a5910 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6df400640 1 -- 172.21.15.39:0/1449321513 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80a5ce0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 -- 172.21.15.39:0/1449321513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 msgr2=0x7fb6e00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/1449321513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d801c9a0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 -- 172.21.15.39:0/1449321513 shutdown_connections 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/1449321513 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e00ce5e0 0x7fb6e00cea70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/1449321513 >> v2:172.21.15.71:3300/0 conn(0x7fb6e01458d0 0x7fb6e00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 -- 172.21.15.39:0/1449321513 >> 172.21.15.39:0/1449321513 conn(0x7fb6e006c7d0 msgr2=0x7fb6e006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 -- 172.21.15.39:0/1449321513 shutdown_connections 2024-04-26T23:28:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.827+0000 7fb6e6a00640 1 -- 172.21.15.39:0/1449321513 wait complete. 2024-04-26T23:28:07.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 Processor -- start 2024-04-26T23:28:07.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- start start 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e0073400 0x7fb6e01660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6e01458d0 0x7fb6e015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e01690c0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0168f40 con 0x7fb6e01458d0 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0169240 con 0x7fb6e0073400 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41648/0 (socket says 172.21.15.39:41648) 2024-04-26T23:28:07.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 -- 172.21.15.39:0/608483908 learned_addr learned my addr 172.21.15.39:0/608483908 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6dfe00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e0073400 0x7fb6e01660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e4a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6e01458d0 0x7fb6e015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 -- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e0073400 msgr2=0x7fb6e01660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e0073400 0x7fb6e01660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 -- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6e01458d0 msgr2=0x7fb6e015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6e01458d0 0x7fb6e015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 -- 172.21.15.39:0/608483908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e015e7d0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6d7e00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c450 tx=0x7fb6c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8016020 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c80052d0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e015eab0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8007260 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.831+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e015f070 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e006a720 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb6c8007400 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6dcc00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 0x7fb6bc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:07.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fb6c80862e0 con 0x7fb6e00ce5e0 2024-04-26T23:28:07.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6dfe00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 0x7fb6bc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:07.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.835+0000 7fb6dfe00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 0x7fb6bc06a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009ac0 tx=0x7fb6d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:07.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:07.839+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6c8020020 con 0x7fb6e00ce5e0 2024-04-26T23:28:08.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb6e00697b0 con 0x7fb6e00ce5e0 2024-04-26T23:28:08.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6dcc00640 1 -- 172.21.15.39:0/608483908 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fb6c8005480 con 0x7fb6e00ce5e0 2024-04-26T23:28:08.010 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:28:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 msgr2=0x7fb6bc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 0x7fb6bc06a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009ac0 tx=0x7fb6d0009190 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 msgr2=0x7fb6e015dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c450 tx=0x7fb6c800c910 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 shutdown_connections 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb6bc068410 0x7fb6bc06a8d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6e01458d0 0x7fb6e015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6e00ce5e0 0x7fb6e015dbf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 --2- 172.21.15.39:0/608483908 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6e0073400 0x7fb6e01660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 >> 172.21.15.39:0/608483908 conn(0x7fb6e006c7d0 msgr2=0x7fb6e00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 shutdown_connections 2024-04-26T23:28:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.007+0000 7fb6e6a00640 1 -- 172.21.15.39:0/608483908 wait complete. 2024-04-26T23:28:08.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:28:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.171+0000 7f2393c00640 1 Processor -- start 2024-04-26T23:28:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.171+0000 7f2393c00640 1 -- start start 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2393c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f238c1488f0 0x7f238c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2393c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238c1492a0 con 0x7f238c0cf770 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2393c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238c070840 con 0x7f238c06d4c0 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2393c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f238c0cfbd0 con 0x7f238c1488f0 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f238c0cf770 0x7f238c06cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33236/0 (socket says 172.21.15.39:33236) 2024-04-26T23:28:08.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238be00640 1 -- 172.21.15.39:0/2533400458 learned_addr learned my addr 172.21.15.39:0/2533400458 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2391200640 1 --2- 172.21.15.39:0/2533400458 >> v2:172.21.15.71:3300/0 conn(0x7f238c1488f0 0x7f238c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468120798 0 0) 0x7f238c1492a0 con 0x7f238c0cf770 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2374003530 con 0x7f238c0cf770 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891404922 0 0) 0x7f238c070840 con 0x7f238c06d4c0 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f238c1492a0 con 0x7f238c06d4c0 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2391200640 1 -- 172.21.15.39:0/2533400458 >> v1:172.21.15.71:6789/0 conn(0x7f238c06d4c0 legacy=0x7f238c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2391200640 1 -- 172.21.15.39:0/2533400458 >> v1:172.21.15.39:6789/0 conn(0x7f238c0cf770 legacy=0x7f238c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1863030211 0 0) 0x7f2374003530 con 0x7f238c0cf770 2024-04-26T23:28:08.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.175+0000 7f2391200640 1 -- 172.21.15.39:0/2533400458 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c06d9c0 con 0x7f238c1488f0 2024-04-26T23:28:08.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2391200640 1 --2- 172.21.15.39:0/2533400458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c1488f0 0x7f238c0cf230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f23800097c0 tx=0x7f238001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2b2037a1f454af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23800b1070 con 0x7f238c1488f0 2024-04-26T23:28:08.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800ac440 con 0x7f238c1488f0 2024-04-26T23:28:08.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f238b400640 1 -- 172.21.15.39:0/2533400458 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378001680 con 0x7f238c1488f0 2024-04-26T23:28:08.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- 172.21.15.39:0/2533400458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c1488f0 msgr2=0x7f238c0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 --2- 172.21.15.39:0/2533400458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c1488f0 0x7f238c0cf230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f23800097c0 tx=0x7f238001c390 comp rx=0 tx=0).stop 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- 172.21.15.39:0/2533400458 shutdown_connections 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 --2- 172.21.15.39:0/2533400458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c1488f0 0x7f238c0cf230 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- 172.21.15.39:0/2533400458 >> 172.21.15.39:0/2533400458 conn(0x7f238c0ce0e0 msgr2=0x7f238c0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- 172.21.15.39:0/2533400458 shutdown_connections 2024-04-26T23:28:08.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- 172.21.15.39:0/2533400458 wait complete. 2024-04-26T23:28:08.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 Processor -- start 2024-04-26T23:28:08.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- start start 2024-04-26T23:28:08.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c06d4c0 0x7f238c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f238c1488f0 0x7f238c0c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f238c148cd0 con 0x7f238c0cf770 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f238c06f070 con 0x7f238c06d4c0 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.179+0000 7f2393c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f238c16d3f0 con 0x7f238c1488f0 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41662/0 (socket says 172.21.15.39:41662) 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 -- 172.21.15.39:0/57761917 learned_addr learned my addr 172.21.15.39:0/57761917 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:08.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2391200640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c06d4c0 0x7f238c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2391c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f238c1488f0 0x7f238c0c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 -- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f238c1488f0 msgr2=0x7f238c0c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f238c1488f0 0x7f238c0c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 -- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c06d4c0 msgr2=0x7f238c15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c06d4c0 0x7f238c15c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 -- 172.21.15.39:0/57761917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c0c5910 con 0x7f238c0cf770 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f238be00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f237800c780 tx=0x7f237800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378017070 con 0x7f238c0cf770 2024-04-26T23:28:08.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2378005b00 con 0x7f238c0cf770 2024-04-26T23:28:08.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c0c5bf0 con 0x7f238c0cf770 2024-04-26T23:28:08.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378007070 con 0x7f238c0cf770 2024-04-26T23:28:08.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c15f050 con 0x7f238c0cf770 2024-04-26T23:28:08.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c06a720 con 0x7f238c0cf770 2024-04-26T23:28:08.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.183+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f237801a070 con 0x7f238c0cf770 2024-04-26T23:28:08.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.187+0000 7f2388c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 0x7f236c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.187+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f2378085f60 con 0x7f238c0cf770 2024-04-26T23:28:08.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.187+0000 7f2391200640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 0x7f236c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.187+0000 7f2391200640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 0x7f236c06a8d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f23800ae000 tx=0x7f23800a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.191+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2378055de0 con 0x7f238c0cf770 2024-04-26T23:28:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f238c1486d0 con 0x7f238c0cf770 2024-04-26T23:28:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2388c00640 1 -- 172.21.15.39:0/57761917 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f237805a0e0 con 0x7f238c0cf770 2024-04-26T23:28:08.358 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 msgr2=0x7f236c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 0x7f236c06a8d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f23800ae000 tx=0x7f23800a6070 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 msgr2=0x7f238c0c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f237800c780 tx=0x7f237800cc40 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 shutdown_connections 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f236c068410 0x7f236c06a8d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f238c1488f0 0x7f238c0c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f238c0cf770 0x7f238c0c6f30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 --2- 172.21.15.39:0/57761917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f238c06d4c0 0x7f238c15c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 >> 172.21.15.39:0/57761917 conn(0x7f238c0ce0e0 msgr2=0x7f238c0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 shutdown_connections 2024-04-26T23:28:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.355+0000 7f2393c00640 1 -- 172.21.15.39:0/57761917 wait complete. 2024-04-26T23:28:08.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:28:08.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 Processor -- start 2024-04-26T23:28:08.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 -- start start 2024-04-26T23:28:08.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248806d4e0 0x7f248806d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880d10d0 0x7f24880d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248806dfa0 con 0x7f24880cf8c0 2024-04-26T23:28:08.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f248806e280 con 0x7f248806d4e0 2024-04-26T23:28:08.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f248e000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f248806e560 con 0x7f24880d10d0 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.519+0000 7f247ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248806d4e0 0x7f248806d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248806d4e0 0x7f248806d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41678/0 (socket says 172.21.15.39:41678) 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 -- 172.21.15.39:0/4229625192 learned_addr learned my addr 172.21.15.39:0/4229625192 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f2487e00640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880d10d0 0x7f24880d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 -- 172.21.15.39:0/4229625192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880d10d0 msgr2=0x7f24880d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:08.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880d10d0 0x7f24880d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 -- 172.21.15.39:0/4229625192 >> v1:172.21.15.71:6789/0 conn(0x7f24880cf8c0 legacy=0x7f24880cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 -- 172.21.15.39:0/4229625192 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24880b2ff0 con 0x7f248806d4e0 2024-04-26T23:28:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f247ea00640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f248806d970 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edf37f3062e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f2486a00640 1 -- 172.21.15.39:0/4229625192 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700a9610 con 0x7f248806d4e0 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f2486a00640 1 -- 172.21.15.39:0/4229625192 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24700a97b0 con 0x7f248806d4e0 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.523+0000 7f2486a00640 1 -- 172.21.15.39:0/4229625192 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700a9b80 con 0x7f248806d4e0 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- 172.21.15.39:0/4229625192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 msgr2=0x7f248806d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f248806d970 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c530 comp rx=0 tx=0).stop 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- 172.21.15.39:0/4229625192 shutdown_connections 2024-04-26T23:28:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880d10d0 0x7f24880d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- 172.21.15.39:0/4229625192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f248806d970 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- 172.21.15.39:0/4229625192 >> 172.21.15.39:0/4229625192 conn(0x7f24880d3040 msgr2=0x7f24880d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- 172.21.15.39:0/4229625192 shutdown_connections 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- 172.21.15.39:0/4229625192 wait complete. 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 Processor -- start 2024-04-26T23:28:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- start start 2024-04-26T23:28:08.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880cf8c0 0x7f248814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24880d10d0 0x7f24880c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f248816bf10 con 0x7f248806d4e0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f248815f780 con 0x7f24880d10d0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f248e000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f248816c090 con 0x7f24880cf8c0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41682/0 (socket says 172.21.15.39:41682) 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 -- 172.21.15.39:0/1976858986 learned_addr learned my addr 172.21.15.39:0/1976858986 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487e00640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24880d10d0 0x7f24880c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f247ea00640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880cf8c0 0x7f248814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 -- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880cf8c0 msgr2=0x7f248814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880cf8c0 0x7f248814fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 -- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24880d10d0 msgr2=0x7f24880c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24880d10d0 0x7f24880c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 -- 172.21.15.39:0/1976858986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24880c7cb0 con 0x7f248806d4e0 2024-04-26T23:28:08.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.527+0000 7f2487400640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f247800c370 tx=0x7f247800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24780052d0 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478005470 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478007260 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24880c7f90 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880c8550 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248806a720 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2478007400 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 0x7f246406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f2478085f50 con 0x7f248806d4e0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.531+0000 7f247ea00640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 0x7f246406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.535+0000 7f247ea00640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 0x7f246406a8d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f24700ae000 tx=0x7f2470009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.539+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2478055d40 con 0x7f248806d4e0 2024-04-26T23:28:08.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:28:08.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:28:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.703+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f24880cf680 con 0x7f248806d4e0 2024-04-26T23:28:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.703+0000 7f247fe00640 1 -- 172.21.15.39:0/1976858986 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f247805a040 con 0x7f248806d4e0 2024-04-26T23:28:08.708 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 msgr2=0x7f246406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 0x7f246406a8d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f24700ae000 tx=0x7f2470009040 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 msgr2=0x7f24880b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f247800c370 tx=0x7f247800c830 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 shutdown_connections 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2464068410 0x7f246406a8d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24880d10d0 0x7f24880c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f24880cf8c0 0x7f248814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 --2- 172.21.15.39:0/1976858986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248806d4e0 0x7f24880b5370 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 >> 172.21.15.39:0/1976858986 conn(0x7f24880d3040 msgr2=0x7f2488150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 shutdown_connections 2024-04-26T23:28:08.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.707+0000 7f248e000640 1 -- 172.21.15.39:0/1976858986 wait complete. 2024-04-26T23:28:08.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:08.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 Processor -- start 2024-04-26T23:28:08.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 -- start start 2024-04-26T23:28:08.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe015d000 0x7f9fe006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9fe006fd70 0x7f9fe015f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe0160340 con 0x7f9fe015fea0 2024-04-26T23:28:08.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe015d3e0 con 0x7f9fe006fd70 2024-04-26T23:28:08.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe8400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe0160900 con 0x7f9fe015d000 2024-04-26T23:28:08.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9fe006fd70 0x7f9fe015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe6400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9fe015fea0 0x7f9fe00cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33248/0 (socket says 172.21.15.39:33248) 2024-04-26T23:28:08.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe6400640 1 -- 172.21.15.39:0/3435540590 learned_addr learned my addr 172.21.15.39:0/3435540590 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:08.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5a00640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe015d000 0x7f9fe006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5000640 1 -- 172.21.15.39:0/3435540590 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe015d000 msgr2=0x7f9fe006ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:08.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5000640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe015d000 0x7f9fe006ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5000640 1 -- 172.21.15.39:0/3435540590 >> v1:172.21.15.39:6789/0 conn(0x7f9fe015fea0 legacy=0x7f9fe00cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fe5000640 1 -- 172.21.15.39:0/3435540590 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe0160620 con 0x7f9fe006fd70 2024-04-26T23:28:08.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.867+0000 7f9fdfe00640 1 -- 172.21.15.39:0/3435540590 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765464827 0 0) 0x7f9fe0160340 con 0x7f9fe015fea0 2024-04-26T23:28:08.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe5000640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe006fd70 0x7f9fe015f960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097c0 tx=0x7f9fcc01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b14e308a46341b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fdfe00640 1 -- 172.21.15.39:0/3435540590 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b0070 con 0x7f9fe006fd70 2024-04-26T23:28:08.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fdfe00640 1 -- 172.21.15.39:0/3435540590 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc004230 con 0x7f9fe006fd70 2024-04-26T23:28:08.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fdfe00640 1 -- 172.21.15.39:0/3435540590 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc003620 con 0x7f9fe006fd70 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 -- 172.21.15.39:0/3435540590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe006fd70 msgr2=0x7f9fe015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe006fd70 0x7f9fe015f960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097c0 tx=0x7f9fcc01c350 comp rx=0 tx=0).stop 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 -- 172.21.15.39:0/3435540590 shutdown_connections 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe006fd70 0x7f9fe015f960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 --2- 172.21.15.39:0/3435540590 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe015d000 0x7f9fe006ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 -- 172.21.15.39:0/3435540590 >> 172.21.15.39:0/3435540590 conn(0x7f9fe00b2af0 msgr2=0x7f9fe00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 -- 172.21.15.39:0/3435540590 shutdown_connections 2024-04-26T23:28:08.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.871+0000 7f9fe8400640 1 -- 172.21.15.39:0/3435540590 wait complete. 2024-04-26T23:28:08.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 Processor -- start 2024-04-26T23:28:08.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- start start 2024-04-26T23:28:08.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe006fd70 0x7f9fe00d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 0x7f9fe01543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00cdfe0 con 0x7f9fe015d000 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00cde60 con 0x7f9fe015fea0 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe00cf4f0 con 0x7f9fe006fd70 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41694/0 (socket says 172.21.15.39:41694) 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 -- 172.21.15.39:0/4057747702 learned_addr learned my addr 172.21.15.39:0/4057747702 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5a00640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe006fd70 0x7f9fe00d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe6400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 0x7f9fe01543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 -- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe006fd70 msgr2=0x7f9fe00d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe006fd70 0x7f9fe00d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 -- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 msgr2=0x7f9fe01543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 0x7f9fe01543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 -- 172.21.15.39:0/4057747702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe0151660 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe6400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 0x7f9fe01543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe5000640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0ae040 tx=0x7f9fcc0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b9020 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc003df0 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe0151900 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b0040 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.875+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe0151ec0 con 0x7f9fe015d000 2024-04-26T23:28:08.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe0050740 con 0x7f9fe015d000 2024-04-26T23:28:08.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9fcc0bc020 con 0x7f9fe015d000 2024-04-26T23:28:08.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fdd600640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:08.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f9fcc120b70 con 0x7f9fe015d000 2024-04-26T23:28:08.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fe5a00640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:08.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.879+0000 7f9fe5a00640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009af0 tx=0x7f9fd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:08.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:08.883+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9fcc0c3030 con 0x7f9fe015d000 2024-04-26T23:28:09.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fe00b6270 con 0x7f9fe015d000 2024-04-26T23:28:09.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fdd600640 1 -- 172.21.15.39:0/4057747702 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5178 (secure 0 0 0) 0x7f9fcc016090 con 0x7f9fe015d000 2024-04-26T23:28:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:09.086 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:28:09.086 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 msgr2=0x7f9fc006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009af0 tx=0x7f9fd4008040 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 msgr2=0x7f9fe0150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0ae040 tx=0x7f9fcc0190f0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 shutdown_connections 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe015fea0 0x7f9fe01543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe015d000 0x7f9fe0150ed0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 --2- 172.21.15.39:0/4057747702 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe006fd70 0x7f9fe00d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 >> 172.21.15.39:0/4057747702 conn(0x7f9fe00b2af0 msgr2=0x7f9fe00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 shutdown_connections 2024-04-26T23:28:09.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.083+0000 7f9fe8400640 1 -- 172.21.15.39:0/4057747702 wait complete. 2024-04-26T23:28:09.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:09.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.243+0000 7f7320000640 1 Processor -- start 2024-04-26T23:28:09.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7320000640 1 -- start start 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7320000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73180cf2a0 0x7f731806f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7320000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7318160060 con 0x7f731806fab0 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7320000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7318160340 con 0x7f7318145820 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7320000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f731806ff20 con 0x7f73180cf2a0 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f731806fab0 0x7f73180cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33252/0 (socket says 172.21.15.39:33252) 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731e000640 1 -- 172.21.15.39:0/266330809 learned_addr learned my addr 172.21.15.39:0/266330809 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731cc00640 1 --2- 172.21.15.39:0/266330809 >> v2:172.21.15.71:3300/0 conn(0x7f73180cf2a0 0x7f731806f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18377479 0 0) 0x7f7318160060 con 0x7f731806fab0 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7300003530 con 0x7f731806fab0 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839241320 0 0) 0x7f7318160340 con 0x7f7318145820 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318160060 con 0x7f7318145820 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731cc00640 1 -- 172.21.15.39:0/266330809 >> v1:172.21.15.71:6789/0 conn(0x7f7318145820 legacy=0x7f73180b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731cc00640 1 -- 172.21.15.39:0/266330809 >> v1:172.21.15.39:6789/0 conn(0x7f731806fab0 legacy=0x7f73180cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.247+0000 7f731cc00640 1 -- 172.21.15.39:0/266330809 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7318160620 con 0x7f73180cf2a0 2024-04-26T23:28:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f731cc00640 1 --2- 172.21.15.39:0/266330809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73180cf2a0 0x7f731806f570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f73040097c0 tx=0x7f730401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ae470198b66c74a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040b0070 con 0x7f73180cf2a0 2024-04-26T23:28:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040ab600 con 0x7f73180cf2a0 2024-04-26T23:28:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7317e00640 1 -- 172.21.15.39:0/266330809 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040ab9d0 con 0x7f73180cf2a0 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 -- 172.21.15.39:0/266330809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73180cf2a0 msgr2=0x7f731806f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 --2- 172.21.15.39:0/266330809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73180cf2a0 0x7f731806f570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f73040097c0 tx=0x7f730401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 -- 172.21.15.39:0/266330809 shutdown_connections 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 --2- 172.21.15.39:0/266330809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73180cf2a0 0x7f731806f570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 -- 172.21.15.39:0/266330809 >> 172.21.15.39:0/266330809 conn(0x7f73180b2af0 msgr2=0x7f73180b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:09.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 -- 172.21.15.39:0/266330809 shutdown_connections 2024-04-26T23:28:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.251+0000 7f7320000640 1 -- 172.21.15.39:0/266330809 wait complete. 2024-04-26T23:28:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 Processor -- start 2024-04-26T23:28:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- start start 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73180cf2a0 0x7f73180b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7318145820 0x7f731813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f731815fdb0 con 0x7f731806fab0 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f731815fc30 con 0x7f7318145820 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f73180ce570 con 0x7f73180cf2a0 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41696/0 (socket says 172.21.15.39:41696) 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 -- 172.21.15.39:0/2649346748 learned_addr learned my addr 172.21.15.39:0/2649346748 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731cc00640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73180cf2a0 0x7f73180b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731e000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7318145820 0x7f731813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 -- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73180cf2a0 msgr2=0x7f73180b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73180cf2a0 0x7f73180b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 -- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7318145820 msgr2=0x7f731813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7318145820 0x7f731813f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 -- 172.21.15.39:0/2649346748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73180b0030 con 0x7f731806fab0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f731d600640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c460 tx=0x7f730c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0052d0 con 0x7f731806fab0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730c005490 con 0x7f731806fab0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c012850 con 0x7f731806fab0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73180b02d0 con 0x7f731806fab0 2024-04-26T23:28:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731813bbc0 con 0x7f731806fab0 2024-04-26T23:28:09.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.255+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7318050740 con 0x7f731806fab0 2024-04-26T23:28:09.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.259+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f730c0129f0 con 0x7f731806fab0 2024-04-26T23:28:09.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.259+0000 7f7315600640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 0x7f72f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.259+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f730c086630 con 0x7f731806fab0 2024-04-26T23:28:09.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.259+0000 7f731cc00640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 0x7f72f806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.259+0000 7f731cc00640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 0x7f72f806a8d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.263+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f730c056b90 con 0x7f731806fab0 2024-04-26T23:28:09.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.427+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73180742e0 con 0x7f731806fab0 2024-04-26T23:28:09.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7315600640 1 -- 172.21.15.39:0/2649346748 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f730c056490 con 0x7f731806fab0 2024-04-26T23:28:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:09.436 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 msgr2=0x7f72f806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 0x7f72f806a8d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f7304008040 comp rx=0 tx=0).stop 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 msgr2=0x7f7318156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c460 tx=0x7f730c00c920 comp rx=0 tx=0).stop 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 shutdown_connections 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72f8068410 0x7f72f806a8d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7318145820 0x7f731813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73180cf2a0 0x7f73180b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 --2- 172.21.15.39:0/2649346748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731806fab0 0x7f7318156500 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 >> 172.21.15.39:0/2649346748 conn(0x7f73180b2af0 msgr2=0x7f7318142560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 shutdown_connections 2024-04-26T23:28:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.431+0000 7f7320000640 1 -- 172.21.15.39:0/2649346748 wait complete. 2024-04-26T23:28:09.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:28:09.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:09.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 Processor -- start 2024-04-26T23:28:09.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 -- start start 2024-04-26T23:28:09.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f621015f340 0x7f62100d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f62100b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100cd810 con 0x7f62100b5710 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f62100d26a0 con 0x7f621015f340 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6215000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f62100ce140 con 0x7f621009c0f0 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6207e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f62100b5710 0x7f621009b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:33260/0 (socket says 172.21.15.39:33260) 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f6207e00640 1 -- 172.21.15.39:0/127709554 learned_addr learned my addr 172.21.15.39:0/127709554 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620de00640 1 --2- 172.21.15.39:0/127709554 >> v2:172.21.15.71:3300/0 conn(0x7f621015f340 0x7f62100d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620e800640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f62100b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054573394 0 0) 0x7f62100cd810 con 0x7f62100b5710 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f4003530 con 0x7f62100b5710 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3196651538 0 0) 0x7f61f4003530 con 0x7f62100b5710 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 msgr2=0x7f62100b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f62100b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 >> v2:172.21.15.71:3300/0 conn(0x7f621015f340 msgr2=0x7f62100d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 --2- 172.21.15.39:0/127709554 >> v2:172.21.15.71:3300/0 conn(0x7f621015f340 0x7f62100d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100cdaf0 con 0x7f62100b5710 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f61f8001680 con 0x7f62100b5710 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 >> v1:172.21.15.39:6789/0 conn(0x7f62100b5710 legacy=0x7f621009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61f40039c0 0x7f61f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f61f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f61f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f62100d26a0 con 0x7f61f4004810 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62100ce140 con 0x7f61f40039c0 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.611+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f61f400ba00 con 0x7f621009c0f0 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f61f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620de00640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61f40039c0 0x7f61f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620e800640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f61f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 -- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 msgr2=0x7f61f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:09.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621009c0f0 0x7f61f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 -- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61f40039c0 msgr2=0x7f61f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:09.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61f40039c0 0x7f61f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 -- 172.21.15.39:0/127709554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f4003530 con 0x7f61f4004810 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6207e00640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f61f4004c90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61f800c210 tx=0x7f61f801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c708be1481cecc13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8007d60 con 0x7f61f4004810 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f80a9020 con 0x7f61f4004810 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620d400640 1 -- 172.21.15.39:0/127709554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8005b00 con 0x7f61f4004810 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6215000640 1 -- 172.21.15.39:0/127709554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 msgr2=0x7f61f4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f6215000640 1 --2- 172.21.15.39:0/127709554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f61f4004c90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61f800c210 tx=0x7f61f801cc10 comp rx=0 tx=0).stop 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.615+0000 7f620e800640 1 -- 172.21.15.39:0/127709554 reap_dead start 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- 172.21.15.39:0/127709554 shutdown_connections 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- 172.21.15.39:0/127709554 >> 172.21.15.39:0/127709554 conn(0x7f62100b4b80 msgr2=0x7f62100b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:09.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- 172.21.15.39:0/127709554 shutdown_connections 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- 172.21.15.39:0/127709554 wait complete. 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 Processor -- start 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- start start 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f62100c92b0 0x7f62100cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 0x7f62100cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f62100b8c30 con 0x7f61f4004810 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62100b8ab0 con 0x7f62101540e0 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6215000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f62100b8db0 con 0x7f62100c92b0 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41706/0 (socket says 172.21.15.39:41706) 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 -- 172.21.15.39:0/2451354252 learned_addr learned my addr 172.21.15.39:0/2451354252 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6207e00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f62100c92b0 0x7f62100cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620e800640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 0x7f62100cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 -- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f62100c92b0 msgr2=0x7f62100cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f62100c92b0 0x7f62100cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 -- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 msgr2=0x7f62100cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 0x7f62100cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 -- 172.21.15.39:0/2451354252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100c8210 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620e800640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 0x7f62100cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f620de00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a30 tx=0x7f6200011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620000fbb0 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620000fd50 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.619+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200014660 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62100c84f0 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62100c8ab0 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62100c9690 con 0x7f61f4004810 2024-04-26T23:28:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f6200012040 con 0x7f61f4004810 2024-04-26T23:28:09.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6206000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 0x7f61ec06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.623+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f62000872e0 con 0x7f61f4004810 2024-04-26T23:28:09.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.627+0000 7f6207e00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 0x7f61ec06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:09.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.627+0000 7f6207e00640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 0x7f61ec06a900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61f80aa000 tx=0x7f61f8001ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:09.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.627+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6200019030 con 0x7f61f4004810 2024-04-26T23:28:09.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.827+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6210050740 con 0x7f61f4004810 2024-04-26T23:28:09.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.827+0000 7f6206000640 1 -- 172.21.15.39:0/2451354252 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5178 (secure 0 0 0) 0x7f62000577e0 con 0x7f61f4004810 2024-04-26T23:28:09.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:09.833 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:28:09.833 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 msgr2=0x7f61ec06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 0x7f61ec06a900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61f80aa000 tx=0x7f61f8001ac0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 msgr2=0x7f62100c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a30 tx=0x7f6200011ef0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 shutdown_connections 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f61ec068440 0x7f61ec06a900 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62101540e0 0x7f62100cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f62100c92b0 0x7f62100cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 --2- 172.21.15.39:0/2451354252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61f4004810 0x7f62100c7c30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:09.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 >> 172.21.15.39:0/2451354252 conn(0x7f62100b4b80 msgr2=0x7f6210071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:09.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 shutdown_connections 2024-04-26T23:28:09.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.831+0000 7f6215000640 1 -- 172.21.15.39:0/2451354252 wait complete. 2024-04-26T23:28:09.854 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 Processor -- start 2024-04-26T23:28:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 -- start start 2024-04-26T23:28:09.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9bdc145820 0x7f9bdc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:09.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc160060 con 0x7f9bdc06f570 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9bdc0cd5c0 con 0x7f9bdc0b4950 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9be1c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9bdc160340 con 0x7f9bdc145820 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41714/0 (socket says 172.21.15.39:41714) 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 -- 172.21.15.39:0/3352997628 learned_addr learned my addr 172.21.15.39:0/3352997628 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bdaa00640 1 --2- 172.21.15.39:0/3352997628 >> v2:172.21.15.71:3300/0 conn(0x7f9bdc145820 0x7f9bdc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 -- 172.21.15.39:0/3352997628 >> v2:172.21.15.71:3300/0 conn(0x7f9bdc145820 msgr2=0x7f9bdc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 --2- 172.21.15.39:0/3352997628 >> v2:172.21.15.71:3300/0 conn(0x7f9bdc145820 0x7f9bdc0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 -- 172.21.15.39:0/3352997628 >> v1:172.21.15.71:6789/0 conn(0x7f9bdc06f570 legacy=0x7f9bdc0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.995+0000 7f9bd3e00640 1 -- 172.21.15.39:0/3352997628 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc160620 con 0x7f9bdc0b4950 2024-04-26T23:28:10.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9bd3e00640 1 --2- 172.21.15.39:0/3352997628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc068ec0 tx=0x7f9bc401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6859af4e0ea349d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9bda000640 1 -- 172.21.15.39:0/3352997628 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40ab610 con 0x7f9bdc0b4950 2024-04-26T23:28:10.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9bda000640 1 -- 172.21.15.39:0/3352997628 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc40b0070 con 0x7f9bdc0b4950 2024-04-26T23:28:10.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9bda000640 1 -- 172.21.15.39:0/3352997628 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40ab9d0 con 0x7f9bdc0b4950 2024-04-26T23:28:10.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 -- 172.21.15.39:0/3352997628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc0b4950 msgr2=0x7f9bdc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 --2- 172.21.15.39:0/3352997628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc068ec0 tx=0x7f9bc401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 -- 172.21.15.39:0/3352997628 shutdown_connections 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 --2- 172.21.15.39:0/3352997628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc0b4950 0x7f9bdc0b4d70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 --2- 172.21.15.39:0/3352997628 >> v2:172.21.15.71:3300/0 conn(0x7f9bdc145820 0x7f9bdc0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 -- 172.21.15.39:0/3352997628 >> 172.21.15.39:0/3352997628 conn(0x7f9bdc0b2af0 msgr2=0x7f9bdc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 -- 172.21.15.39:0/3352997628 shutdown_connections 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:09.999+0000 7f9be1c00640 1 -- 172.21.15.39:0/3352997628 wait complete. 2024-04-26T23:28:10.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 Processor -- start 2024-04-26T23:28:10.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- start start 2024-04-26T23:28:10.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 0x7f9bdc166650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bdc0b4950 0x7f9bdc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 0x7f9bdc0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc15fdb0 con 0x7f9bdc145820 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc15fc30 con 0x7f9bdc06f570 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc0ce570 con 0x7f9bdc0b4950 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 0x7f9bdc166650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 0x7f9bdc0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 0x7f9bdc166650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:38614/0 (socket says 172.21.15.39:38614) 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdaa00640 1 -- 172.21.15.39:0/985000601 learned_addr learned my addr 172.21.15.39:0/985000601 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bd3e00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bdc0b4950 0x7f9bdc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 -- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bdc0b4950 msgr2=0x7f9bdc159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bdc0b4950 0x7f9bdc159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 -- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 msgr2=0x7f9bdc166650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 0x7f9bdc166650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 -- 172.21.15.39:0/985000601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc166b90 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bdb400640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 0x7f9bdc0b1ab0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c700 tx=0x7f9bd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4003b80 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd4003d20 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd400aa30 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc14a890 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.003+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc14ae50 con 0x7f9bdc145820 2024-04-26T23:28:10.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc050740 con 0x7f9bdc145820 2024-04-26T23:28:10.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9bd400abd0 con 0x7f9bdc145820 2024-04-26T23:28:10.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9bd2a00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 0x7f9bb806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f9bd4086650 con 0x7f9bdc145820 2024-04-26T23:28:10.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9bdaa00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 0x7f9bb806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.007+0000 7f9bdaa00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 0x7f9bb806a8d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc007a70 tx=0x7f9bcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.011+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9bd4056660 con 0x7f9bdc145820 2024-04-26T23:28:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.211+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bdc06e8a0 con 0x7f9bdc145820 2024-04-26T23:28:10.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.211+0000 7f9bd2a00640 1 -- 172.21.15.39:0/985000601 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5178 (secure 0 0 0) 0x7f9bd405a960 con 0x7f9bdc145820 2024-04-26T23:28:10.215 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:10.215 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:27:47.140323+0000","modified":"2024-04-26T23:27:50.165896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/3842819351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3842819351},{"type":"v1","addr":"172.21.15.39:6835","nonce":3842819351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5490,"qdb_cluster":[5490]},"id":4}]} 2024-04-26T23:28:10.215 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 msgr2=0x7f9bb806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 0x7f9bb806a8d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc007a70 tx=0x7f9bcc008040 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 msgr2=0x7f9bdc0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 0x7f9bdc0b1ab0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c700 tx=0x7f9bd400cbc0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 shutdown_connections 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9bb8068410 0x7f9bb806a8d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bdc145820 0x7f9bdc0b1ab0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bdc0b4950 0x7f9bdc159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 --2- 172.21.15.39:0/985000601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc06f570 0x7f9bdc166650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 >> 172.21.15.39:0/985000601 conn(0x7f9bdc0b2af0 msgr2=0x7f9bdc15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 shutdown_connections 2024-04-26T23:28:10.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.215+0000 7f9be1c00640 1 -- 172.21.15.39:0/985000601 wait complete. 2024-04-26T23:28:10.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 Processor -- start 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 -- start start 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9c0815f340 0x7f9c080d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c080cd810 con 0x7f9c080b5710 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9c080d26a0 con 0x7f9c0815f340 2024-04-26T23:28:10.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9c080ce140 con 0x7f9c0809c0f0 2024-04-26T23:28:10.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0d400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9c0815f340 0x7f9c080d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0ca00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9c080b5710 0x7f9c0809b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:43120/0 (socket says 172.21.15.39:43120) 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:39240/0 (socket says 172.21.15.39:39240) 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0ca00640 1 -- 172.21.15.39:0/1827940121 learned_addr learned my addr 172.21.15.39:0/1827940121 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 -- 172.21.15.39:0/1827940121 >> v2:172.21.15.71:3300/0 conn(0x7f9c0815f340 msgr2=0x7f9c080d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 --2- 172.21.15.39:0/1827940121 >> v2:172.21.15.71:3300/0 conn(0x7f9c0815f340 0x7f9c080d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 -- 172.21.15.39:0/1827940121 >> v1:172.21.15.71:6789/0 conn(0x7f9c080b5710 legacy=0x7f9c0809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.375+0000 7f9c0de00640 1 -- 172.21.15.39:0/1827940121 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c080cdaf0 con 0x7f9c0809c0f0 2024-04-26T23:28:10.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0de00640 1 --2- 172.21.15.39:0/1827940121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009d90 tx=0x7f9c0001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189831abfd69ba99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c07e00640 1 -- 172.21.15.39:0/1827940121 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000b2070 con 0x7f9c0809c0f0 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c07e00640 1 -- 172.21.15.39:0/1827940121 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c000a5990 con 0x7f9c0809c0f0 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c07e00640 1 -- 172.21.15.39:0/1827940121 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000a5d60 con 0x7f9c0809c0f0 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1827940121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 msgr2=0x7f9c080b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1827940121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009d90 tx=0x7f9c0001c8b0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1827940121 shutdown_connections 2024-04-26T23:28:10.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1827940121 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0809c0f0 0x7f9c080b82a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1827940121 >> v2:172.21.15.71:3300/0 conn(0x7f9c0815f340 0x7f9c080d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1827940121 >> 172.21.15.39:0/1827940121 conn(0x7f9c080b4b80 msgr2=0x7f9c080b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1827940121 shutdown_connections 2024-04-26T23:28:10.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.379+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1827940121 wait complete. 2024-04-26T23:28:10.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 Processor -- start 2024-04-26T23:28:10.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- start start 2024-04-26T23:28:10.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c0809c0f0 0x7f9c0815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0815f340 0x7f9c0815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c080ce730 con 0x7f9c080b5710 2024-04-26T23:28:10.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c080ce5b0 con 0x7f9c0809c0f0 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9c080ce8b0 con 0x7f9c0815f340 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44022/0 (socket says 172.21.15.39:44022) 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 -- 172.21.15.39:0/1653078115 learned_addr learned my addr 172.21.15.39:0/1653078115 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0d400640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c0809c0f0 0x7f9c0815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0de00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0815f340 0x7f9c0815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 -- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0815f340 msgr2=0x7f9c0815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0815f340 0x7f9c0815d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 -- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c0809c0f0 msgr2=0x7f9c0815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c0809c0f0 0x7f9c0815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 -- 172.21.15.39:0/1653078115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c080cbff0 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0ca00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400c430 tx=0x7f9bf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4017070 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf4005cf0 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40072f0 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c080cc2d0 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.383+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c080cc890 con 0x7f9c080b5710 2024-04-26T23:28:10.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c08050740 con 0x7f9c080b5710 2024-04-26T23:28:10.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9bf401a070 con 0x7f9c080b5710 2024-04-26T23:28:10.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c05600640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 0x7f9be806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf4085e10 con 0x7f9c080b5710 2024-04-26T23:28:10.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c0d400640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 0x7f9be806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.387+0000 7f9c0d400640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 0x7f9be806a900 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009ac0 tx=0x7f9bfc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.391+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9bf4089030 con 0x7f9c080b5710 2024-04-26T23:28:10.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.559+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c080d19e0 con 0x7f9c080b5710 2024-04-26T23:28:10.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.559+0000 7f9c05600640 1 -- 172.21.15.39:0/1653078115 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16605 (secure 0 0 0) 0x7f9bf4055c90 con 0x7f9c080b5710 2024-04-26T23:28:10.564 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:10.564 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":51,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:27:48.747870+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:27:45.529505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:27:46.096938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 msgr2=0x7f9be806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 0x7f9be806a900 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009ac0 tx=0x7f9bfc009190 comp rx=0 tx=0).stop 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 msgr2=0x7f9c080cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400c430 tx=0x7f9bf400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 shutdown_connections 2024-04-26T23:28:10.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9be8068440 0x7f9be806a900 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c0815f340 0x7f9c0815d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c080b5710 0x7f9c080cab70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 --2- 172.21.15.39:0/1653078115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c0809c0f0 0x7f9c0815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 >> 172.21.15.39:0/1653078115 conn(0x7f9c080b4b80 msgr2=0x7f9c08070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 shutdown_connections 2024-04-26T23:28:10.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.563+0000 7f9c0fe00640 1 -- 172.21.15.39:0/1653078115 wait complete. 2024-04-26T23:28:10.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:28:10.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 Processor -- start 2024-04-26T23:28:10.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 -- start start 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f510c1458d0 0x7f510c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c072180 con 0x7f510c073400 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f510c0739a0 con 0x7f510c1458d0 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5111200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f510c073c80 con 0x7f510c0ce5e0 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f510a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f510a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:39260/0 (socket says 172.21.15.39:39260) 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f510a800640 1 -- 172.21.15.39:0/1913601002 learned_addr learned my addr 172.21.15.39:0/1913601002 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.723+0000 7f5109e00640 1 --2- 172.21.15.39:0/1913601002 >> v2:172.21.15.71:3300/0 conn(0x7f510c1458d0 0x7f510c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f510a800640 1 -- 172.21.15.39:0/1913601002 >> v2:172.21.15.71:3300/0 conn(0x7f510c1458d0 msgr2=0x7f510c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f510a800640 1 --2- 172.21.15.39:0/1913601002 >> v2:172.21.15.71:3300/0 conn(0x7f510c1458d0 0x7f510c0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f510a800640 1 -- 172.21.15.39:0/1913601002 >> v1:172.21.15.71:6789/0 conn(0x7f510c073400 legacy=0x7f510c072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f510a800640 1 -- 172.21.15.39:0/1913601002 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c145cb0 con 0x7f510c0ce5e0 2024-04-26T23:28:10.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f510a800640 1 --2- 172.21.15.39:0/1913601002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5104009e50 tx=0x7f510401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85b538806288e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f5109400640 1 -- 172.21.15.39:0/1913601002 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51040a5770 con 0x7f510c0ce5e0 2024-04-26T23:28:10.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f5109400640 1 -- 172.21.15.39:0/1913601002 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51040a5910 con 0x7f510c0ce5e0 2024-04-26T23:28:10.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.727+0000 7f5109400640 1 -- 172.21.15.39:0/1913601002 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51040a5ce0 con 0x7f510c0ce5e0 2024-04-26T23:28:10.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- 172.21.15.39:0/1913601002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 msgr2=0x7f510c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- 172.21.15.39:0/1913601002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5104009e50 tx=0x7f510401c9a0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- 172.21.15.39:0/1913601002 shutdown_connections 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- 172.21.15.39:0/1913601002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c0cea70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- 172.21.15.39:0/1913601002 >> v2:172.21.15.71:3300/0 conn(0x7f510c1458d0 0x7f510c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- 172.21.15.39:0/1913601002 >> 172.21.15.39:0/1913601002 conn(0x7f510c06c7d0 msgr2=0x7f510c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- 172.21.15.39:0/1913601002 shutdown_connections 2024-04-26T23:28:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- 172.21.15.39:0/1913601002 wait complete. 2024-04-26T23:28:10.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 Processor -- start 2024-04-26T23:28:10.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- start start 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f510c1458d0 0x7f510c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1690c0 con 0x7f510c073400 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f510c168f40 con 0x7f510c1458d0 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5111200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f510c169240 con 0x7f510c0ce5e0 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44032/0 (socket says 172.21.15.39:44032) 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 -- 172.21.15.39:0/194291261 learned_addr learned my addr 172.21.15.39:0/194291261 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f510a800640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f510c1458d0 0x7f510c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5103e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 -- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 msgr2=0x7f510c141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 -- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f510c1458d0 msgr2=0x7f510c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f510c1458d0 0x7f510c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 -- 172.21.15.39:0/194291261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c0af860 con 0x7f510c073400 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5103e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:10.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.731+0000 7f5109e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e870 tx=0x7f50fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc017070 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc00c940 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00ccf0 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c13ed80 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1f8d20 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c06a720 con 0x7f510c073400 2024-04-26T23:28:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f50fc01a070 con 0x7f510c073400 2024-04-26T23:28:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 0x7f50e806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7f50fc086900 con 0x7f510c073400 2024-04-26T23:28:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.735+0000 7f5103e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 0x7f50e806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.739+0000 7f5103e00640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 0x7f50e806a8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f510c166f00 tx=0x7f50f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:10.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.739+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f50fc056780 con 0x7f510c073400 2024-04-26T23:28:10.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.943+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f510c06f350 con 0x7f510c073400 2024-04-26T23:28:10.946 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-04-26T23:28:10.943+0000 7f6c56400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:28:10.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5102000640 1 -- 172.21.15.39:0/194291261 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7f50fc05aa80 con 0x7f510c073400 2024-04-26T23:28:10.949 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:28:10.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 msgr2=0x7f50e806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 0x7f50e806a8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f510c166f00 tx=0x7f50f4009040 comp rx=0 tx=0).stop 2024-04-26T23:28:10.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 msgr2=0x7f510c13e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:10.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e870 tx=0x7f50fc00ec70 comp rx=0 tx=0).stop 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 shutdown_connections 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50e8068410 0x7f50e806a8d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f510c1458d0 0x7f510c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f510c0ce5e0 0x7f510c141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 --2- 172.21.15.39:0/194291261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f510c073400 0x7f510c13e840 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 >> 172.21.15.39:0/194291261 conn(0x7f510c06c7d0 msgr2=0x7f510c0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:10.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.947+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 shutdown_connections 2024-04-26T23:28:10.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:10.951+0000 7f5111200640 1 -- 172.21.15.39:0/194291261 wait complete. 2024-04-26T23:28:10.959 INFO:tasks.ceph.mds.a.smithi039.stderr: -3892> 2024-04-26T23:27:49.719+0000 7f9471800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:28:10.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:28:11.010 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:28:11.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.115+0000 7f7791e00640 1 Processor -- start 2024-04-26T23:28:11.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.115+0000 7f7791e00640 1 -- start start 2024-04-26T23:28:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7791e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f778c140170 0x7f778c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7791e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778c06e500 con 0x7f778c15e340 2024-04-26T23:28:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7791e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778c06e7e0 con 0x7f778c0d18f0 2024-04-26T23:28:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7791e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f778c06f110 con 0x7f778c140170 2024-04-26T23:28:11.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7782000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f778c15e340 0x7f778c0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34036/0 (socket says 172.21.15.39:34036) 2024-04-26T23:28:11.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f7782000640 1 -- 172.21.15.39:0/1048008310 learned_addr learned my addr 172.21.15.39:0/1048008310 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:11.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f778aa00640 1 --2- 172.21.15.39:0/1048008310 >> v2:172.21.15.39:3300/0 conn(0x7f778c140170 0x7f778c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:11.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f778aa00640 1 -- 172.21.15.39:0/1048008310 >> v1:172.21.15.71:6789/0 conn(0x7f778c0d18f0 legacy=0x7f778c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:11.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f778aa00640 1 -- 172.21.15.39:0/1048008310 >> v1:172.21.15.39:6789/0 conn(0x7f778c15e340 legacy=0x7f778c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f778aa00640 1 -- 172.21.15.39:0/1048008310 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c06eac0 con 0x7f778c140170 2024-04-26T23:28:11.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.119+0000 7f778a000640 1 -- 172.21.15.39:0/1048008310 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245290179 0 0) 0x7f778c06e500 con 0x7f778c15e340 2024-04-26T23:28:11.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f778aa00640 1 --2- 172.21.15.39:0/1048008310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c140170 0x7f778c15de00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f777c009d90 tx=0x7f777c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310f5aab89d6adb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:11.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f778a000640 1 -- 172.21.15.39:0/1048008310 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b2070 con 0x7f778c140170 2024-04-26T23:28:11.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f778a000640 1 -- 172.21.15.39:0/1048008310 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c0a5990 con 0x7f778c140170 2024-04-26T23:28:11.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f778a000640 1 -- 172.21.15.39:0/1048008310 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0a5d60 con 0x7f778c140170 2024-04-26T23:28:11.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- 172.21.15.39:0/1048008310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c140170 msgr2=0x7f778c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 --2- 172.21.15.39:0/1048008310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c140170 0x7f778c15de00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f777c009d90 tx=0x7f777c01c8b0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- 172.21.15.39:0/1048008310 shutdown_connections 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 --2- 172.21.15.39:0/1048008310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c140170 0x7f778c15de00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- 172.21.15.39:0/1048008310 >> 172.21.15.39:0/1048008310 conn(0x7f778c06c7d0 msgr2=0x7f778c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- 172.21.15.39:0/1048008310 shutdown_connections 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- 172.21.15.39:0/1048008310 wait complete. 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 Processor -- start 2024-04-26T23:28:11.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.123+0000 7f7791e00640 1 -- start start 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 0x7f778c1f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f778c140170 0x7f778c141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0d09a0 con 0x7f778c15e340 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0d0820 con 0x7f778c140170 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f778c16afc0 con 0x7f778c0d18f0 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44074/0 (socket says 172.21.15.39:44074) 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 -- 172.21.15.39:0/396359000 learned_addr learned my addr 172.21.15.39:0/396359000 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7782000640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f778c140170 0x7f778c141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:11.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778aa00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 0x7f778c1f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 -- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 msgr2=0x7f778c1f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 0x7f778c1f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 -- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f778c140170 msgr2=0x7f778c141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f778c140170 0x7f778c141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 -- 172.21.15.39:0/396359000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c140910 con 0x7f778c15e340 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778aa00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 0x7f778c1f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f778b400640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f778400c3c0 tx=0x7f778400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784017070 con 0x7f778c15e340 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77840052d0 con 0x7f778c15e340 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784003840 con 0x7f778c15e340 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c140bf0 con 0x7f778c15e340 2024-04-26T23:28:11.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c1411b0 con 0x7f778c15e340 2024-04-26T23:28:11.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778c06a720 con 0x7f778c15e340 2024-04-26T23:28:11.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.127+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f778401a070 con 0x7f778c15e340 2024-04-26T23:28:11.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.131+0000 7f7783e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 0x7f776806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:11.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.131+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5795+0+0 (secure 0 0 0) 0x7f7784085c20 con 0x7f778c15e340 2024-04-26T23:28:11.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.131+0000 7f778aa00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 0x7f776806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:11.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.131+0000 7f778aa00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 0x7f776806a8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f777c0af000 tx=0x7f777c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.135+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7784005480 con 0x7f778c15e340 2024-04-26T23:28:11.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.335+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f778c06fdc0 con 0x7f778c15e340 2024-04-26T23:28:11.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.946+0000 7f7783e00640 1 -- 172.21.15.39:0/396359000 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f7784055bd0 con 0x7f778c15e340 2024-04-26T23:28:11.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 msgr2=0x7f776806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 0x7f776806a8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f777c0af000 tx=0x7f777c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:28:11.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 msgr2=0x7f778c13f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:11.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f778400c3c0 tx=0x7f778400c880 comp rx=0 tx=0).stop 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 shutdown_connections 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7768068410 0x7f776806a8d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f778c15e340 0x7f778c13f260 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f778c140170 0x7f778c141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 --2- 172.21.15.39:0/396359000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778c0d18f0 0x7f778c1f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 >> 172.21.15.39:0/396359000 conn(0x7f778c06c7d0 msgr2=0x7f778c13b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 shutdown_connections 2024-04-26T23:28:11.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:11.950+0000 7f7791e00640 1 -- 172.21.15.39:0/396359000 wait complete. 2024-04-26T23:28:11.976 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:28:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 Processor -- start 2024-04-26T23:28:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 -- start start 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b24145870 0x7f9b240cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9b2406f4d0 0x7f9b2406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b2415fa90 0x7f9b2415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240cfd30 con 0x7f9b2406f4d0 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240d0010 con 0x7f9b24145870 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b2b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240d02f0 con 0x7f9b2415fa90 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9b2406f4d0 0x7f9b2406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9b2406f4d0 0x7f9b2406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44086/0 (socket says 172.21.15.39:44086) 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 -- 172.21.15.39:0/1694428901 learned_addr learned my addr 172.21.15.39:0/1694428901 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:12.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b29200640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b2415fa90 0x7f9b2415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23e00640 1 --2- 172.21.15.39:0/1694428901 >> v2:172.21.15.71:3300/0 conn(0x7f9b24145870 0x7f9b240cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 -- 172.21.15.39:0/1694428901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b2415fa90 msgr2=0x7f9b2415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b2415fa90 0x7f9b2415ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 -- 172.21.15.39:0/1694428901 >> v2:172.21.15.71:3300/0 conn(0x7f9b24145870 msgr2=0x7f9b240cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 --2- 172.21.15.39:0/1694428901 >> v2:172.21.15.71:3300/0 conn(0x7f9b24145870 0x7f9b240cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.162+0000 7f9b23400640 1 -- 172.21.15.39:0/1694428901 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b240d05d0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b23400640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b2406f960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9b24070540 tx=0x7f9b1001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7abcbf9e11306b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b22a00640 1 -- 172.21.15.39:0/1694428901 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b100ab5f0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b22a00640 1 -- 172.21.15.39:0/1694428901 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b100b0070 con 0x7f9b2406f4d0 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b22a00640 1 -- 172.21.15.39:0/1694428901 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b100ab9b0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 -- 172.21.15.39:0/1694428901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 msgr2=0x7f9b2406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b2406f960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9b24070540 tx=0x7f9b1001c520 comp rx=0 tx=0).stop 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 -- 172.21.15.39:0/1694428901 shutdown_connections 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b2415fa90 0x7f9b2415ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 --2- 172.21.15.39:0/1694428901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b2406f960 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 --2- 172.21.15.39:0/1694428901 >> v2:172.21.15.71:3300/0 conn(0x7f9b24145870 0x7f9b240cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 -- 172.21.15.39:0/1694428901 >> 172.21.15.39:0/1694428901 conn(0x7f9b240b2cc0 msgr2=0x7f9b240b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 -- 172.21.15.39:0/1694428901 shutdown_connections 2024-04-26T23:28:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 -- 172.21.15.39:0/1694428901 wait complete. 2024-04-26T23:28:12.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.166+0000 7f9b2b200640 1 Processor -- start 2024-04-26T23:28:12.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- start start 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b24145870 0x7f9b241535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 0x7f9b24159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415d710 con 0x7f9b2406f4d0 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415d590 con 0x7f9b2415fa90 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240722a0 con 0x7f9b24145870 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44092/0 (socket says 172.21.15.39:44092) 2024-04-26T23:28:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 -- 172.21.15.39:0/2358380614 learned_addr learned my addr 172.21.15.39:0/2358380614 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b29200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 0x7f9b24159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23400640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b24145870 0x7f9b241535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 -- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b24145870 msgr2=0x7f9b241535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b24145870 0x7f9b241535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 -- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 msgr2=0x7f9b24159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 0x7f9b24159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 -- 172.21.15.39:0/2358380614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b24153b00 con 0x7f9b2406f4d0 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b29200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 0x7f9b24159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b23e00640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400d830 tx=0x7f9b1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400b6c0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14019070 con 0x7f9b2406f4d0 2024-04-26T23:28:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400ba60 con 0x7f9b2406f4d0 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b240b4c30 con 0x7f9b2406f4d0 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b240b51f0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.170+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b24050740 con 0x7f9b2406f4d0 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.174+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9b1401e460 con 0x7f9b2406f4d0 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.174+0000 7f9b1be00640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 0x7f9b0406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:12.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.174+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5795+0+0 (secure 0 0 0) 0x7f9b14087100 con 0x7f9b2406f4d0 2024-04-26T23:28:12.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.174+0000 7f9b23400640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 0x7f9b0406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:12.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.174+0000 7f9b23400640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 0x7f9b0406a8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:12.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.178+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b14057670 con 0x7f9b2406f4d0 2024-04-26T23:28:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.342+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9b2406f9a0 con 0x7f9b2406f4d0 2024-04-26T23:28:12.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b1be00640 1 -- 172.21.15.39:0/2358380614 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f9b14056f70 con 0x7f9b2406f4d0 2024-04-26T23:28:12.954 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 msgr2=0x7f9b0406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 0x7f9b0406a8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 msgr2=0x7f9b24141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400d830 tx=0x7f9b1400dcf0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 shutdown_connections 2024-04-26T23:28:12.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b04068410 0x7f9b0406a8d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b2415fa90 0x7f9b24159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b24145870 0x7f9b241535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 --2- 172.21.15.39:0/2358380614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b2406f4d0 0x7f9b24141da0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.950+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 >> 172.21.15.39:0/2358380614 conn(0x7f9b240b2cc0 msgr2=0x7f9b24165740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.954+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 shutdown_connections 2024-04-26T23:28:12.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:12.954+0000 7f9b2b200640 1 -- 172.21.15.39:0/2358380614 wait complete. 2024-04-26T23:28:12.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:28:13.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.126+0000 7fc530e00640 1 Processor -- start 2024-04-26T23:28:13.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.126+0000 7fc530e00640 1 -- start start 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc530e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc52c0715e0 0x7fc52c1635a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc530e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52c15fe30 con 0x7fc52c163ae0 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc530e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52c162de0 con 0x7fc52c15f340 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc530e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc52c1600b0 con 0x7fc52c0715e0 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52aa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc52c0715e0 0x7fc52c1635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52be00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc52c163ae0 0x7fc52c06c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34044/0 (socket says 172.21.15.39:34044) 2024-04-26T23:28:13.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52be00640 1 -- 172.21.15.39:0/3660339248 learned_addr learned my addr 172.21.15.39:0/3660339248 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:13.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52aa00640 1 -- 172.21.15.39:0/3660339248 >> v1:172.21.15.71:6789/0 conn(0x7fc52c15f340 legacy=0x7fc52c15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:13.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52aa00640 1 -- 172.21.15.39:0/3660339248 >> v1:172.21.15.39:6789/0 conn(0x7fc52c163ae0 legacy=0x7fc52c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52a000640 1 -- 172.21.15.39:0/3660339248 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341231847 0 0) 0x7fc524001120 con 0x7fc52c163ae0 2024-04-26T23:28:13.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.130+0000 7fc52aa00640 1 -- 172.21.15.39:0/3660339248 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c160390 con 0x7fc52c0715e0 2024-04-26T23:28:13.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52aa00640 1 --2- 172.21.15.39:0/3660339248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c1635a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc5180097c0 tx=0x7fc51801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63d3e6b64a88a3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52a000640 1 -- 172.21.15.39:0/3660339248 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a7070 con 0x7fc52c0715e0 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52a000640 1 -- 172.21.15.39:0/3660339248 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5180b0070 con 0x7fc52c0715e0 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52a000640 1 -- 172.21.15.39:0/3660339248 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180ab890 con 0x7fc52c0715e0 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- 172.21.15.39:0/3660339248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 msgr2=0x7fc52c1635a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 --2- 172.21.15.39:0/3660339248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c1635a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc5180097c0 tx=0x7fc51801c470 comp rx=0 tx=0).stop 2024-04-26T23:28:13.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- 172.21.15.39:0/3660339248 shutdown_connections 2024-04-26T23:28:13.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 --2- 172.21.15.39:0/3660339248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c1635a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- 172.21.15.39:0/3660339248 >> 172.21.15.39:0/3660339248 conn(0x7fc52c0d1de0 msgr2=0x7fc52c0d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:13.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- 172.21.15.39:0/3660339248 shutdown_connections 2024-04-26T23:28:13.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- 172.21.15.39:0/3660339248 wait complete. 2024-04-26T23:28:13.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 Processor -- start 2024-04-26T23:28:13.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- start start 2024-04-26T23:28:13.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:13.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc52c15f340 0x7fc52c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:13.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 0x7fc52c1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:13.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c06cae0 con 0x7fc52c0715e0 2024-04-26T23:28:13.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c0d07f0 con 0x7fc52c163ae0 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc530e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc52c06cc60 con 0x7fc52c15f340 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44108/0 (socket says 172.21.15.39:44108) 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52b400640 1 -- 172.21.15.39:0/1109190527 learned_addr learned my addr 172.21.15.39:0/1109190527 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.134+0000 7fc52be00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 0x7fc52c1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52aa00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc52c15f340 0x7fc52c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 -- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc52c15f340 msgr2=0x7fc52c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc52c15f340 0x7fc52c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 -- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 msgr2=0x7fc52c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 0x7fc52c1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 -- 172.21.15.39:0/1109190527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c06ef70 con 0x7fc52c0715e0 2024-04-26T23:28:13.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52be00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 0x7fc52c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc52b400640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c7d0 tx=0x7fc51c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c003b80 con 0x7fc52c0715e0 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51c003d20 con 0x7fc52c0715e0 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c1528b0 con 0x7fc52c0715e0 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00aa90 con 0x7fc52c0715e0 2024-04-26T23:28:13.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52c15aa40 con 0x7fc52c0715e0 2024-04-26T23:28:13.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc52c0506d0 con 0x7fc52c0715e0 2024-04-26T23:28:13.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc51c00ac30 con 0x7fc52c0715e0 2024-04-26T23:28:13.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 0x7fc50c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:13.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.138+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5357+0+0 (secure 0 0 0) 0x7fc51c086820 con 0x7fc52c0715e0 2024-04-26T23:28:13.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.142+0000 7fc52aa00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 0x7fc50c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:13.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.142+0000 7fc52aa00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 0x7fc50c06a900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5180af000 tx=0x7fc5180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:13.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.142+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc51c056ee0 con 0x7fc52c0715e0 2024-04-26T23:28:13.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.310+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc52c0d2a00 con 0x7fc52c0715e0 2024-04-26T23:28:13.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.954+0000 7fc523400640 1 -- 172.21.15.39:0/1109190527 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7fc51c0567e0 con 0x7fc52c0715e0 2024-04-26T23:28:13.960 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 msgr2=0x7fc50c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 0x7fc50c06a900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5180af000 tx=0x7fc5180a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 msgr2=0x7fc52c152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c7d0 tx=0x7fc51c00cc90 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 shutdown_connections 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc50c068440 0x7fc50c06a900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc52c163ae0 0x7fc52c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc52c15f340 0x7fc52c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 --2- 172.21.15.39:0/1109190527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc52c0715e0 0x7fc52c152370 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 >> 172.21.15.39:0/1109190527 conn(0x7fc52c0d1de0 msgr2=0x7fc52c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 shutdown_connections 2024-04-26T23:28:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:13.958+0000 7fc530e00640 1 -- 172.21.15.39:0/1109190527 wait complete. 2024-04-26T23:28:13.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:28:14.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.126+0000 7fab67600640 1 Processor -- start 2024-04-26T23:28:14.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.126+0000 7fab67600640 1 -- start start 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab67600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60140170 0x7fab6015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab67600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab6015e340 0x7fab600d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab67600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6006e500 con 0x7fab60161850 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab67600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fab6006f110 con 0x7fab6015e340 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab67600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fab6006e7e0 con 0x7fab60140170 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab6015e340 0x7fab600d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab6015e340 0x7fab600d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44116/0 (socket says 172.21.15.39:44116) 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 -- 172.21.15.39:0/3689691471 learned_addr learned my addr 172.21.15.39:0/3689691471 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab64c00640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60140170 0x7fab6015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 -- 172.21.15.39:0/3689691471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60140170 msgr2=0x7fab6015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60140170 0x7fab6015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 -- 172.21.15.39:0/3689691471 >> v1:172.21.15.71:6789/0 conn(0x7fab60161850 legacy=0x7fab60142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.130+0000 7fab57e00640 1 -- 172.21.15.39:0/3689691471 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6006eac0 con 0x7fab6015e340 2024-04-26T23:28:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab57e00640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab6015e340 0x7fab600d11e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fab48009870 tx=0x7fab4801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8963473784570f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab5fe00640 1 -- 172.21.15.39:0/3689691471 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480b1070 con 0x7fab6015e340 2024-04-26T23:28:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab5fe00640 1 -- 172.21.15.39:0/3689691471 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab480ac410 con 0x7fab6015e340 2024-04-26T23:28:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab5fe00640 1 -- 172.21.15.39:0/3689691471 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480ac7e0 con 0x7fab6015e340 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- 172.21.15.39:0/3689691471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab6015e340 msgr2=0x7fab600d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab6015e340 0x7fab600d11e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fab48009870 tx=0x7fab4801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- 172.21.15.39:0/3689691471 shutdown_connections 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab6015e340 0x7fab600d11e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 --2- 172.21.15.39:0/3689691471 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60140170 0x7fab6015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- 172.21.15.39:0/3689691471 >> 172.21.15.39:0/3689691471 conn(0x7fab6006c7d0 msgr2=0x7fab6006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- 172.21.15.39:0/3689691471 shutdown_connections 2024-04-26T23:28:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- 172.21.15.39:0/3689691471 wait complete. 2024-04-26T23:28:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 Processor -- start 2024-04-26T23:28:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 -- start start 2024-04-26T23:28:14.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.134+0000 7fab67600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 0x7fab60073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 0x7fab60152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab6016a340 con 0x7fab60140170 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab6016a1c0 con 0x7fab6015e340 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fab6016a4c0 con 0x7fab60161850 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44124/0 (socket says 172.21.15.39:44124) 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 -- 172.21.15.39:0/882919152 learned_addr learned my addr 172.21.15.39:0/882919152 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab65600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 0x7fab60152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab57e00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 0x7fab60073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 -- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 msgr2=0x7fab60152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 0x7fab60152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 -- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 msgr2=0x7fab60073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 0x7fab60073cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 -- 172.21.15.39:0/882919152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab600b56b0 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab65600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 0x7fab60152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab57e00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 0x7fab60073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab64c00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fab5000d800 tx=0x7fab5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5000b6c0 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab50019070 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5000bae0 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab600b5990 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab60072210 con 0x7fab60140170 2024-04-26T23:28:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6006a720 con 0x7fab60140170 2024-04-26T23:28:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.138+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fab5000bc80 con 0x7fab60140170 2024-04-26T23:28:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.142+0000 7fab5d600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 0x7fab3c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.142+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fab50086bb0 con 0x7fab60140170 2024-04-26T23:28:14.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.142+0000 7fab57e00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 0x7fab3c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.142+0000 7fab57e00640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 0x7fab3c06a8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fab480ae000 tx=0x7fab48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.146+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fab5008d080 con 0x7fab60140170 2024-04-26T23:28:14.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.310+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fab6006fdc0 con 0x7fab60140170 2024-04-26T23:28:14.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab5d600640 1 -- 172.21.15.39:0/882919152 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fab50057510 con 0x7fab60140170 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 msgr2=0x7fab3c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 0x7fab3c06a8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fab480ae000 tx=0x7fab48008040 comp rx=0 tx=0).stop 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 msgr2=0x7fab60138900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fab5000d800 tx=0x7fab5000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 shutdown_connections 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fab3c068410 0x7fab3c06a8d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fab60161850 0x7fab60152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6015e340 0x7fab60073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 --2- 172.21.15.39:0/882919152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab60140170 0x7fab60138900 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 >> 172.21.15.39:0/882919152 conn(0x7fab6006c7d0 msgr2=0x7fab6015f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:14.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 shutdown_connections 2024-04-26T23:28:14.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.318+0000 7fab67600640 1 -- 172.21.15.39:0/882919152 wait complete. 2024-04-26T23:28:14.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2024-04-26T23:28:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 Processor -- start 2024-04-26T23:28:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 -- start start 2024-04-26T23:28:14.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f92740cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f927406fc80 0x7f92740b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9274160060 con 0x7f92740b4950 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f92740cd5c0 con 0x7f927406fc80 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9279000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9274160340 con 0x7f9274145820 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.478+0000 7f9272800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f927406fc80 0x7f92740b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f927406fc80 0x7f92740b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44136/0 (socket says 172.21.15.39:44136) 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 -- 172.21.15.39:0/2030428580 learned_addr learned my addr 172.21.15.39:0/2030428580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9271e00640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f92740cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 -- 172.21.15.39:0/2030428580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 msgr2=0x7f92740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f92740cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 -- 172.21.15.39:0/2030428580 >> v1:172.21.15.71:6789/0 conn(0x7f92740b4950 legacy=0x7f927406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 -- 172.21.15.39:0/2030428580 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9274160620 con 0x7f927406fc80 2024-04-26T23:28:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9272800640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f92740b4d70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f926c009e50 tx=0x7f926c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73d19473b9cb4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9271400640 1 -- 172.21.15.39:0/2030428580 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a58f0 con 0x7f927406fc80 2024-04-26T23:28:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9271400640 1 -- 172.21.15.39:0/2030428580 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0a5a90 con 0x7f927406fc80 2024-04-26T23:28:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.482+0000 7f9271400640 1 -- 172.21.15.39:0/2030428580 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a5e60 con 0x7f927406fc80 2024-04-26T23:28:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/2030428580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 msgr2=0x7f92740b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f92740b4d70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f926c009e50 tx=0x7f926c01ca00 comp rx=0 tx=0).stop 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/2030428580 shutdown_connections 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f92740b4d70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- 172.21.15.39:0/2030428580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f92740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/2030428580 >> 172.21.15.39:0/2030428580 conn(0x7f92740b2af0 msgr2=0x7f92740b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/2030428580 shutdown_connections 2024-04-26T23:28:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/2030428580 wait complete. 2024-04-26T23:28:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 Processor -- start 2024-04-26T23:28:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- start start 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92740b4950 0x7f92740732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f927413b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92740ce260 con 0x7f927406fc80 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f927415fe40 con 0x7f92740b4950 2024-04-26T23:28:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f92740ce3e0 con 0x7f9274145820 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44138/0 (socket says 172.21.15.39:44138) 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 -- 172.21.15.39:0/205442343 learned_addr learned my addr 172.21.15.39:0/205442343 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9272800640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f927413b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f926be00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92740b4950 0x7f92740732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 -- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 msgr2=0x7f927413b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f927413b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 -- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92740b4950 msgr2=0x7f92740732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92740b4950 0x7f92740732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 -- 172.21.15.39:0/205442343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92741440f0 con 0x7f927406fc80 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9271e00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f926400e870 tx=0x7f926400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264017070 con 0x7f927406fc80 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926400c940 con 0x7f927406fc80 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926400ccf0 con 0x7f927406fc80 2024-04-26T23:28:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.486+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741443d0 con 0x7f927406fc80 2024-04-26T23:28:14.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9274144990 con 0x7f927406fc80 2024-04-26T23:28:14.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9274050740 con 0x7f927406fc80 2024-04-26T23:28:14.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f926401a070 con 0x7f927406fc80 2024-04-26T23:28:14.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f926a000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 0x7f925006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:14.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f9264086a40 con 0x7f927406fc80 2024-04-26T23:28:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.490+0000 7f926be00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 0x7f925006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.494+0000 7f926be00640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 0x7f925006a8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f927413c2d0 tx=0x7f925c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.494+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9264057210 con 0x7f927406fc80 2024-04-26T23:28:14.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.726+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) -- 0x7f92740d0b70 con 0x7f927406fc80 2024-04-26T23:28:14.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f926a000640 1 -- 172.21.15.39:0/205442343 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v141) ==== 133+0+0 (secure 0 0 0) 0x7f9264056b10 con 0x7f927406fc80 2024-04-26T23:28:14.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 msgr2=0x7f925006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 0x7f925006a8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f927413c2d0 tx=0x7f925c009040 comp rx=0 tx=0).stop 2024-04-26T23:28:14.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 msgr2=0x7f9274143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:14.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f926400e870 tx=0x7f926400ec70 comp rx=0 tx=0).stop 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 shutdown_connections 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9250068410 0x7f925006a8d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9274145820 0x7f927413b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92740b4950 0x7f92740732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 --2- 172.21.15.39:0/205442343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f927406fc80 0x7f9274143990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 >> 172.21.15.39:0/205442343 conn(0x7f92740b2af0 msgr2=0x7f92740cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 shutdown_connections 2024-04-26T23:28:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:14.958+0000 7f9279000640 1 -- 172.21.15.39:0/205442343 wait complete. 2024-04-26T23:28:14.985 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2024-04-26T23:28:14.986 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2024-04-26T23:28:14.986 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:28:14.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:15.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 Processor -- start 2024-04-26T23:28:15.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 -- start start 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f72f80cfe00 0x7f72f806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f8074750 con 0x7f72f80742f0 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f80d0290 con 0x7f72f80cd810 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.122+0000 7f7300200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f72f80d0b10 con 0x7f72f80cfe00 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fce00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f72f80742f0 0x7f72f80cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34058/0 (socket says 172.21.15.39:34058) 2024-04-26T23:28:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fce00640 1 -- 172.21.15.39:0/576664389 learned_addr learned my addr 172.21.15.39:0/576664389 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:15.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fe200640 1 --2- 172.21.15.39:0/576664389 >> v2:172.21.15.39:3300/0 conn(0x7f72f80cfe00 0x7f72f806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72f7e00640 1 -- 172.21.15.39:0/576664389 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275112088 0 0) 0x7f72f8074750 con 0x7f72f80742f0 2024-04-26T23:28:15.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72f7e00640 1 -- 172.21.15.39:0/576664389 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e0003530 con 0x7f72f80742f0 2024-04-26T23:28:15.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fe200640 1 -- 172.21.15.39:0/576664389 >> v1:172.21.15.71:6789/0 conn(0x7f72f80cd810 legacy=0x7f72f8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fe200640 1 -- 172.21.15.39:0/576664389 >> v1:172.21.15.39:6789/0 conn(0x7f72f80742f0 legacy=0x7f72f80cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fe200640 1 -- 172.21.15.39:0/576664389 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80d0550 con 0x7f72f80cfe00 2024-04-26T23:28:15.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72fe200640 1 --2- 172.21.15.39:0/576664389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f806ee00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a27659658600f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72f7e00640 1 -- 172.21.15.39:0/576664389 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00b2070 con 0x7f72f80cfe00 2024-04-26T23:28:15.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72f7e00640 1 -- 172.21.15.39:0/576664389 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00a57d0 con 0x7f72f80cfe00 2024-04-26T23:28:15.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.126+0000 7f72f7e00640 1 -- 172.21.15.39:0/576664389 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00a5ba0 con 0x7f72f80cfe00 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- 172.21.15.39:0/576664389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 msgr2=0x7f72f806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 --2- 172.21.15.39:0/576664389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f806ee00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f001c820 comp rx=0 tx=0).stop 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- 172.21.15.39:0/576664389 shutdown_connections 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 --2- 172.21.15.39:0/576664389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f806ee00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- 172.21.15.39:0/576664389 >> 172.21.15.39:0/576664389 conn(0x7f72f80b2af0 msgr2=0x7f72f80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- 172.21.15.39:0/576664389 shutdown_connections 2024-04-26T23:28:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- 172.21.15.39:0/576664389 wait complete. 2024-04-26T23:28:15.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 Processor -- start 2024-04-26T23:28:15.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- start start 2024-04-26T23:28:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 0x7f72f80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72f80cd810 0x7f72f80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f72f816b080 con 0x7f72f80cfe00 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f72f816af00 con 0x7f72f80cd810 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f7300200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f72f816b200 con 0x7f72f80742f0 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 0x7f72f80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44150/0 (socket says 172.21.15.39:44150) 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fd800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 0x7f72f80b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:39378/0 (socket says 172.21.15.39:39378) 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 -- 172.21.15.39:0/3904171491 learned_addr learned my addr 172.21.15.39:0/3904171491 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fce00640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72f80cd810 0x7f72f80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 -- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 msgr2=0x7f72f80b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 0x7f72f80b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 -- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72f80cd810 msgr2=0x7f72f80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72f80cd810 0x7f72f80afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.130+0000 7f72fe200640 1 -- 172.21.15.39:0/3904171491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80ae850 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72fe200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f00195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00b2050 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00be070 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00ad890 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f80aeb30 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f80af0f0 con 0x7f72f80cfe00 2024-04-26T23:28:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f8050740 con 0x7f72f80cfe00 2024-04-26T23:28:15.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f72f00ada30 con 0x7f72f80cfe00 2024-04-26T23:28:15.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 0x7f72d806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f72f0121780 con 0x7f72f80cfe00 2024-04-26T23:28:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.134+0000 7f72fd800640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 0x7f72d806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.138+0000 7f72fd800640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 0x7f72d806a8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001810 tx=0x7f72ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.138+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f72f0016560 con 0x7f72f80cfe00 2024-04-26T23:28:15.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72f80b1460 con 0x7f72f80cfe00 2024-04-26T23:28:15.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f72f5600640 1 -- 172.21.15.39:0/3904171491 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+12960 (secure 0 0 0) 0x7f72f00f1b20 con 0x7f72f80cfe00 2024-04-26T23:28:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:15.310 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":54,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:13.953173+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6835/3842819351":"2024-04-27T23:28:10.945442+0000","172.21.15.39:6832/3842819351":"2024-04-27T23:28:10.945442+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:15.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 msgr2=0x7f72d806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 0x7f72d806a8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001810 tx=0x7f72ec009040 comp rx=0 tx=0).stop 2024-04-26T23:28:15.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 msgr2=0x7f72f813fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.306+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f00195c0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 shutdown_connections 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f72d8068410 0x7f72d806a8d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72f80cfe00 0x7f72f813fb90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72f80cd810 0x7f72f80afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 --2- 172.21.15.39:0/3904171491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72f80742f0 0x7f72f80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 >> 172.21.15.39:0/3904171491 conn(0x7f72f80b2af0 msgr2=0x7f72f80b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 shutdown_connections 2024-04-26T23:28:15.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.310+0000 7f7300200640 1 -- 172.21.15.39:0/3904171491 wait complete. 2024-04-26T23:28:15.332 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:28:15.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.470+0000 7fe95fe00640 1 Processor -- start 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 -- start start 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe958140170 0x7fe95815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 0x7fe9580cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95806e500 con 0x7fe95815e340 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe95806f110 con 0x7fe958140170 2024-04-26T23:28:15.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe95806e7e0 con 0x7fe9580d18f0 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95ca00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe95815e340 0x7fe9580d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34066/0 (socket says 172.21.15.39:34066) 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95ca00640 1 -- 172.21.15.39:0/980531477 learned_addr learned my addr 172.21.15.39:0/980531477 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95de00640 1 --2- 172.21.15.39:0/980531477 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 0x7fe9580cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95d400640 1 --2- 172.21.15.39:0/980531477 >> v2:172.21.15.71:3300/0 conn(0x7fe958140170 0x7fe95815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe957e00640 1 -- 172.21.15.39:0/980531477 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463878335 0 0) 0x7fe95806e500 con 0x7fe95815e340 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe957e00640 1 -- 172.21.15.39:0/980531477 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe940003530 con 0x7fe95815e340 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95de00640 1 -- 172.21.15.39:0/980531477 >> v2:172.21.15.71:3300/0 conn(0x7fe958140170 msgr2=0x7fe95815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95de00640 1 --2- 172.21.15.39:0/980531477 >> v2:172.21.15.71:3300/0 conn(0x7fe958140170 0x7fe95815de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95de00640 1 -- 172.21.15.39:0/980531477 >> v1:172.21.15.39:6789/0 conn(0x7fe95815e340 legacy=0x7fe9580d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.474+0000 7fe95de00640 1 -- 172.21.15.39:0/980531477 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95806eac0 con 0x7fe9580d18f0 2024-04-26T23:28:15.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95de00640 1 --2- 172.21.15.39:0/980531477 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 0x7fe9580cf6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe950009d90 tx=0x7fe95001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d29a853df408b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe957e00640 1 -- 172.21.15.39:0/980531477 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500b2070 con 0x7fe9580d18f0 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe957e00640 1 -- 172.21.15.39:0/980531477 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500a5990 con 0x7fe9580d18f0 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe957e00640 1 -- 172.21.15.39:0/980531477 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500a5d60 con 0x7fe9580d18f0 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- 172.21.15.39:0/980531477 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 msgr2=0x7fe9580cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 --2- 172.21.15.39:0/980531477 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 0x7fe9580cf6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe950009d90 tx=0x7fe95001c8b0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- 172.21.15.39:0/980531477 shutdown_connections 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 --2- 172.21.15.39:0/980531477 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe9580d18f0 0x7fe9580cf6f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 --2- 172.21.15.39:0/980531477 >> v2:172.21.15.71:3300/0 conn(0x7fe958140170 0x7fe95815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- 172.21.15.39:0/980531477 >> 172.21.15.39:0/980531477 conn(0x7fe95806c7d0 msgr2=0x7fe95806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- 172.21.15.39:0/980531477 shutdown_connections 2024-04-26T23:28:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- 172.21.15.39:0/980531477 wait complete. 2024-04-26T23:28:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 Processor -- start 2024-04-26T23:28:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.478+0000 7fe95fe00640 1 -- start start 2024-04-26T23:28:15.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe958140170 0x7fe958160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe95815e340 0x7fe95813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580d07d0 con 0x7fe9580d18f0 2024-04-26T23:28:15.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580d0650 con 0x7fe95815e340 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580d0950 con 0x7fe958140170 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44164/0 (socket says 172.21.15.39:44164) 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 -- 172.21.15.39:0/3010898370 learned_addr learned my addr 172.21.15.39:0/3010898370 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95de00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe95815e340 0x7fe95813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95ca00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe958140170 0x7fe958160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 -- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe958140170 msgr2=0x7fe958160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe958140170 0x7fe958160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 -- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe95815e340 msgr2=0x7fe95813b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe95815e340 0x7fe95813b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 -- 172.21.15.39:0/3010898370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95813c4d0 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95d400640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00e930 tx=0x7fe94c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c017070 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c00ca00 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95813c7b0 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00cdb0 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95813cd70 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.482+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95806a720 con 0x7fe9580d18f0 2024-04-26T23:28:15.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.486+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fe94c01a070 con 0x7fe9580d18f0 2024-04-26T23:28:15.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.486+0000 7fe955600640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 0x7fe93806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.486+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fe94c086820 con 0x7fe9580d18f0 2024-04-26T23:28:15.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.486+0000 7fe95ca00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 0x7fe93806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.486+0000 7fe95ca00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 0x7fe93806a8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe944007fd0 tx=0x7fe944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.490+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe94c0569d0 con 0x7fe9580d18f0 2024-04-26T23:28:15.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9580ce180 con 0x7fe9580d18f0 2024-04-26T23:28:15.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe955600640 1 -- 172.21.15.39:0/3010898370 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7fe94c05acd0 con 0x7fe9580d18f0 2024-04-26T23:28:15.657 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:28:15.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 msgr2=0x7fe93806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 0x7fe93806a8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe944007fd0 tx=0x7fe944009040 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 msgr2=0x7fe958142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00e930 tx=0x7fe94c00edf0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 shutdown_connections 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe938068410 0x7fe93806a8d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe95815e340 0x7fe95813b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe958140170 0x7fe958160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 --2- 172.21.15.39:0/3010898370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9580d18f0 0x7fe958142f20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 >> 172.21.15.39:0/3010898370 conn(0x7fe95806c7d0 msgr2=0x7fe9580d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 shutdown_connections 2024-04-26T23:28:15.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.654+0000 7fe95fe00640 1 -- 172.21.15.39:0/3010898370 wait complete. 2024-04-26T23:28:15.683 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2024-04-26T23:28:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 Processor -- start 2024-04-26T23:28:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 -- start start 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0750163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075015fad0 con 0x7f07500d19b0 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07500d0100 con 0x7f075006cae0 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0756600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f07500d1580 con 0x7f075015f6f0 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0747e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f07500d19b0 0x7f075006c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34080/0 (socket says 172.21.15.39:34080) 2024-04-26T23:28:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0747e00640 1 -- 172.21.15.39:0/2188514894 learned_addr learned my addr 172.21.15.39:0/2188514894 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0750163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645401210 0 0) 0x7f075015fad0 con 0x7f07500d19b0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0734003530 con 0x7f07500d19b0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 932275737 0 0) 0x7f0734003530 con 0x7f07500d19b0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 msgr2=0x7f0750163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0750163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 >> v1:172.21.15.71:6789/0 conn(0x7f075006cae0 legacy=0x7f075006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07500b1410 con 0x7f07500d19b0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f0738001680 con 0x7f07500d19b0 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 >> v1:172.21.15.39:6789/0 conn(0x7f07500d19b0 legacy=0x7f075006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f0734003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0734004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734004d50 0x7f07340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f073400b9d0 con 0x7f07340039f0 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f073400bb50 con 0x7f0734004d50 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f073400bd50 con 0x7f075015f6f0 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f0734003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f0747e00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0734004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074fe00640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734004d50 0x7f07340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 -- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 msgr2=0x7f0734004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f075015f6f0 0x7f0734004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 -- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734004d50 msgr2=0x7f07340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734004d50 0x7f07340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.822+0000 7f074f400640 1 -- 172.21.15.39:0/2188514894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0734003530 con 0x7f07340039f0 2024-04-26T23:28:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f074f400640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f0734003dd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0740009ae0 tx=0x7f074001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c666849bd0cf68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400b2070 con 0x7f07340039f0 2024-04-26T23:28:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400a55a0 con 0x7f07340039f0 2024-04-26T23:28:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f074ea00640 1 -- 172.21.15.39:0/2188514894 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400096b0 con 0x7f07340039f0 2024-04-26T23:28:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 -- 172.21.15.39:0/2188514894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 msgr2=0x7f0734003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 --2- 172.21.15.39:0/2188514894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f0734003dd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0740009ae0 tx=0x7f074001c9b0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f074fe00640 1 -- 172.21.15.39:0/2188514894 reap_dead start 2024-04-26T23:28:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 -- 172.21.15.39:0/2188514894 shutdown_connections 2024-04-26T23:28:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 -- 172.21.15.39:0/2188514894 >> 172.21.15.39:0/2188514894 conn(0x7f07500d1ee0 msgr2=0x7f07500d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 -- 172.21.15.39:0/2188514894 shutdown_connections 2024-04-26T23:28:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.826+0000 7f0756600640 1 -- 172.21.15.39:0/2188514894 wait complete. 2024-04-26T23:28:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 Processor -- start 2024-04-26T23:28:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- start start 2024-04-26T23:28:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07500b5ef0 0x7f0750155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07500b75d0 0x7f0750161e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f07500cfd90 con 0x7f07340039f0 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07500cfab0 con 0x7f07500b75d0 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0750070880 con 0x7f07500b5ef0 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44190/0 (socket says 172.21.15.39:44190) 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 -- 172.21.15.39:0/2738941787 learned_addr learned my addr 172.21.15.39:0/2738941787 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 -- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07500b5ef0 msgr2=0x7f0750155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07500b5ef0 0x7f0750155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 -- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07500b75d0 msgr2=0x7f0750161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07500b75d0 0x7f0750161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 -- 172.21.15.39:0/2738941787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07500c6fa0 con 0x7f07340039f0 2024-04-26T23:28:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f074f400640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f074001ce90 tx=0x7f0734005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400b2040 con 0x7f07340039f0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074000f000 con 0x7f07340039f0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400096b0 con 0x7f07340039f0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0750155640 con 0x7f07340039f0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07500b6af0 con 0x7f07340039f0 2024-04-26T23:28:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.830+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0750050740 con 0x7f07340039f0 2024-04-26T23:28:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.834+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f07400c0020 con 0x7f07340039f0 2024-04-26T23:28:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.834+0000 7f0747400640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 0x7f072c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.834+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f0740120930 con 0x7f07340039f0 2024-04-26T23:28:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.834+0000 7f0747e00640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 0x7f072c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:15.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.834+0000 7f0747e00640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 0x7f072c06a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0738001cf0 tx=0x7f0738001c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:15.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:15.838+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f07400166c0 con 0x7f07340039f0 2024-04-26T23:28:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.062+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) -- 0x7f07500cf580 con 0x7f07340039f0 2024-04-26T23:28:16.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.966+0000 7f0747400640 1 -- 172.21.15.39:0/2738941787 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v143) ==== 161+0+0 (secure 0 0 0) 0x7f07400c1370 con 0x7f07340039f0 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 msgr2=0x7f072c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 0x7f072c06a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0738001cf0 tx=0x7f0738001c80 comp rx=0 tx=0).stop 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 msgr2=0x7f07500c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f074001ce90 tx=0x7f0734005840 comp rx=0 tx=0).stop 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 shutdown_connections 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f072c068440 0x7f072c06a900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:16.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07500b75d0 0x7f0750161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:16.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07500b5ef0 0x7f0750155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:16.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 --2- 172.21.15.39:0/2738941787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07340039f0 0x7f07500c84f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:16.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 >> 172.21.15.39:0/2738941787 conn(0x7f07500d1ee0 msgr2=0x7f07500b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:16.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 shutdown_connections 2024-04-26T23:28:16.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:16.970+0000 7f0756600640 1 -- 172.21.15.39:0/2738941787 wait complete. 2024-04-26T23:28:16.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:28:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 Processor -- start 2024-04-26T23:28:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 -- start start 2024-04-26T23:28:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc40c15ce60 0x7fc40c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c15d240 0x7fc40c0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c0b1fa0 con 0x7fc40c0b1b90 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c0ae040 con 0x7fc40c15d240 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc412c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c163f40 con 0x7fc40c15ce60 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c15d240 0x7fc40c0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c15d240 0x7fc40c0b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44200/0 (socket says 172.21.15.39:44200) 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 -- 172.21.15.39:0/261814574 learned_addr learned my addr 172.21.15.39:0/261814574 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40be00640 1 --2- 172.21.15.39:0/261814574 >> v2:172.21.15.71:3300/0 conn(0x7fc40c15ce60 0x7fc40c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 -- 172.21.15.39:0/261814574 >> v2:172.21.15.71:3300/0 conn(0x7fc40c15ce60 msgr2=0x7fc40c0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 --2- 172.21.15.39:0/261814574 >> v2:172.21.15.71:3300/0 conn(0x7fc40c15ce60 0x7fc40c0b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 -- 172.21.15.39:0/261814574 >> v1:172.21.15.71:6789/0 conn(0x7fc40c0b1b90 legacy=0x7fc40c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.142+0000 7fc40b400640 1 -- 172.21.15.39:0/261814574 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c15fc00 con 0x7fc40c15d240 2024-04-26T23:28:17.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc40b400640 1 --2- 172.21.15.39:0/261814574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c0b1650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc40c070f30 tx=0x7fc3f801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05b2237bcdda057 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc40aa00640 1 -- 172.21.15.39:0/261814574 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80b0070 con 0x7fc40c15d240 2024-04-26T23:28:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc40aa00640 1 -- 172.21.15.39:0/261814574 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f80ab600 con 0x7fc40c15d240 2024-04-26T23:28:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc40aa00640 1 -- 172.21.15.39:0/261814574 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80ab9d0 con 0x7fc40c15d240 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- 172.21.15.39:0/261814574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 msgr2=0x7fc40c0b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 --2- 172.21.15.39:0/261814574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c0b1650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc40c070f30 tx=0x7fc3f801c300 comp rx=0 tx=0).stop 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- 172.21.15.39:0/261814574 shutdown_connections 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 --2- 172.21.15.39:0/261814574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c0b1650 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 --2- 172.21.15.39:0/261814574 >> v2:172.21.15.71:3300/0 conn(0x7fc40c15ce60 0x7fc40c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- 172.21.15.39:0/261814574 >> 172.21.15.39:0/261814574 conn(0x7fc40c0b65c0 msgr2=0x7fc40c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- 172.21.15.39:0/261814574 shutdown_connections 2024-04-26T23:28:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- 172.21.15.39:0/261814574 wait complete. 2024-04-26T23:28:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 Processor -- start 2024-04-26T23:28:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.146+0000 7fc412c00640 1 -- start start 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc40c0b1b90 0x7fc40c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40c15ce60 0x7fc40c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c0b0d60 con 0x7fc40c15d240 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1609c0 con 0x7fc40c0b1b90 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c163af0 con 0x7fc40c15ce60 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44212/0 (socket says 172.21.15.39:44212) 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 -- 172.21.15.39:0/1545664642 learned_addr learned my addr 172.21.15.39:0/1545664642 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc40be00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc40c0b1b90 0x7fc40c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc40b400640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40c15ce60 0x7fc40c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 -- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40c15ce60 msgr2=0x7fc40c09a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40c15ce60 0x7fc40c09a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 -- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc40c0b1b90 msgr2=0x7fc40c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc40c0b1b90 0x7fc40c0cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 -- 172.21.15.39:0/1545664642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c15b530 con 0x7fc40c15d240 2024-04-26T23:28:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc410c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b9a0 tx=0x7fc40400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404019070 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40400cba0 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404014440 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c0b4e60 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c0b5140 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c06a720 con 0x7fc40c15d240 2024-04-26T23:28:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.150+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc40401c070 con 0x7fc40c15d240 2024-04-26T23:28:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.154+0000 7fc403e00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 0x7fc3ec06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.154+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fc4040863d0 con 0x7fc40c15d240 2024-04-26T23:28:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.154+0000 7fc40be00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 0x7fc3ec06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.154+0000 7fc40be00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 0x7fc3ec06a8d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc007a60 tx=0x7fc3fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.158+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc404056550 con 0x7fc40c15d240 2024-04-26T23:28:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.322+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc40c0cd660 con 0x7fc40c15d240 2024-04-26T23:28:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.326+0000 7fc403e00640 1 -- 172.21.15.39:0/1545664642 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fc40405a850 con 0x7fc40c15d240 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.326+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 msgr2=0x7fc3ec06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.326+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 0x7fc3ec06a8d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc007a60 tx=0x7fc3fc008040 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.326+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 msgr2=0x7fc40c159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.326+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b9a0 tx=0x7fc40400be60 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 shutdown_connections 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc3ec068410 0x7fc3ec06a8d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c15d240 0x7fc40c159110 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40c15ce60 0x7fc40c09a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 --2- 172.21.15.39:0/1545664642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc40c0b1b90 0x7fc40c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 >> 172.21.15.39:0/1545664642 conn(0x7fc40c0b65c0 msgr2=0x7fc40c162e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 shutdown_connections 2024-04-26T23:28:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.330+0000 7fc412c00640 1 -- 172.21.15.39:0/1545664642 wait complete. 2024-04-26T23:28:17.352 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:28:17.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:28:17.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:28:17.534 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:28:17.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:17.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:17.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:28:17.543 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:17.543 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:17.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:28:17.552 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:17.552 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:17.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:28:17.592 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:17.592 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:17.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:28:17.603 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:28:17.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:17.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.774+0000 7f98d9600640 1 Processor -- start 2024-04-26T23:28:17.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.774+0000 7f98d9600640 1 -- start start 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d9600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f1f0 0x7f98d4073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d9600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f98d415f5d0 0x7f98d406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d9600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d406eab0 con 0x7f98d40ae850 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d9600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f98d40b4d70 con 0x7f98d415f5d0 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d9600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f98d40aedf0 con 0x7f98d415f1f0 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d3400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f98d40ae850 0x7f98d4162f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34094/0 (socket says 172.21.15.39:34094) 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d3400640 1 -- 172.21.15.39:0/4247702958 learned_addr learned my addr 172.21.15.39:0/4247702958 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:17.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98cbe00640 1 --2- 172.21.15.39:0/4247702958 >> v2:172.21.15.39:3300/0 conn(0x7f98d415f5d0 0x7f98d406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d2a00640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f1f0 0x7f98d4073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98cbe00640 1 -- 172.21.15.39:0/4247702958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f1f0 msgr2=0x7f98d4073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:17.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98cbe00640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f1f0 0x7f98d4073640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98d2000640 1 -- 172.21.15.39:0/4247702958 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430474727 0 0) 0x7f98cc0014a0 con 0x7f98d40ae850 2024-04-26T23:28:17.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98cbe00640 1 -- 172.21.15.39:0/4247702958 >> v1:172.21.15.39:6789/0 conn(0x7f98d40ae850 legacy=0x7f98d4162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.778+0000 7f98cbe00640 1 -- 172.21.15.39:0/4247702958 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d40b4720 con 0x7f98d415f5d0 2024-04-26T23:28:17.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98cbe00640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f5d0 0x7f98d406d3e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0097c0 tx=0x7f98bc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372c698dacdae8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d2000640 1 -- 172.21.15.39:0/4247702958 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0b5070 con 0x7f98d415f5d0 2024-04-26T23:28:17.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d2000640 1 -- 172.21.15.39:0/4247702958 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc0a8990 con 0x7f98d415f5d0 2024-04-26T23:28:17.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d2000640 1 -- 172.21.15.39:0/4247702958 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0a8d60 con 0x7f98d415f5d0 2024-04-26T23:28:17.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- 172.21.15.39:0/4247702958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f5d0 msgr2=0x7f98d406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f5d0 0x7f98d406d3e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0097c0 tx=0x7f98bc01ec90 comp rx=0 tx=0).stop 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- 172.21.15.39:0/4247702958 shutdown_connections 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f5d0 0x7f98d406d3e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- 172.21.15.39:0/4247702958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f1f0 0x7f98d4073640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- 172.21.15.39:0/4247702958 >> 172.21.15.39:0/4247702958 conn(0x7f98d40729d0 msgr2=0x7f98d4072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- 172.21.15.39:0/4247702958 shutdown_connections 2024-04-26T23:28:17.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- 172.21.15.39:0/4247702958 wait complete. 2024-04-26T23:28:17.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 Processor -- start 2024-04-26T23:28:17.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- start start 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98d40ae850 0x7f98d4161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f5d0 0x7f98d41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98d40b6210 con 0x7f98d415f1f0 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98d4073b80 con 0x7f98d40ae850 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98d9600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f98d40b6390 con 0x7f98d415f5d0 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98cbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98cbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44230/0 (socket says 172.21.15.39:44230) 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.782+0000 7f98cbe00640 1 -- 172.21.15.39:0/2412790476 learned_addr learned my addr 172.21.15.39:0/2412790476 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98d3400640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f5d0 0x7f98d41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98d2a00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98d40ae850 0x7f98d4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 -- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f5d0 msgr2=0x7f98d41524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f5d0 0x7f98d41524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 -- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98d40ae850 msgr2=0x7f98d4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98d40ae850 0x7f98d4161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 -- 172.21.15.39:0/2412790476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d41619e0 con 0x7f98d415f1f0 2024-04-26T23:28:17.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98cbe00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f98bc01c8c0 tx=0x7f98bc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0bf070 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc0b07a0 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0b5040 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d415fa50 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d4160010 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d4050740 con 0x7f98d415f1f0 2024-04-26T23:28:17.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.786+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f98bc0b0b90 con 0x7f98d415f1f0 2024-04-26T23:28:17.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.790+0000 7f98caa00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 0x7f98b006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:17.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.790+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f98bc122fe0 con 0x7f98d415f1f0 2024-04-26T23:28:17.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.790+0000 7f98d2a00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 0x7f98b006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:17.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.790+0000 7f98d2a00640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 0x7f98b006a8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b1dc0 tx=0x7f98c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:17.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.794+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f98bc0187f0 con 0x7f98d415f1f0 2024-04-26T23:28:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.990+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98d4068890 con 0x7f98d415f1f0 2024-04-26T23:28:17.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.990+0000 7f98caa00640 1 -- 172.21.15.39:0/2412790476 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+3866 (secure 0 0 0) 0x7f98bc0f38a0 con 0x7f98d415f1f0 2024-04-26T23:28:17.996 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:17.996 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3597283177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3597283177},{"type":"v1","addr":"172.21.15.71:6836","nonce":3597283177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/797571204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":797571204},{"type":"v1","addr":"172.21.15.71:6837","nonce":797571204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1275811937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1275811937},{"type":"v1","addr":"172.21.15.39:6834","nonce":1275811937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5817,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1213168171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1213168171},{"type":"v1","addr":"172.21.15.39:6835","nonce":1213168171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-04-26T23:28:17.996 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 33 2024-04-26T23:28:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 msgr2=0x7f98b006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 0x7f98b006a8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b1dc0 tx=0x7f98c4008040 comp rx=0 tx=0).stop 2024-04-26T23:28:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 msgr2=0x7f98d41f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f98bc01c8c0 tx=0x7f98bc01ba30 comp rx=0 tx=0).stop 2024-04-26T23:28:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 shutdown_connections 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f98b0068410 0x7f98b006a8d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f98d415f5d0 0x7f98d41524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98d415f1f0 0x7f98d41f60a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 --2- 172.21.15.39:0/2412790476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98d40ae850 0x7f98d4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 >> 172.21.15.39:0/2412790476 conn(0x7f98d40729d0 msgr2=0x7f98d4163860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 shutdown_connections 2024-04-26T23:28:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:17.994+0000 7f98d9600640 1 -- 172.21.15.39:0/2412790476 wait complete. 2024-04-26T23:28:18.018 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:28:18.018 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:28:18.018 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:28:18.018 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:28:18.018 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:28:18.018 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:28:18.019 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:28:18.019 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:28:18.019 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:28:18.019 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:28:18.019 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:28:18.019 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:28:18.019 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:28:18.019 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:28:18.020 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:28:18.020 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:28:18.031 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:28:18.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:28:18.032 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:28:18.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:28:18.034 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:28:18.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:28:18.036 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:28:18.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:28:18.078 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:28:18.079 DEBUG:teuthology.parallel:result is None 2024-04-26T23:28:18.079 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:28:18.079 DEBUG:teuthology.parallel:result is None 2024-04-26T23:28:18.080 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:28:18.080 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:28:18.081 DEBUG:teuthology.parallel:result is None 2024-04-26T23:28:18.081 DEBUG:teuthology.parallel:result is None 2024-04-26T23:28:18.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:28:18.166 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-04-26T23:28:18.166 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:28:18.168 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-04-26T23:28:18.168 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-04-26T23:28:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.222+0000 7f6659e00640 1 Processor -- start 2024-04-26T23:28:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.222+0000 7f6659e00640 1 -- start start 2024-04-26T23:28:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66540d0550 0x7f66540d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f66540d1640 0x7f66540b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66540d3c40 con 0x7f665415d1d0 2024-04-26T23:28:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f66540d1a80 con 0x7f66540d1640 2024-04-26T23:28:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f66540b2350 con 0x7f66540d0550 2024-04-26T23:28:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f66540d1640 0x7f66540b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f66540d1640 0x7f66540b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44258/0 (socket says 172.21.15.39:44258) 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 -- 172.21.15.39:0/905283735 learned_addr learned my addr 172.21.15.39:0/905283735 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f664be00640 1 --2- 172.21.15.39:0/905283735 >> v2:172.21.15.71:3300/0 conn(0x7f66540d0550 0x7f66540d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 -- 172.21.15.39:0/905283735 >> v2:172.21.15.71:3300/0 conn(0x7f66540d0550 msgr2=0x7f66540d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 --2- 172.21.15.39:0/905283735 >> v2:172.21.15.71:3300/0 conn(0x7f66540d0550 0x7f66540d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 -- 172.21.15.39:0/905283735 >> v1:172.21.15.71:6789/0 conn(0x7f665415d1d0 legacy=0x7f66540cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 -- 172.21.15.39:0/905283735 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66540b2630 con 0x7f66540d1640 2024-04-26T23:28:18.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.226+0000 7f6659400640 1 --2- 172.21.15.39:0/905283735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540b33f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f66540a0dd0 tx=0x7f664c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669c2b3b937e0de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:18.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6653e00640 1 -- 172.21.15.39:0/905283735 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0a5880 con 0x7f66540d1640 2024-04-26T23:28:18.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6653e00640 1 -- 172.21.15.39:0/905283735 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c0a5a20 con 0x7f66540d1640 2024-04-26T23:28:18.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6653e00640 1 -- 172.21.15.39:0/905283735 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0a5df0 con 0x7f66540d1640 2024-04-26T23:28:18.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- 172.21.15.39:0/905283735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 msgr2=0x7f66540b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:18.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- 172.21.15.39:0/905283735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540b33f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f66540a0dd0 tx=0x7f664c01c9c0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- 172.21.15.39:0/905283735 shutdown_connections 2024-04-26T23:28:18.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- 172.21.15.39:0/905283735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540b33f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- 172.21.15.39:0/905283735 >> v2:172.21.15.71:3300/0 conn(0x7f66540d0550 0x7f66540d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- 172.21.15.39:0/905283735 >> 172.21.15.39:0/905283735 conn(0x7f66540d2e40 msgr2=0x7f66540d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:18.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- 172.21.15.39:0/905283735 shutdown_connections 2024-04-26T23:28:18.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- 172.21.15.39:0/905283735 wait complete. 2024-04-26T23:28:18.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 Processor -- start 2024-04-26T23:28:18.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- start start 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665415d1d0 0x7f66540c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66540b0c30 0x7f66540b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f66540b4140 con 0x7f66540d1640 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f665415d5b0 con 0x7f665415d1d0 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f66540b42c0 con 0x7f66540b0c30 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6658a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6658a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44260/0 (socket says 172.21.15.39:44260) 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6658a00640 1 -- 172.21.15.39:0/3528462699 learned_addr learned my addr 172.21.15.39:0/3528462699 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f664be00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665415d1d0 0x7f66540c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.230+0000 7f6659400640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66540b0c30 0x7f66540b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 -- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66540b0c30 msgr2=0x7f66540b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66540b0c30 0x7f66540b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 -- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665415d1d0 msgr2=0x7f66540c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665415d1d0 0x7f66540c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 -- 172.21.15.39:0/3528462699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66540c95b0 con 0x7f66540d1640 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6658a00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f664400c390 tx=0x7f664400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644017070 con 0x7f66540d1640 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66440052f0 con 0x7f66540d1640 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665414ec90 con 0x7f66540d1640 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644003840 con 0x7f66540d1640 2024-04-26T23:28:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665414f250 con 0x7f66540d1640 2024-04-26T23:28:18.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6654069e30 con 0x7f66540d1640 2024-04-26T23:28:18.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f664401a070 con 0x7f66540d1640 2024-04-26T23:28:18.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 0x7f663006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:18.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f6644085ab0 con 0x7f66540d1640 2024-04-26T23:28:18.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.234+0000 7f664be00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 0x7f663006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:18.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.238+0000 7f664be00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 0x7f663006a8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66540c67c0 tx=0x7f663c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:18.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.238+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66540c95b0 con 0x7f66540d1640 2024-04-26T23:28:18.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:18.418+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f66540506d0 con 0x7f66540d1640 2024-04-26T23:28:19.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6651600640 1 -- 172.21.15.39:0/3528462699 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7f6644055ba0 con 0x7f66540d1640 2024-04-26T23:28:19.365 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 msgr2=0x7f663006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 0x7f663006a8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66540c67c0 tx=0x7f663c009190 comp rx=0 tx=0).stop 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 msgr2=0x7f66540c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f664400c390 tx=0x7f664400c850 comp rx=0 tx=0).stop 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 shutdown_connections 2024-04-26T23:28:19.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6630068410 0x7f663006a8d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66540b0c30 0x7f66540b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665415d1d0 0x7f66540c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 --2- 172.21.15.39:0/3528462699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66540d1640 0x7f66540c6a90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 >> 172.21.15.39:0/3528462699 conn(0x7f66540d2e40 msgr2=0x7f66540d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 shutdown_connections 2024-04-26T23:28:19.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.362+0000 7f6659e00640 1 -- 172.21.15.39:0/3528462699 wait complete. 2024-04-26T23:28:19.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:28:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 Processor -- start 2024-04-26T23:28:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 -- start start 2024-04-26T23:28:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb3700732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb3700b17d0 0x7fb37006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3700ce9a0 0x7fb37006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb370161a20 con 0x7fb3700ce9a0 2024-04-26T23:28:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb370160e10 con 0x7fb3700b17d0 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb376400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb3701610f0 con 0x7fb370146b50 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3700ce9a0 0x7fb37006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3700ce9a0 0x7fb37006c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44268/0 (socket says 172.21.15.39:44268) 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 -- 172.21.15.39:0/1709658249 learned_addr learned my addr 172.21.15.39:0/1709658249 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36f400640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb3700732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb366a00640 1 --2- 172.21.15.39:0/1709658249 >> v2:172.21.15.71:3300/0 conn(0x7fb3700b17d0 0x7fb37006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 -- 172.21.15.39:0/1709658249 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 msgr2=0x7fb3700732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb3700732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 -- 172.21.15.39:0/1709658249 >> v2:172.21.15.71:3300/0 conn(0x7fb3700b17d0 msgr2=0x7fb37006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 --2- 172.21.15.39:0/1709658249 >> v2:172.21.15.71:3300/0 conn(0x7fb3700b17d0 0x7fb37006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.534+0000 7fb36fe00640 1 -- 172.21.15.39:0/1709658249 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3701613d0 con 0x7fb3700ce9a0 2024-04-26T23:28:19.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb36fe00640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700ce9a0 0x7fb37006c910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb37006e440 tx=0x7fb36801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cec25827376679b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb36ea00640 1 -- 172.21.15.39:0/1709658249 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3680a5890 con 0x7fb3700ce9a0 2024-04-26T23:28:19.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb36ea00640 1 -- 172.21.15.39:0/1709658249 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3680a5a30 con 0x7fb3700ce9a0 2024-04-26T23:28:19.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb36ea00640 1 -- 172.21.15.39:0/1709658249 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3680a5e00 con 0x7fb3700ce9a0 2024-04-26T23:28:19.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 -- 172.21.15.39:0/1709658249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700ce9a0 msgr2=0x7fb37006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700ce9a0 0x7fb37006c910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb37006e440 tx=0x7fb36801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 -- 172.21.15.39:0/1709658249 shutdown_connections 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700ce9a0 0x7fb37006c910 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 --2- 172.21.15.39:0/1709658249 >> v2:172.21.15.71:3300/0 conn(0x7fb3700b17d0 0x7fb37006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 --2- 172.21.15.39:0/1709658249 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb3700732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 -- 172.21.15.39:0/1709658249 >> 172.21.15.39:0/1709658249 conn(0x7fb37006f550 msgr2=0x7fb37006f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 -- 172.21.15.39:0/1709658249 shutdown_connections 2024-04-26T23:28:19.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.538+0000 7fb376400640 1 -- 172.21.15.39:0/1709658249 wait complete. 2024-04-26T23:28:19.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 Processor -- start 2024-04-26T23:28:19.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- start start 2024-04-26T23:28:19.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3700ce9a0 0x7fb3701668f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb370145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb370071500 con 0x7fb3700b17d0 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb370071380 con 0x7fb3700ce9a0 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb370071680 con 0x7fb370146b50 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44276/0 (socket says 172.21.15.39:44276) 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 -- 172.21.15.39:0/3318741444 learned_addr learned my addr 172.21.15.39:0/3318741444 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb366a00640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3700ce9a0 0x7fb3701668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36fe00640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb370145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 -- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 msgr2=0x7fb370145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb370145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 -- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3700ce9a0 msgr2=0x7fb3701668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3700ce9a0 0x7fb3701668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 -- 172.21.15.39:0/3318741444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3700b2ef0 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb36f400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d5f0 tx=0x7fb36000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3600125f0 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360019070 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3600129b0 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3700b31d0 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3700b3790 con 0x7fb3700b17d0 2024-04-26T23:28:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.542+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb370050740 con 0x7fb3700b17d0 2024-04-26T23:28:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.546+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb360012b50 con 0x7fb3700b17d0 2024-04-26T23:28:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.546+0000 7fb367e00640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 0x7fb34c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.546+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7fb360086a50 con 0x7fb3700b17d0 2024-04-26T23:28:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.546+0000 7fb366a00640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 0x7fb34c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.546+0000 7fb366a00640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 0x7fb34c06a8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb370142b60 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.550+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb360056c20 con 0x7fb3700b17d0 2024-04-26T23:28:19.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb370167770 con 0x7fb3700b17d0 2024-04-26T23:28:19.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb367e00640 1 -- 172.21.15.39:0/3318741444 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fb36005af20 con 0x7fb3700b17d0 2024-04-26T23:28:19.781 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqV33LRAAEJGRcr66jyYjplL5wl+brg==", 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmxfZIOhAAqBAlj+xssqRyWvvbCYfPwA==", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmSwdTNRAA9WY84j6z2N65LmrYLj+lYA==", 2024-04-26T23:28:19.783 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmau88BhAAGTd6/z68e7znV/KHRCCDGA==", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:28:19.784 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDdNyxmZuaFKhAAsfRLhoI4+QYnw9ufIR28iA==", 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2024-04-26T23:28:19.785 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDgNyxmPDO6NBAAdHN3Ijn/eE9d0sEomTfEtw==", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDkNyxmTFCfAhAA/Q6nJAECSWB/CwTzLIV3rA==", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.786 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDnNyxmh9LLCxAA+qQSaClk3U21trpe22vj3A==", 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2024-04-26T23:28:19.787 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDtNyxmbifsBRAAjNjFGc0ejjAFGEcIugsBvA==", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDwNyxmnTs7ERAA//zGSDQBvm2tcRzZTOlNvA==", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.788 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDzNyxm5C8dHBAAeWFaQRTmZVLQqrfyScFj3A==", 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2024-04-26T23:28:19.789 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQD2Nyxmek04JRAALoMi3/NJ6Sp0Lfx6VeWKWA==", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g==", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow r", 2024-04-26T23:28:19.790 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmTGgYFBAAVTR5yp7RgxU5styz5dROGw==", 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.791 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmT9aVEBAAib2ep6XrtA1R8JCqVmQbRw==", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDXNyxmMDXpGRAA9orIW7EXyWBNIend4Gr4pA==", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-04-26T23:28:19.792 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxm5J90ERAA9DJ7JqkuVegQd3DC6U1UCA==", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.793 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmW4xWKRAA7+rz/WwBsBWQ5XhHVOvfkQ==", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDWNyxmqK9rJRAA9aE1iwhQtH0eYlqn5obd/A==", 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-04-26T23:28:19.794 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-04-26T23:28:19.795 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 msgr2=0x7fb34c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 0x7fb34c06a8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb370142b60 tx=0x7fb358008040 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 msgr2=0x7fb3701f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d5f0 tx=0x7fb36000dab0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 shutdown_connections 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb34c068410 0x7fb34c06a8d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb370146b50 0x7fb370145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3700ce9a0 0x7fb3701668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 --2- 172.21.15.39:0/3318741444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3700b17d0 0x7fb3701f7ed0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 >> 172.21.15.39:0/3318741444 conn(0x7fb37006f550 msgr2=0x7fb37015ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:19.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 shutdown_connections 2024-04-26T23:28:19.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.778+0000 7fb376400640 1 -- 172.21.15.39:0/3318741444 wait complete. 2024-04-26T23:28:19.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:19.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 Processor -- start 2024-04-26T23:28:19.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 -- start start 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb3815d170 0x7fcb380b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb3809c0f0 0x7fcb380c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb3809c7a0 con 0x7fcb380d1640 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fcb380c6be0 con 0x7fcb3809c0f0 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb40000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcb380d1b70 con 0x7fcb3815d170 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3cc00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcb380d1640 0x7fcb3809b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34100/0 (socket says 172.21.15.39:34100) 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3e000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcb3809c0f0 0x7fcb380c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3cc00640 1 -- 172.21.15.39:0/1718613333 learned_addr learned my addr 172.21.15.39:0/1718613333 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3d600640 1 --2- 172.21.15.39:0/1718613333 >> v2:172.21.15.71:3300/0 conn(0x7fcb3815d170 0x7fcb380b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3e000640 1 -- 172.21.15.39:0/1718613333 >> v2:172.21.15.71:3300/0 conn(0x7fcb3815d170 msgr2=0x7fcb380b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3e000640 1 --2- 172.21.15.39:0/1718613333 >> v2:172.21.15.71:3300/0 conn(0x7fcb3815d170 0x7fcb380b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3e000640 1 -- 172.21.15.39:0/1718613333 >> v1:172.21.15.39:6789/0 conn(0x7fcb380d1640 legacy=0x7fcb3809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb3e000640 1 -- 172.21.15.39:0/1718613333 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380d1e50 con 0x7fcb3809c0f0 2024-04-26T23:28:19.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.942+0000 7fcb37e00640 1 -- 172.21.15.39:0/1718613333 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208224693 0 0) 0x7fcb3809c7a0 con 0x7fcb380d1640 2024-04-26T23:28:19.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb3e000640 1 --2- 172.21.15.39:0/1718613333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3809c0f0 0x7fcb380c7630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcb38074870 tx=0x7fcb3001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2bbe661314f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb37e00640 1 -- 172.21.15.39:0/1718613333 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300b2070 con 0x7fcb3809c0f0 2024-04-26T23:28:19.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb37e00640 1 -- 172.21.15.39:0/1718613333 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb300a58e0 con 0x7fcb3809c0f0 2024-04-26T23:28:19.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb37e00640 1 -- 172.21.15.39:0/1718613333 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300a5cb0 con 0x7fcb3809c0f0 2024-04-26T23:28:19.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 -- 172.21.15.39:0/1718613333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3809c0f0 msgr2=0x7fcb380c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 --2- 172.21.15.39:0/1718613333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3809c0f0 0x7fcb380c7630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcb38074870 tx=0x7fcb3001c930 comp rx=0 tx=0).stop 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 -- 172.21.15.39:0/1718613333 shutdown_connections 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 --2- 172.21.15.39:0/1718613333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3809c0f0 0x7fcb380c7630 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 --2- 172.21.15.39:0/1718613333 >> v2:172.21.15.71:3300/0 conn(0x7fcb3815d170 0x7fcb380b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 -- 172.21.15.39:0/1718613333 >> 172.21.15.39:0/1718613333 conn(0x7fcb380b4b80 msgr2=0x7fcb380b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 -- 172.21.15.39:0/1718613333 shutdown_connections 2024-04-26T23:28:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.946+0000 7fcb40000640 1 -- 172.21.15.39:0/1718613333 wait complete. 2024-04-26T23:28:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 Processor -- start 2024-04-26T23:28:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- start start 2024-04-26T23:28:19.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb3809c0f0 0x7fcb3815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb380d1640 0x7fcb380b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380c8710 con 0x7fcb3815d170 2024-04-26T23:28:19.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380c8590 con 0x7fcb380d1640 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb380c8890 con 0x7fcb3809c0f0 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44298/0 (socket says 172.21.15.39:44298) 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 -- 172.21.15.39:0/1977634176 learned_addr learned my addr 172.21.15.39:0/1977634176 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3cc00640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb380d1640 0x7fcb380b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3d600640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb3809c0f0 0x7fcb3815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 -- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb3809c0f0 msgr2=0x7fcb3815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb3809c0f0 0x7fcb3815bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 -- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb380d1640 msgr2=0x7fcb380b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb380d1640 0x7fcb380b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 -- 172.21.15.39:0/1977634176 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380b6f50 con 0x7fcb3815d170 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb3e000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcb30019540 tx=0x7fcb300196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300bd020 con 0x7fcb3815d170 2024-04-26T23:28:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb300b3040 con 0x7fcb3815d170 2024-04-26T23:28:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300b2050 con 0x7fcb3815d170 2024-04-26T23:28:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb380b8490 con 0x7fcb3815d170 2024-04-26T23:28:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb380b8a50 con 0x7fcb3815d170 2024-04-26T23:28:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.950+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38050740 con 0x7fcb3815d170 2024-04-26T23:28:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.954+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fcb300a5760 con 0x7fcb3815d170 2024-04-26T23:28:19.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.954+0000 7fcb35600640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 0x7fcb1806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:19.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.954+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7fcb301211a0 con 0x7fcb3815d170 2024-04-26T23:28:19.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.954+0000 7fcb3d600640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 0x7fcb1806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:19.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.954+0000 7fcb3d600640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 0x7fcb1806a8d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009ac0 tx=0x7fcb2c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:19.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:19.958+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb300c7020 con 0x7fcb3815d170 2024-04-26T23:28:20.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.126+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb380b6320 con 0x7fcb3815d170 2024-04-26T23:28:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.126+0000 7fcb35600640 1 -- 172.21.15.39:0/1977634176 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+12831 (secure 0 0 0) 0x7fcb30016520 con 0x7fcb3815d170 2024-04-26T23:28:20.132 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:20.132 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":59,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:19.361415+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 msgr2=0x7fcb1806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 0x7fcb1806a8d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009ac0 tx=0x7fcb2c009190 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 msgr2=0x7fcb380cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcb30019540 tx=0x7fcb300196d0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 shutdown_connections 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb18068410 0x7fcb1806a8d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3815d170 0x7fcb380cf2c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb380d1640 0x7fcb380b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 --2- 172.21.15.39:0/1977634176 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb3809c0f0 0x7fcb3815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 >> 172.21.15.39:0/1977634176 conn(0x7fcb380b4b80 msgr2=0x7fcb38160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 shutdown_connections 2024-04-26T23:28:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.130+0000 7fcb40000640 1 -- 172.21.15.39:0/1977634176 wait complete. 2024-04-26T23:28:20.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:28:20.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:28:20.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 Processor -- start 2024-04-26T23:28:20.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 -- start start 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f95b8161850 0x7f95b80d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b80d1720 0x7f95b80cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b806e500 con 0x7f95b8140170 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f95b806f110 con 0x7f95b80d1720 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f95b806e7e0 con 0x7f95b8161850 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b80d1720 0x7f95b80cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95b7e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f95b8140170 0x7f95b815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42650/0 (socket says 172.21.15.39:42650) 2024-04-26T23:28:20.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b80d1720 0x7f95b80cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43624/0 (socket says 172.21.15.39:43624) 2024-04-26T23:28:20.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95b7e00640 1 -- 172.21.15.39:0/3538487079 learned_addr learned my addr 172.21.15.39:0/3538487079 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:20.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95af400640 1 --2- 172.21.15.39:0/3538487079 >> v2:172.21.15.71:3300/0 conn(0x7f95b8161850 0x7f95b80d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 -- 172.21.15.39:0/3538487079 >> v2:172.21.15.71:3300/0 conn(0x7f95b8161850 msgr2=0x7f95b80d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:20.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 --2- 172.21.15.39:0/3538487079 >> v2:172.21.15.71:3300/0 conn(0x7f95b8161850 0x7f95b80d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 -- 172.21.15.39:0/3538487079 >> v1:172.21.15.39:6789/0 conn(0x7f95b8140170 legacy=0x7f95b815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95bcc00640 1 -- 172.21.15.39:0/3538487079 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b806eac0 con 0x7f95b80d1720 2024-04-26T23:28:20.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.294+0000 7f95b7400640 1 -- 172.21.15.39:0/3538487079 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128537350 0 0) 0x7f95b806e500 con 0x7f95b8140170 2024-04-26T23:28:20.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bcc00640 1 --2- 172.21.15.39:0/3538487079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b80cf6f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f95b8072270 tx=0x7f95b001ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da2dc95c7f6a08a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95b7400640 1 -- 172.21.15.39:0/3538487079 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b00b0070 con 0x7f95b80d1720 2024-04-26T23:28:20.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95b7400640 1 -- 172.21.15.39:0/3538487079 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b00ab600 con 0x7f95b80d1720 2024-04-26T23:28:20.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95b7400640 1 -- 172.21.15.39:0/3538487079 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b00ab9d0 con 0x7f95b80d1720 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 -- 172.21.15.39:0/3538487079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 msgr2=0x7f95b80cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 --2- 172.21.15.39:0/3538487079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b80cf6f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f95b8072270 tx=0x7f95b001ce10 comp rx=0 tx=0).stop 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 -- 172.21.15.39:0/3538487079 shutdown_connections 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 --2- 172.21.15.39:0/3538487079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b80cf6f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 --2- 172.21.15.39:0/3538487079 >> v2:172.21.15.71:3300/0 conn(0x7f95b8161850 0x7f95b80d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 -- 172.21.15.39:0/3538487079 >> 172.21.15.39:0/3538487079 conn(0x7f95b806c7d0 msgr2=0x7f95b806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 -- 172.21.15.39:0/3538487079 shutdown_connections 2024-04-26T23:28:20.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.298+0000 7f95bec00640 1 -- 172.21.15.39:0/3538487079 wait complete. 2024-04-26T23:28:20.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 Processor -- start 2024-04-26T23:28:20.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- start start 2024-04-26T23:28:20.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b8140170 0x7f95b80b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f95b8161850 0x7f95b81415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80d07d0 con 0x7f95b80d1720 2024-04-26T23:28:20.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80d0650 con 0x7f95b8140170 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f95b80d0950 con 0x7f95b8161850 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43634/0 (socket says 172.21.15.39:43634) 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 -- 172.21.15.39:0/2408445302 learned_addr learned my addr 172.21.15.39:0/2408445302 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95af400640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b8140170 0x7f95b80b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bcc00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f95b8161850 0x7f95b81415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 -- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f95b8161850 msgr2=0x7f95b81415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f95b8161850 0x7f95b81415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 -- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b8140170 msgr2=0x7f95b80b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b8140170 0x7f95b80b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 -- 172.21.15.39:0/2408445302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b813afd0 con 0x7f95b80d1720 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b7e00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001570 tx=0x7f95a800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8018070 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a800a640 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a800aa30 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b81435b0 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.302+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b813b800 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b813b350 con 0x7f95b80d1720 2024-04-26T23:28:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f95a801b070 con 0x7f95b80d1720 2024-04-26T23:28:20.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95b4c00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 0x7f959406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7f95a8085d60 con 0x7f95b80d1720 2024-04-26T23:28:20.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95af400640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 0x7f959406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.306+0000 7f95af400640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 0x7f959406a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f95b8160d30 tx=0x7f95a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.310+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f95a8055f30 con 0x7f95b80d1720 2024-04-26T23:28:20.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.478+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95b806fdc0 con 0x7f95b80d1720 2024-04-26T23:28:20.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.478+0000 7f95b4c00640 1 -- 172.21.15.39:0/2408445302 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f95a805a230 con 0x7f95b80d1720 2024-04-26T23:28:20.483 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 msgr2=0x7f959406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 0x7f959406a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f95b8160d30 tx=0x7f95a0008040 comp rx=0 tx=0).stop 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 msgr2=0x7f95b81535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001570 tx=0x7f95a800cd20 comp rx=0 tx=0).stop 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 shutdown_connections 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9594068410 0x7f959406a8d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f95b8161850 0x7f95b81415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b8140170 0x7f95b80b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 --2- 172.21.15.39:0/2408445302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b80d1720 0x7f95b81535d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 >> 172.21.15.39:0/2408445302 conn(0x7f95b806c7d0 msgr2=0x7f95b813f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 shutdown_connections 2024-04-26T23:28:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.482+0000 7f95bec00640 1 -- 172.21.15.39:0/2408445302 wait complete. 2024-04-26T23:28:20.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:28:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.638+0000 7f2d33800640 1 Processor -- start 2024-04-26T23:28:20.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 -- start start 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2d2c145820 0x7f2d2c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c06fc80 0x7f2d2c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2c160060 con 0x7f2d2c0b4950 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2c0cd5c0 con 0x7f2d2c145820 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d33800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c160340 con 0x7f2d2c06fc80 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2d2c145820 0x7f2d2c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2d2c145820 0x7f2d2c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43642/0 (socket says 172.21.15.39:43642) 2024-04-26T23:28:20.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 -- 172.21.15.39:0/1195006274 learned_addr learned my addr 172.21.15.39:0/1195006274 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d31800640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c06fc80 0x7f2d2c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 -- 172.21.15.39:0/1195006274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c06fc80 msgr2=0x7f2d2c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c06fc80 0x7f2d2c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 -- 172.21.15.39:0/1195006274 >> v1:172.21.15.71:6789/0 conn(0x7f2d2c0b4950 legacy=0x7f2d2c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.642+0000 7f2d30e00640 1 -- 172.21.15.39:0/1195006274 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c160620 con 0x7f2d2c145820 2024-04-26T23:28:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d30e00640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c0cf2a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665608191b04d371 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d2be00640 1 -- 172.21.15.39:0/1195006274 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a9610 con 0x7f2d2c145820 2024-04-26T23:28:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d2be00640 1 -- 172.21.15.39:0/1195006274 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a97b0 con 0x7f2d2c145820 2024-04-26T23:28:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d2be00640 1 -- 172.21.15.39:0/1195006274 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a9b80 con 0x7f2d2c145820 2024-04-26T23:28:20.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- 172.21.15.39:0/1195006274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 msgr2=0x7f2d2c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c0cf2a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01c530 comp rx=0 tx=0).stop 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- 172.21.15.39:0/1195006274 shutdown_connections 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c06fc80 0x7f2d2c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 --2- 172.21.15.39:0/1195006274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c0cf2a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- 172.21.15.39:0/1195006274 >> 172.21.15.39:0/1195006274 conn(0x7f2d2c0b2af0 msgr2=0x7f2d2c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- 172.21.15.39:0/1195006274 shutdown_connections 2024-04-26T23:28:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- 172.21.15.39:0/1195006274 wait complete. 2024-04-26T23:28:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 Processor -- start 2024-04-26T23:28:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.646+0000 7f2d33800640 1 -- start start 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d2c06fc80 0x7f2d2c0b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 0x7f2d2c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c0ce260 con 0x7f2d2c145820 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c15fe40 con 0x7f2d2c06fc80 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c0ce3e0 con 0x7f2d2c0b4950 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43654/0 (socket says 172.21.15.39:43654) 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d30e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d2c06fc80 0x7f2d2c0b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 -- 172.21.15.39:0/2961804328 learned_addr learned my addr 172.21.15.39:0/2961804328 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d23e00640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 0x7f2d2c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 -- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 msgr2=0x7f2d2c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 0x7f2d2c0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 -- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d2c06fc80 msgr2=0x7f2d2c0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d2c06fc80 0x7f2d2c0b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 -- 172.21.15.39:0/2961804328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c1f8790 con 0x7f2d2c145820 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d23e00640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 0x7f2d2c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:20.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d31800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2d24007e40 tx=0x7f2d2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24014620 con 0x7f2d2c145820 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d24019070 con 0x7f2d2c145820 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24014a20 con 0x7f2d2c145820 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1f8a70 con 0x7f2d2c145820 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c1f9030 con 0x7f2d2c145820 2024-04-26T23:28:20.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.650+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c050740 con 0x7f2d2c145820 2024-04-26T23:28:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.654+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2d24014bc0 con 0x7f2d2c145820 2024-04-26T23:28:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.654+0000 7f2d29600640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 0x7f2d0806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.654+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7f2d24086e40 con 0x7f2d2c145820 2024-04-26T23:28:20.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.654+0000 7f2d30e00640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 0x7f2d0806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.654+0000 7f2d30e00640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 0x7f2d0806a8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ae000 tx=0x7f2d1c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:20.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.658+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2d240577f0 con 0x7f2d2c145820 2024-04-26T23:28:20.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.822+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2d2c145030 con 0x7f2d2c145820 2024-04-26T23:28:20.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d29600640 1 -- 172.21.15.39:0/2961804328 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7f2d240570f0 con 0x7f2d2c145820 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:20.829 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 msgr2=0x7f2d0806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 0x7f2d0806a8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ae000 tx=0x7f2d1c0b3040 comp rx=0 tx=0).stop 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 msgr2=0x7f2d2c13b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2d24007e40 tx=0x7f2d2400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 shutdown_connections 2024-04-26T23:28:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2d08068410 0x7f2d0806a8d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2c145820 0x7f2d2c13b0f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d2c0b4950 0x7f2d2c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 --2- 172.21.15.39:0/2961804328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d2c06fc80 0x7f2d2c0b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 >> 172.21.15.39:0/2961804328 conn(0x7f2d2c0b2af0 msgr2=0x7f2d2c15cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 shutdown_connections 2024-04-26T23:28:20.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.826+0000 7f2d33800640 1 -- 172.21.15.39:0/2961804328 wait complete. 2024-04-26T23:28:20.849 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:28:20.850 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:28:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.990+0000 7ff9a8400640 1 Processor -- start 2024-04-26T23:28:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.990+0000 7ff9a8400640 1 -- start start 2024-04-26T23:28:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.990+0000 7ff9a8400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 0x7ff9a0074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.990+0000 7ff9a8400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9a01613d0 0x7ff9a00b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a8400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a00b4280 con 0x7ff9a00b3df0 2024-04-26T23:28:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a8400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a006edd0 con 0x7ff9a01613d0 2024-04-26T23:28:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a8400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a0072620 con 0x7ff9a01468a0 2024-04-26T23:28:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9a01613d0 0x7ff9a00b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a5000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff9a00b3df0 0x7ff9a0160cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:44332/0 (socket says 172.21.15.39:44332) 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a5000640 1 -- 172.21.15.39:0/1184812600 learned_addr learned my addr 172.21.15.39:0/1184812600 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a5a00640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 0x7ff9a0074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 -- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 msgr2=0x7ff9a0074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 0x7ff9a0074180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 -- 172.21.15.39:0/1184812600 >> v1:172.21.15.71:6789/0 conn(0x7ff9a00b3df0 legacy=0x7ff9a0160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 -- 172.21.15.39:0/1184812600 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a006f020 con 0x7ff9a01613d0 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a5a00640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 0x7ff9a0074180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff99fe00640 1 -- 172.21.15.39:0/1184812600 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2813251854 0 0) 0x7ff9a00b4280 con 0x7ff9a00b3df0 2024-04-26T23:28:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.994+0000 7ff9a6400640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a01613d0 0x7ff9a00b5970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff998009d90 tx=0x7ff99801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b3797f890eb9cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff99fe00640 1 -- 172.21.15.39:0/1184812600 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980b2070 con 0x7ff9a01613d0 2024-04-26T23:28:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff99fe00640 1 -- 172.21.15.39:0/1184812600 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9980a5710 con 0x7ff9a01613d0 2024-04-26T23:28:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff99fe00640 1 -- 172.21.15.39:0/1184812600 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a5ae0 con 0x7ff9a01613d0 2024-04-26T23:28:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a01613d0 msgr2=0x7ff9a00b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a01613d0 0x7ff9a00b5970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff998009d90 tx=0x7ff99801c850 comp rx=0 tx=0).stop 2024-04-26T23:28:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/1184812600 shutdown_connections 2024-04-26T23:28:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a01613d0 0x7ff9a00b5970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/1184812600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01468a0 0x7ff9a0074180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/1184812600 >> 172.21.15.39:0/1184812600 conn(0x7ff9a00b2cc0 msgr2=0x7ff9a00b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/1184812600 shutdown_connections 2024-04-26T23:28:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/1184812600 wait complete. 2024-04-26T23:28:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 Processor -- start 2024-04-26T23:28:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- start start 2024-04-26T23:28:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 0x7ff9a013f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 0x7ff9a013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0073440 con 0x7ff9a01468a0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a00732c0 con 0x7ff9a015ad70 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:20.998+0000 7ff9a8400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a00735c0 con 0x7ff9a01613d0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43664/0 (socket says 172.21.15.39:43664) 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 -- 172.21.15.39:0/4064520565 learned_addr learned my addr 172.21.15.39:0/4064520565 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a6400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 0x7ff9a013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5000640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 0x7ff9a013f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 -- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 msgr2=0x7ff9a013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 0x7ff9a013f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 -- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 msgr2=0x7ff9a013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 0x7ff9a013fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 -- 172.21.15.39:0/4064520565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a00cfe30 con 0x7ff9a01468a0 2024-04-26T23:28:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a6400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 0x7ff9a013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5000640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 0x7ff9a013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a5a00640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff99400e980 tx=0x7ff99400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994017070 con 0x7ff9a01468a0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99400ca00 con 0x7ff9a01468a0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a01440f0 con 0x7ff9a01468a0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99400cdd0 con 0x7ff9a01468a0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a015d6d0 con 0x7ff9a01468a0 2024-04-26T23:28:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a0050740 con 0x7ff9a01468a0 2024-04-26T23:28:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.002+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7ff99401a070 con 0x7ff9a01468a0 2024-04-26T23:28:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.006+0000 7ff99d600640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 0x7ff98006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.006+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7ff994086a00 con 0x7ff9a01468a0 2024-04-26T23:28:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.006+0000 7ff9a5000640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 0x7ff98006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.006+0000 7ff9a5000640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 0x7ff98006a8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015a6b0 tx=0x7ff98c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.010+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff994057220 con 0x7ff9a01468a0 2024-04-26T23:28:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.174+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff9a01401d0 con 0x7ff9a01468a0 2024-04-26T23:28:22.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff99d600640 1 -- 172.21.15.39:0/4064520565 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7ff994056b20 con 0x7ff9a01468a0 2024-04-26T23:28:22.001 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 msgr2=0x7ff98006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 0x7ff98006a8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015a6b0 tx=0x7ff98c009040 comp rx=0 tx=0).stop 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 msgr2=0x7ff9a013cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff99400e980 tx=0x7ff99400ee40 comp rx=0 tx=0).stop 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 shutdown_connections 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff980068410 0x7ff98006a8d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a015ad70 0x7ff9a013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9a01613d0 0x7ff9a013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 --2- 172.21.15.39:0/4064520565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a01468a0 0x7ff9a013cab0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 >> 172.21.15.39:0/4064520565 conn(0x7ff9a00b2cc0 msgr2=0x7ff9a00b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:22.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 shutdown_connections 2024-04-26T23:28:22.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:21.998+0000 7ff9a8400640 1 -- 172.21.15.39:0/4064520565 wait complete. 2024-04-26T23:28:22.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:28:22.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.174+0000 7f4cd4200640 1 Processor -- start 2024-04-26T23:28:22.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.174+0000 7f4cd4200640 1 -- start start 2024-04-26T23:28:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd4200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ccc140170 0x7f4ccc15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd4200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd4200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc06e500 con 0x7f4ccc15e340 2024-04-26T23:28:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd4200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc06f110 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd4200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc06e7e0 con 0x7f4ccc140170 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43676/0 (socket says 172.21.15.39:43676) 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 -- 172.21.15.39:0/1979717155 learned_addr learned my addr 172.21.15.39:0/1979717155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd1800640 1 --2- 172.21.15.39:0/1979717155 >> v2:172.21.15.71:3300/0 conn(0x7f4ccc140170 0x7f4ccc15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 -- 172.21.15.39:0/1979717155 >> v2:172.21.15.71:3300/0 conn(0x7f4ccc140170 msgr2=0x7f4ccc15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 --2- 172.21.15.39:0/1979717155 >> v2:172.21.15.71:3300/0 conn(0x7f4ccc140170 0x7f4ccc15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 -- 172.21.15.39:0/1979717155 >> v1:172.21.15.39:6789/0 conn(0x7f4ccc15e340 legacy=0x7f4ccc0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.178+0000 7f4cd2200640 1 -- 172.21.15.39:0/1979717155 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc06eac0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd2200640 1 --2- 172.21.15.39:0/1979717155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0b64c0 tx=0x7f4cc401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612357aeaa174fd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:22.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4ccbe00640 1 -- 172.21.15.39:0/1979717155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40a5810 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4ccbe00640 1 -- 172.21.15.39:0/1979717155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc40a59b0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4ccbe00640 1 -- 172.21.15.39:0/1979717155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40a5d80 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- 172.21.15.39:0/1979717155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 msgr2=0x7f4ccc0cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- 172.21.15.39:0/1979717155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0b64c0 tx=0x7f4cc401c8f0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- 172.21.15.39:0/1979717155 shutdown_connections 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- 172.21.15.39:0/1979717155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0cf6f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- 172.21.15.39:0/1979717155 >> v2:172.21.15.71:3300/0 conn(0x7f4ccc140170 0x7f4ccc15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- 172.21.15.39:0/1979717155 >> 172.21.15.39:0/1979717155 conn(0x7f4ccc06c7d0 msgr2=0x7f4ccc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- 172.21.15.39:0/1979717155 shutdown_connections 2024-04-26T23:28:22.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- 172.21.15.39:0/1979717155 wait complete. 2024-04-26T23:28:22.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 Processor -- start 2024-04-26T23:28:22.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- start start 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 0x7f4ccc1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ccc15e340 0x7f4ccc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0d07d0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0d0650 con 0x7f4ccc140170 2024-04-26T23:28:22.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd4200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc0d0950 con 0x7f4ccc15e340 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd1800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd1800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43688/0 (socket says 172.21.15.39:43688) 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.182+0000 7f4cd1800640 1 -- 172.21.15.39:0/3107733097 learned_addr learned my addr 172.21.15.39:0/3107733097 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd2200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ccc15e340 0x7f4ccc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd0e00640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 0x7f4ccc1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 -- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ccc15e340 msgr2=0x7f4ccc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ccc15e340 0x7f4ccc1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 -- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 msgr2=0x7f4ccc1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 0x7f4ccc1407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 -- 172.21.15.39:0/3107733097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc136cb0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd0e00640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 0x7f4ccc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:22.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd1800640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e930 tx=0x7f4cc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0017070 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc000ca00 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000cdb0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc136f90 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc137550 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc139680 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4cc001a070 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.186+0000 7f4cc9600640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 0x7f4cac06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:22.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.190+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5227+0+0 (secure 0 0 0) 0x7f4cc0086cd0 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.190+0000 7f4cd0e00640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 0x7f4cac06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:22.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.190+0000 7f4cd0e00640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 0x7f4cac06a8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc157ad0 tx=0x7f4cb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:22.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.194+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4cc0057440 con 0x7f4ccc0d18f0 2024-04-26T23:28:22.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.358+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4ccc06a720 con 0x7f4ccc0d18f0 2024-04-26T23:28:23.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:22.998+0000 7f4cc9600640 1 -- 172.21.15.39:0/3107733097 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7f4cc0056d40 con 0x7f4ccc0d18f0 2024-04-26T23:28:23.004 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 msgr2=0x7f4cac06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 0x7f4cac06a8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc157ad0 tx=0x7f4cb8009040 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 msgr2=0x7f4ccc0b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e930 tx=0x7f4cc000edf0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 shutdown_connections 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4cac068410 0x7f4cac06a8d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ccc15e340 0x7f4ccc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ccc140170 0x7f4ccc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 --2- 172.21.15.39:0/3107733097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ccc0d18f0 0x7f4ccc0b1ea0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 >> 172.21.15.39:0/3107733097 conn(0x7f4ccc06c7d0 msgr2=0x7f4ccc073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 shutdown_connections 2024-04-26T23:28:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.002+0000 7f4cd4200640 1 -- 172.21.15.39:0/3107733097 wait complete. 2024-04-26T23:28:23.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:28:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 Processor -- start 2024-04-26T23:28:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 -- start start 2024-04-26T23:28:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a58161850 0x7f0a580d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a580d1720 0x7f0a580cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5806e500 con 0x7f0a58140170 2024-04-26T23:28:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0a5806f110 con 0x7f0a580d1720 2024-04-26T23:28:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5f800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5806e7e0 con 0x7f0a58161850 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a580d1720 0x7f0a580cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a580d1720 0x7f0a580cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43704/0 (socket says 172.21.15.39:43704) 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 -- 172.21.15.39:0/2212048677 learned_addr learned my addr 172.21.15.39:0/2212048677 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a57e00640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a58161850 0x7f0a580d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 -- 172.21.15.39:0/2212048677 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a58161850 msgr2=0x7f0a580d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a58161850 0x7f0a580d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 -- 172.21.15.39:0/2212048677 >> v1:172.21.15.71:6789/0 conn(0x7f0a58140170 legacy=0x7f0a5815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.182+0000 7f0a5d800640 1 -- 172.21.15.39:0/2212048677 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5806eac0 con 0x7f0a580d1720 2024-04-26T23:28:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5d800640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a580d1720 0x7f0a580cf6f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009e50 tx=0x7f0a5001d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06bc7ef267ae0d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a57400640 1 -- 172.21.15.39:0/2212048677 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500a5810 con 0x7f0a580d1720 2024-04-26T23:28:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a57400640 1 -- 172.21.15.39:0/2212048677 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500a59b0 con 0x7f0a580d1720 2024-04-26T23:28:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a57400640 1 -- 172.21.15.39:0/2212048677 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500a5d80 con 0x7f0a580d1720 2024-04-26T23:28:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 -- 172.21.15.39:0/2212048677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a580d1720 msgr2=0x7f0a580cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a580d1720 0x7f0a580cf6f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009e50 tx=0x7f0a5001d450 comp rx=0 tx=0).stop 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 -- 172.21.15.39:0/2212048677 shutdown_connections 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a580d1720 0x7f0a580cf6f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 --2- 172.21.15.39:0/2212048677 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a58161850 0x7f0a580d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 -- 172.21.15.39:0/2212048677 >> 172.21.15.39:0/2212048677 conn(0x7f0a5806c7d0 msgr2=0x7f0a5806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 -- 172.21.15.39:0/2212048677 shutdown_connections 2024-04-26T23:28:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.186+0000 7f0a5f800640 1 -- 172.21.15.39:0/2212048677 wait complete. 2024-04-26T23:28:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 Processor -- start 2024-04-26T23:28:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- start start 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a580d1720 0x7f0a58153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a58140170 0x7f0a5813a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a580d07d0 con 0x7f0a58161850 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a580d0650 con 0x7f0a58140170 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0a580d0950 con 0x7f0a580d1720 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43720/0 (socket says 172.21.15.39:43720) 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 -- 172.21.15.39:0/3832123035 learned_addr learned my addr 172.21.15.39:0/3832123035 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a57e00640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a58140170 0x7f0a5813a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5ce00640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a580d1720 0x7f0a58153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 -- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a580d1720 msgr2=0x7f0a58153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a580d1720 0x7f0a58153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 -- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a58140170 msgr2=0x7f0a5813a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a58140170 0x7f0a5813a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 -- 172.21.15.39:0/3832123035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5813d630 con 0x7f0a58161850 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5d800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0a500af040 tx=0x7f0a50019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500bc020 con 0x7f0a58161850 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500b8690 con 0x7f0a58161850 2024-04-26T23:28:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500b8a80 con 0x7f0a58161850 2024-04-26T23:28:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5813d910 con 0x7f0a58161850 2024-04-26T23:28:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5813ded0 con 0x7f0a58161850 2024-04-26T23:28:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.190+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5806a720 con 0x7f0a58161850 2024-04-26T23:28:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.194+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f0a500bf020 con 0x7f0a58161850 2024-04-26T23:28:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.194+0000 7f0a54c00640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 0x7f0a3806ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.194+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5609+0+0 (secure 0 0 0) 0x7f0a50121cd0 con 0x7f0a58161850 2024-04-26T23:28:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.194+0000 7f0a5ce00640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 0x7f0a3806ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.194+0000 7f0a5ce00640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 0x7f0a3806ece0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a580b2600 tx=0x7f0a4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:23.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.198+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0a500c6030 con 0x7f0a58161850 2024-04-26T23:28:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:23.402+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0a5806ce00 con 0x7f0a58161850 2024-04-26T23:28:24.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.026+0000 7f0a54c00640 1 -- 172.21.15.39:0/3832123035 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v35) ==== 174+0+0 (secure 0 0 0) 0x7f0a500165e0 con 0x7f0a58161850 2024-04-26T23:28:24.035 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 10 and data pool 11 2024-04-26T23:28:24.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 msgr2=0x7f0a3806ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 0x7f0a3806ece0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a580b2600 tx=0x7f0a4c009040 comp rx=0 tx=0).stop 2024-04-26T23:28:24.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 msgr2=0x7f0a5813b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0a500af040 tx=0x7f0a50019790 comp rx=0 tx=0).stop 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 shutdown_connections 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0a3806c820 0x7f0a3806ece0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a58161850 0x7f0a5813b350 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a58140170 0x7f0a5813a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 --2- 172.21.15.39:0/3832123035 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a580d1720 0x7f0a58153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.038+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 >> 172.21.15.39:0/3832123035 conn(0x7f0a5806c7d0 msgr2=0x7f0a58072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.042+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 shutdown_connections 2024-04-26T23:28:24.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.042+0000 7f0a5f800640 1 -- 172.21.15.39:0/3832123035 wait complete. 2024-04-26T23:28:24.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:24.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 Processor -- start 2024-04-26T23:28:24.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 -- start start 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44680d1580 0x7f44680d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f44680d0be0 0x7f44680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44680ceed0 con 0x7f446809b9e0 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f44680ce630 con 0x7f44680d1580 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f446f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f44680ce910 con 0x7f44680d0be0 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44680d1580 0x7f44680d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44680d1580 0x7f44680d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43726/0 (socket says 172.21.15.39:43726) 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 -- 172.21.15.39:0/2629137660 learned_addr learned my addr 172.21.15.39:0/2629137660 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f445f400640 1 --2- 172.21.15.39:0/2629137660 >> v2:172.21.15.71:3300/0 conn(0x7f44680d0be0 0x7f44680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 -- 172.21.15.39:0/2629137660 >> v2:172.21.15.71:3300/0 conn(0x7f44680d0be0 msgr2=0x7f44680d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 --2- 172.21.15.39:0/2629137660 >> v2:172.21.15.71:3300/0 conn(0x7f44680d0be0 0x7f44680d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 -- 172.21.15.39:0/2629137660 >> v1:172.21.15.39:6789/0 conn(0x7f446809b9e0 legacy=0x7f446809be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.214+0000 7f4467e00640 1 -- 172.21.15.39:0/2629137660 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680cebf0 con 0x7f44680d1580 2024-04-26T23:28:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f4467e00640 1 --2- 172.21.15.39:0/2629137660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d1580 0x7f44680d1960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4468074090 tx=0x7f445801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a96aca489e7db0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f4467400640 1 -- 172.21.15.39:0/2629137660 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44580ab610 con 0x7f44680d1580 2024-04-26T23:28:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f4467400640 1 -- 172.21.15.39:0/2629137660 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44580b0070 con 0x7f44680d1580 2024-04-26T23:28:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f4467400640 1 -- 172.21.15.39:0/2629137660 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44580ab9d0 con 0x7f44680d1580 2024-04-26T23:28:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 -- 172.21.15.39:0/2629137660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d1580 msgr2=0x7f44680d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 --2- 172.21.15.39:0/2629137660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d1580 0x7f44680d1960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4468074090 tx=0x7f445801c520 comp rx=0 tx=0).stop 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 -- 172.21.15.39:0/2629137660 shutdown_connections 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 --2- 172.21.15.39:0/2629137660 >> v2:172.21.15.71:3300/0 conn(0x7f44680d0be0 0x7f44680d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 --2- 172.21.15.39:0/2629137660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d1580 0x7f44680d1960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 -- 172.21.15.39:0/2629137660 >> 172.21.15.39:0/2629137660 conn(0x7f44680b4b00 msgr2=0x7f44680b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 -- 172.21.15.39:0/2629137660 shutdown_connections 2024-04-26T23:28:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.218+0000 7f446f200640 1 -- 172.21.15.39:0/2629137660 wait complete. 2024-04-26T23:28:24.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 Processor -- start 2024-04-26T23:28:24.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- start start 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446809b9e0 0x7f446814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44680d1580 0x7f4468152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f446815d6c0 con 0x7f44680d0be0 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446815d540 con 0x7f446809b9e0 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f446816a650 con 0x7f44680d1580 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43738/0 (socket says 172.21.15.39:43738) 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 -- 172.21.15.39:0/361174711 learned_addr learned my addr 172.21.15.39:0/361174711 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f4467e00640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446809b9e0 0x7f446814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446d200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44680d1580 0x7f4468152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 -- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44680d1580 msgr2=0x7f4468152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44680d1580 0x7f4468152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 -- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446809b9e0 msgr2=0x7f446814fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446809b9e0 0x7f446814fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 -- 172.21.15.39:0/361174711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446814ec60 con 0x7f44680d0be0 2024-04-26T23:28:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f445f400640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4450007e40 tx=0x7f445000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450014620 con 0x7f44680d0be0 2024-04-26T23:28:24.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4450019070 con 0x7f44680d0be0 2024-04-26T23:28:24.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446814ef40 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450014a00 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.222+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446814f500 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468050740 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4450014ba0 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f4464c00640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 0x7f444406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f4450087230 con 0x7f44680d0be0 2024-04-26T23:28:24.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f4467e00640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 0x7f444406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.226+0000 7f4467e00640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 0x7f444406a8d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f44580af000 tx=0x7f44580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.230+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f44500570b0 con 0x7f44680d0be0 2024-04-26T23:28:24.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.394+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4468074960 con 0x7f44680d0be0 2024-04-26T23:28:24.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f4464c00640 1 -- 172.21.15.39:0/361174711 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16621 (secure 0 0 0) 0x7f445005b3b0 con 0x7f44680d0be0 2024-04-26T23:28:24.401 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:24.401 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":62,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:23.404656+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:24.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 msgr2=0x7f444406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 0x7f444406a8d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f44580af000 tx=0x7f44580a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 msgr2=0x7f4468167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4450007e40 tx=0x7f445000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 shutdown_connections 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4444068410 0x7f444406a8d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44680d1580 0x7f4468152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44680d0be0 0x7f4468167740 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 --2- 172.21.15.39:0/361174711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446809b9e0 0x7f446814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 >> 172.21.15.39:0/361174711 conn(0x7f44680b4b00 msgr2=0x7f4468070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 shutdown_connections 2024-04-26T23:28:24.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.398+0000 7f446f200640 1 -- 172.21.15.39:0/361174711 wait complete. 2024-04-26T23:28:24.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.558+0000 7fa587600640 1 Processor -- start 2024-04-26T23:28:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.558+0000 7fa587600640 1 -- start start 2024-04-26T23:28:24.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa587600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa580145820 0x7fa5800cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa587600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa58006fc80 0x7fa5800b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa587600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa580160060 con 0x7fa5800b4950 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa587600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa5800cd5c0 con 0x7fa580145820 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa587600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa580160340 con 0x7fa58006fc80 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa580145820 0x7fa5800cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa57fe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa5800b4950 0x7fa58006f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42694/0 (socket says 172.21.15.39:42694) 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa580145820 0x7fa5800cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43752/0 (socket says 172.21.15.39:43752) 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa57fe00640 1 -- 172.21.15.39:0/3477541748 learned_addr learned my addr 172.21.15.39:0/3477541748 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa585600640 1 --2- 172.21.15.39:0/3477541748 >> v2:172.21.15.71:3300/0 conn(0x7fa58006fc80 0x7fa5800b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 -- 172.21.15.39:0/3477541748 >> v2:172.21.15.71:3300/0 conn(0x7fa58006fc80 msgr2=0x7fa5800b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 --2- 172.21.15.39:0/3477541748 >> v2:172.21.15.71:3300/0 conn(0x7fa58006fc80 0x7fa5800b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 -- 172.21.15.39:0/3477541748 >> v1:172.21.15.39:6789/0 conn(0x7fa5800b4950 legacy=0x7fa58006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa584c00640 1 -- 172.21.15.39:0/3477541748 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580160620 con 0x7fa580145820 2024-04-26T23:28:24.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.562+0000 7fa57f400640 1 -- 172.21.15.39:0/3477541748 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346321457 0 0) 0x7fa580160060 con 0x7fa5800b4950 2024-04-26T23:28:24.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa584c00640 1 --2- 172.21.15.39:0/3477541748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa5800cf2a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097c0 tx=0x7fa57401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a4cb309f9d48de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa57f400640 1 -- 172.21.15.39:0/3477541748 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740ab650 con 0x7fa580145820 2024-04-26T23:28:24.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa57f400640 1 -- 172.21.15.39:0/3477541748 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740b0070 con 0x7fa580145820 2024-04-26T23:28:24.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa57f400640 1 -- 172.21.15.39:0/3477541748 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740aba10 con 0x7fa580145820 2024-04-26T23:28:24.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- 172.21.15.39:0/3477541748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 msgr2=0x7fa5800cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- 172.21.15.39:0/3477541748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa5800cf2a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097c0 tx=0x7fa57401c430 comp rx=0 tx=0).stop 2024-04-26T23:28:24.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- 172.21.15.39:0/3477541748 shutdown_connections 2024-04-26T23:28:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- 172.21.15.39:0/3477541748 >> v2:172.21.15.71:3300/0 conn(0x7fa58006fc80 0x7fa5800b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- 172.21.15.39:0/3477541748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa5800cf2a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- 172.21.15.39:0/3477541748 >> 172.21.15.39:0/3477541748 conn(0x7fa5800b2af0 msgr2=0x7fa5800b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- 172.21.15.39:0/3477541748 shutdown_connections 2024-04-26T23:28:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- 172.21.15.39:0/3477541748 wait complete. 2024-04-26T23:28:24.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 Processor -- start 2024-04-26T23:28:24.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- start start 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58006fc80 0x7fa580151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5800b4950 0x7fa58013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800ce260 con 0x7fa580145820 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa58015fe40 con 0x7fa58006fc80 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa587600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800ce3e0 con 0x7fa5800b4950 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa585600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa585600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43762/0 (socket says 172.21.15.39:43762) 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa585600640 1 -- 172.21.15.39:0/4127029272 learned_addr learned my addr 172.21.15.39:0/4127029272 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa584c00640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58006fc80 0x7fa580151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.566+0000 7fa57fe00640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5800b4950 0x7fa58013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 -- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5800b4950 msgr2=0x7fa58013ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5800b4950 0x7fa58013ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 -- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58006fc80 msgr2=0x7fa580151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58006fc80 0x7fa580151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 -- 172.21.15.39:0/4127029272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58013bb90 con 0x7fa580145820 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa585600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa578007de0 tx=0x7fa57800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578014620 con 0x7fa580145820 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa578019070 con 0x7fa580145820 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578014a20 con 0x7fa580145820 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa580152190 con 0x7fa580145820 2024-04-26T23:28:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5800b0c00 con 0x7fa580145820 2024-04-26T23:28:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580050740 con 0x7fa580145820 2024-04-26T23:28:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa578014bc0 con 0x7fa580145820 2024-04-26T23:28:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 0x7fa56006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.570+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fa578087390 con 0x7fa580145820 2024-04-26T23:28:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.574+0000 7fa584c00640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 0x7fa56006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.574+0000 7fa584c00640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 0x7fa56006a8d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5740af000 tx=0x7fa5740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.578+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa58013bb90 con 0x7fa580145820 2024-04-26T23:28:24.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.746+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa580158b70 con 0x7fa580145820 2024-04-26T23:28:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.746+0000 7fa57cc00640 1 -- 172.21.15.39:0/4127029272 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16621 (secure 0 0 0) 0x7fa578057860 con 0x7fa580145820 2024-04-26T23:28:24.752 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:24.752 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":62,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:23.404656+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:24.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 msgr2=0x7fa56006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 0x7fa56006a8d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5740af000 tx=0x7fa5740a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 msgr2=0x7fa58015e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa578007de0 tx=0x7fa57800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 shutdown_connections 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa560068410 0x7fa56006a8d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa580145820 0x7fa58015e7c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa5800b4950 0x7fa58013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 --2- 172.21.15.39:0/4127029272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58006fc80 0x7fa580151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 >> 172.21.15.39:0/4127029272 conn(0x7fa5800b2af0 msgr2=0x7fa5800cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 shutdown_connections 2024-04-26T23:28:24.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.750+0000 7fa587600640 1 -- 172.21.15.39:0/4127029272 wait complete. 2024-04-26T23:28:24.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:28:24.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.910+0000 7fb39ec00640 1 Processor -- start 2024-04-26T23:28:24.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.910+0000 7fb39ec00640 1 -- start start 2024-04-26T23:28:24.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb3981458d0 0x7fb3980b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39ec00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb398072180 con 0x7fb3980ce5e0 2024-04-26T23:28:24.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39ec00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3980739a0 con 0x7fb398073400 2024-04-26T23:28:24.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb398073c80 con 0x7fb3981458d0 2024-04-26T23:28:24.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39cc00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb3980ce5e0 0x7fb39806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42696/0 (socket says 172.21.15.39:42696) 2024-04-26T23:28:24.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb39cc00640 1 -- 172.21.15.39:0/1987982858 learned_addr learned my addr 172.21.15.39:0/1987982858 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:24.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397e00640 1 --2- 172.21.15.39:0/1987982858 >> v2:172.21.15.71:3300/0 conn(0x7fb3981458d0 0x7fb3980b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942210075 0 0) 0x7fb398072180 con 0x7fb3980ce5e0 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb37c003530 con 0x7fb3980ce5e0 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73981326 0 0) 0x7fb3980739a0 con 0x7fb398073400 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb398072180 con 0x7fb398073400 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397e00640 1 -- 172.21.15.39:0/1987982858 >> v1:172.21.15.71:6789/0 conn(0x7fb398073400 legacy=0x7fb398072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397e00640 1 -- 172.21.15.39:0/1987982858 >> v1:172.21.15.39:6789/0 conn(0x7fb3980ce5e0 legacy=0x7fb39806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275502622 0 0) 0x7fb37c003530 con 0x7fb3980ce5e0 2024-04-26T23:28:24.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.914+0000 7fb397e00640 1 -- 172.21.15.39:0/1987982858 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb398145cb0 con 0x7fb3981458d0 2024-04-26T23:28:24.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb397e00640 1 --2- 172.21.15.39:0/1987982858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb3980b4890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3880097f0 tx=0x7fb38801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32fdc3709893603 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3880b0070 con 0x7fb3981458d0 2024-04-26T23:28:24.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3880ab400 con 0x7fb3981458d0 2024-04-26T23:28:24.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb397400640 1 -- 172.21.15.39:0/1987982858 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390001a00 con 0x7fb3981458d0 2024-04-26T23:28:24.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- 172.21.15.39:0/1987982858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 msgr2=0x7fb3980b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 --2- 172.21.15.39:0/1987982858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb3980b4890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3880097f0 tx=0x7fb38801c330 comp rx=0 tx=0).stop 2024-04-26T23:28:24.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- 172.21.15.39:0/1987982858 shutdown_connections 2024-04-26T23:28:24.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 --2- 172.21.15.39:0/1987982858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb3980b4890 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- 172.21.15.39:0/1987982858 >> 172.21.15.39:0/1987982858 conn(0x7fb39806c7d0 msgr2=0x7fb39806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:24.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- 172.21.15.39:0/1987982858 shutdown_connections 2024-04-26T23:28:24.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- 172.21.15.39:0/1987982858 wait complete. 2024-04-26T23:28:24.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 Processor -- start 2024-04-26T23:28:24.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.918+0000 7fb39ec00640 1 -- start start 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb398073400 0x7fb3981372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb39815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb39806fe00 con 0x7fb3980ce5e0 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb39806fc80 con 0x7fb3981458d0 2024-04-26T23:28:24.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb3980cea70 con 0x7fb398073400 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43770/0 (socket says 172.21.15.39:43770) 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 -- 172.21.15.39:0/3587322091 learned_addr learned my addr 172.21.15.39:0/3587322091 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb397e00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb398073400 0x7fb3981372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39cc00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb39815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 -- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb398073400 msgr2=0x7fb3981372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb398073400 0x7fb3981372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 -- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 msgr2=0x7fb39815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb39815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 -- 172.21.15.39:0/3587322091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39813b4b0 con 0x7fb3980ce5e0 2024-04-26T23:28:24.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb38f400640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c490 tx=0x7fb38000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800052d0 con 0x7fb3980ce5e0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380005470 con 0x7fb3980ce5e0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380012870 con 0x7fb3980ce5e0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39815f550 con 0x7fb3980ce5e0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39815c850 con 0x7fb3980ce5e0 2024-04-26T23:28:24.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39815c640 con 0x7fb3980ce5e0 2024-04-26T23:28:24.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.922+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb380012a10 con 0x7fb3980ce5e0 2024-04-26T23:28:24.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.926+0000 7fb394c00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 0x7fb37406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:24.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.926+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fb3800866f0 con 0x7fb3980ce5e0 2024-04-26T23:28:24.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.926+0000 7fb397e00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 0x7fb37406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:24.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.926+0000 7fb397e00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 0x7fb37406a8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ad000 tx=0x7fb3880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:24.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:24.930+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb380056c50 con 0x7fb3980ce5e0 2024-04-26T23:28:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:25.134+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb39806a750 con 0x7fb3980ce5e0 2024-04-26T23:28:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.042+0000 7fb394c00640 1 -- 172.21.15.39:0/3587322091 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) ==== 118+0+0 (secure 0 0 0) 0x7fb39806a750 con 0x7fb3980ce5e0 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 msgr2=0x7fb37406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 0x7fb37406a8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ad000 tx=0x7fb3880a6000 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 msgr2=0x7fb39815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c490 tx=0x7fb38000c950 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 shutdown_connections 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb374068410 0x7fb37406a8d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3981458d0 0x7fb39815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3980ce5e0 0x7fb39815ead0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 --2- 172.21.15.39:0/3587322091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb398073400 0x7fb3981372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 >> 172.21.15.39:0/3587322091 conn(0x7fb39806c7d0 msgr2=0x7fb3980d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:26.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 shutdown_connections 2024-04-26T23:28:26.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.046+0000 7fb39ec00640 1 -- 172.21.15.39:0/3587322091 wait complete. 2024-04-26T23:28:26.074 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:28:26.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:28:26.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 Processor -- start 2024-04-26T23:28:26.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 -- start start 2024-04-26T23:28:26.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04800d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048006e500 con 0x7f0480140170 2024-04-26T23:28:26.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048006e7e0 con 0x7f04800d1720 2024-04-26T23:28:26.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0488800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f048006f110 con 0x7f0480161850 2024-04-26T23:28:26.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0485e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0480140170 0x7f048015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42698/0 (socket says 172.21.15.39:42698) 2024-04-26T23:28:26.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0485e00640 1 -- 172.21.15.39:0/1525099568 learned_addr learned my addr 172.21.15.39:0/1525099568 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0485400640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04800d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528177262 0 0) 0x7f048006e500 con 0x7f0480140170 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.218+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0468003530 con 0x7f0480140170 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095344520 0 0) 0x7f048006e7e0 con 0x7f04800d1720 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048006e500 con 0x7f04800d1720 2024-04-26T23:28:26.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1099464466 0 0) 0x7f0468003530 con 0x7f0480140170 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 msgr2=0x7f04800d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04800d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 >> v1:172.21.15.71:6789/0 conn(0x7f04800d1720 legacy=0x7f04800cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048006eac0 con 0x7f0480140170 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f0474001680 con 0x7f0480140170 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485400640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04800d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 >> v1:172.21.15.39:6789/0 conn(0x7f0480140170 legacy=0x7f048015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0468003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0468004810 0x7f0468004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f048006f110 con 0x7f0468003b80 2024-04-26T23:28:26.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f046800ba00 con 0x7f0468004810 2024-04-26T23:28:26.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f046800bc00 con 0x7f0480161850 2024-04-26T23:28:26.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0468003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485400640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0468004810 0x7f0468004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0486800640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 -- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 msgr2=0x7f04680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480161850 0x7f04680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 -- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0468004810 msgr2=0x7f0468004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0468004810 0x7f0468004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 -- 172.21.15.39:0/1525099568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0468003530 con 0x7f0468003b80 2024-04-26T23:28:26.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0485e00640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0468003f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f047400c190 tx=0x7f047401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb0652758c3e7ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474007cf0 con 0x7f0468003b80 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04740a9020 con 0x7f0468003b80 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.222+0000 7f0484a00640 1 -- 172.21.15.39:0/1525099568 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474005b00 con 0x7f0468003b80 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- 172.21.15.39:0/1525099568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 msgr2=0x7f0468003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 --2- 172.21.15.39:0/1525099568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0468003f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f047400c190 tx=0x7f047401cbe0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0486800640 1 -- 172.21.15.39:0/1525099568 reap_dead start 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- 172.21.15.39:0/1525099568 shutdown_connections 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- 172.21.15.39:0/1525099568 >> 172.21.15.39:0/1525099568 conn(0x7f048006c7d0 msgr2=0x7f048006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- 172.21.15.39:0/1525099568 shutdown_connections 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- 172.21.15.39:0/1525099568 wait complete. 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 Processor -- start 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- start start 2024-04-26T23:28:26.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04800b36a0 0x7f04801393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480139930 0x7f04800b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f04800d09a0 con 0x7f0468003b80 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04800d0820 con 0x7f04800b36a0 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0488800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0480168fb0 con 0x7f0480139930 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43776/0 (socket says 172.21.15.39:43776) 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 -- 172.21.15.39:0/627936781 learned_addr learned my addr 172.21.15.39:0/627936781 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485400640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04800b36a0 0x7f04801393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0486800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480139930 0x7f04800b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 -- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480139930 msgr2=0x7f04800b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480139930 0x7f04800b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 -- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04800b36a0 msgr2=0x7f04801393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:26.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04800b36a0 0x7f04801393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.226+0000 7f0485e00640 1 -- 172.21.15.39:0/627936781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0480144a20 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f0485e00640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f047401ca10 tx=0x7f0468005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474004a70 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0474004c10 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474007090 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0480139dd0 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048013a390 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048006a720 con 0x7f0468003b80 2024-04-26T23:28:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f0474007230 con 0x7f0468003b80 2024-04-26T23:28:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 0x7f046406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f047411fd30 con 0x7f0468003b80 2024-04-26T23:28:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.230+0000 7f0485400640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 0x7f046406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.234+0000 7f0485400640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 0x7f046406a8d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f048013b090 tx=0x7f0470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.234+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04740bf030 con 0x7f0468003b80 2024-04-26T23:28:26.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:26.434+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0480163530 con 0x7f0468003b80 2024-04-26T23:28:27.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.050+0000 7f047a000640 1 -- 172.21.15.39:0/627936781 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) ==== 122+0+0 (secure 0 0 0) 0x7f04740168f0 con 0x7f0468003b80 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 msgr2=0x7f046406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 0x7f046406a8d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f048013b090 tx=0x7f0470008040 comp rx=0 tx=0).stop 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 msgr2=0x7f0480152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f047401ca10 tx=0x7f0468005840 comp rx=0 tx=0).stop 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 shutdown_connections 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0464068410 0x7f046406a8d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0480139930 0x7f04800b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04800b36a0 0x7f04801393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 --2- 172.21.15.39:0/627936781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0468003b80 0x7f0480152ce0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 >> 172.21.15.39:0/627936781 conn(0x7f048006c7d0 msgr2=0x7f0480163750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 shutdown_connections 2024-04-26T23:28:27.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.054+0000 7f0488800640 1 -- 172.21.15.39:0/627936781 wait complete. 2024-04-26T23:28:27.078 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:28:27.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:27.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.214+0000 7f9fe9000640 1 Processor -- start 2024-04-26T23:28:27.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.214+0000 7f9fe9000640 1 -- start start 2024-04-26T23:28:27.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe9000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fe406daf0 0x7f9fe40b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe9000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe406eab0 con 0x7f9fe415f5d0 2024-04-26T23:28:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe9000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe40b4d70 con 0x7f9fe406daf0 2024-04-26T23:28:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe9000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe40aedf0 con 0x7f9fe415f1f0 2024-04-26T23:28:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:54114/0 (socket says 172.21.15.39:54114) 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2127676479 learned_addr learned my addr 172.21.15.39:0/2127676479 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe2800640 1 --2- 172.21.15.39:0/2127676479 >> v2:172.21.15.71:3300/0 conn(0x7f9fe406daf0 0x7f9fe40b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2127676479 >> v2:172.21.15.71:3300/0 conn(0x7f9fe406daf0 msgr2=0x7f9fe40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 --2- 172.21.15.39:0/2127676479 >> v2:172.21.15.71:3300/0 conn(0x7f9fe406daf0 0x7f9fe40b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2127676479 >> v1:172.21.15.71:6789/0 conn(0x7f9fe415f5d0 legacy=0x7f9fe406d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.218+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2127676479 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe40b4720 con 0x7f9fe415f1f0 2024-04-26T23:28:27.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe1e00640 1 --2- 172.21.15.39:0/2127676479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009870 tx=0x7f9fd401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611e5688190e472d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe1400640 1 -- 172.21.15.39:0/2127676479 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40b5070 con 0x7f9fe415f1f0 2024-04-26T23:28:27.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe1400640 1 -- 172.21.15.39:0/2127676479 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd40a8a50 con 0x7f9fe415f1f0 2024-04-26T23:28:27.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe1400640 1 -- 172.21.15.39:0/2127676479 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40a8e20 con 0x7f9fe415f1f0 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- 172.21.15.39:0/2127676479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 msgr2=0x7f9fe4073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2127676479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009870 tx=0x7f9fd401ed50 comp rx=0 tx=0).stop 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- 172.21.15.39:0/2127676479 shutdown_connections 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2127676479 >> v2:172.21.15.71:3300/0 conn(0x7f9fe406daf0 0x7f9fe40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2127676479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe415f1f0 0x7f9fe4073640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- 172.21.15.39:0/2127676479 >> 172.21.15.39:0/2127676479 conn(0x7f9fe40729d0 msgr2=0x7f9fe4072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- 172.21.15.39:0/2127676479 shutdown_connections 2024-04-26T23:28:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- 172.21.15.39:0/2127676479 wait complete. 2024-04-26T23:28:27.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 Processor -- start 2024-04-26T23:28:27.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.222+0000 7f9fe9000640 1 -- start start 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 0x7f9fe4152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe415f5d0 0x7f9fe4161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe40ae850 con 0x7f9fe415f1f0 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4073b80 con 0x7f9fe415f5d0 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe40ae9d0 con 0x7f9fe406daf0 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fd9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 0x7f9fe4152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fd9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43786/0 (socket says 172.21.15.39:43786) 2024-04-26T23:28:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fd9400640 1 -- 172.21.15.39:0/2474656211 learned_addr learned my addr 172.21.15.39:0/2474656211 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe2800640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe415f5d0 0x7f9fe4161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe415f5d0 msgr2=0x7f9fe4161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe415f5d0 0x7f9fe4161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2474656211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 msgr2=0x7f9fe4161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 -- 172.21.15.39:0/2474656211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe4153570 con 0x7f9fe406daf0 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fd9400640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:28:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe1e00640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 0x7f9fe4152d20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40af000 tx=0x7f9fd401baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40c0070 con 0x7f9fe406daf0 2024-04-26T23:28:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd40ae550 con 0x7f9fe406daf0 2024-04-26T23:28:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40b5070 con 0x7f9fe406daf0 2024-04-26T23:28:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe4153850 con 0x7f9fe406daf0 2024-04-26T23:28:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe4153260 con 0x7f9fe406daf0 2024-04-26T23:28:27.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.226+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe4050740 con 0x7f9fe406daf0 2024-04-26T23:28:27.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.230+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9fd40c3070 con 0x7f9fe406daf0 2024-04-26T23:28:27.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.230+0000 7f9fdaa00640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.230+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd4124320 con 0x7f9fe406daf0 2024-04-26T23:28:27.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.230+0000 7f9fd9400640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.230+0000 7f9fd9400640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40d0200 tx=0x7f9fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.234+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9fd40188b0 con 0x7f9fe406daf0 2024-04-26T23:28:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.434+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fe4068890 con 0x7f9fe406daf0 2024-04-26T23:28:27.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.434+0000 7f9fdaa00640 1 -- 172.21.15.39:0/2474656211 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5183 (secure 0 0 0) 0x7f9fd40f4230 con 0x7f9fe406daf0 2024-04-26T23:28:27.439 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:27.439 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:28:27.439 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 39 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 msgr2=0x7f9fc006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40d0200 tx=0x7f9fcc009040 comp rx=0 tx=0).stop 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 msgr2=0x7f9fe4152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 0x7f9fe4152d20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40af000 tx=0x7f9fd401baf0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 shutdown_connections 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9fc0068410 0x7f9fc006a8d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe415f5d0 0x7f9fe4161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fe415f1f0 0x7f9fe4161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 --2- 172.21.15.39:0/2474656211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9fe406daf0 0x7f9fe4152d20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 >> 172.21.15.39:0/2474656211 conn(0x7f9fe40729d0 msgr2=0x7f9fe40b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 shutdown_connections 2024-04-26T23:28:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.438+0000 7f9fe9000640 1 -- 172.21.15.39:0/2474656211 wait complete. 2024-04-26T23:28:27.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:28:27.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 Processor -- start 2024-04-26T23:28:27.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 -- start start 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6f1009c0f0 0x7f6f100b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1009c7a0 con 0x7f6f100d1640 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f100d1b70 con 0x7f6f1015d170 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f17c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6f100c6be0 con 0x7f6f1009c0f0 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f0fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6f1009c0f0 0x7f6f100b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f15c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6f100d1640 0x7f6f100c7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42704/0 (socket says 172.21.15.39:42704) 2024-04-26T23:28:27.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f15c00640 1 -- 172.21.15.39:0/2454346298 learned_addr learned my addr 172.21.15.39:0/2454346298 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:27.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f0fe00640 1 -- 172.21.15.39:0/2454346298 >> v1:172.21.15.71:6789/0 conn(0x7f6f1015d170 legacy=0x7f6f1009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f0fe00640 1 -- 172.21.15.39:0/2454346298 >> v1:172.21.15.39:6789/0 conn(0x7f6f100d1640 legacy=0x7f6f100c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f0f400640 1 -- 172.21.15.39:0/2454346298 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842372412 0 0) 0x7f6f1009c7a0 con 0x7f6f100d1640 2024-04-26T23:28:27.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.598+0000 7f6f0fe00640 1 -- 172.21.15.39:0/2454346298 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100d1e50 con 0x7f6f1009c0f0 2024-04-26T23:28:27.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f0fe00640 1 --2- 172.21.15.39:0/2454346298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f100b56a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097c0 tx=0x7f6efc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786a2acfa29a93e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f0f400640 1 -- 172.21.15.39:0/2454346298 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b0070 con 0x7f6f1009c0f0 2024-04-26T23:28:27.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f0f400640 1 -- 172.21.15.39:0/2454346298 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc0ab600 con 0x7f6f1009c0f0 2024-04-26T23:28:27.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f0f400640 1 -- 172.21.15.39:0/2454346298 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0ab9d0 con 0x7f6f1009c0f0 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 -- 172.21.15.39:0/2454346298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 msgr2=0x7f6f100b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 --2- 172.21.15.39:0/2454346298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f100b56a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097c0 tx=0x7f6efc01c410 comp rx=0 tx=0).stop 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 -- 172.21.15.39:0/2454346298 shutdown_connections 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 --2- 172.21.15.39:0/2454346298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f100b56a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 -- 172.21.15.39:0/2454346298 >> 172.21.15.39:0/2454346298 conn(0x7f6f100b4b80 msgr2=0x7f6f100b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 -- 172.21.15.39:0/2454346298 shutdown_connections 2024-04-26T23:28:27.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.602+0000 7f6f17c00640 1 -- 172.21.15.39:0/2454346298 wait complete. 2024-04-26T23:28:27.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 Processor -- start 2024-04-26T23:28:27.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- start start 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f100d1640 0x7f6f100b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 0x7f6f10153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100c88e0 con 0x7f6f1009c0f0 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100c8760 con 0x7f6f100d1640 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1016af60 con 0x7f6f1015d170 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43800/0 (socket says 172.21.15.39:43800) 2024-04-26T23:28:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 -- 172.21.15.39:0/1599542691 learned_addr learned my addr 172.21.15.39:0/1599542691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f0fe00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f100d1640 0x7f6f100b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 -- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 msgr2=0x7f6f10153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 0x7f6f10153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 0x7f6f10153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 -- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f100d1640 msgr2=0x7f6f100b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f100d1640 0x7f6f100b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 -- 172.21.15.39:0/1599542691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1015da60 con 0x7f6f1009c0f0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 0x7f6f10153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f15200640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c530 tx=0x7f6f0000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00016020 con 0x7f6f1009c0f0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f00005220 con 0x7f6f1009c0f0 2024-04-26T23:28:27.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1015dd40 con 0x7f6f1009c0f0 2024-04-26T23:28:27.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00007030 con 0x7f6f1009c0f0 2024-04-26T23:28:27.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1015e300 con 0x7f6f1009c0f0 2024-04-26T23:28:27.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.606+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f10050740 con 0x7f6f1009c0f0 2024-04-26T23:28:27.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.610+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f6f000071d0 con 0x7f6f1009c0f0 2024-04-26T23:28:27.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.610+0000 7f6f0cc00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 0x7f6ef006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.610+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f6f00086410 con 0x7f6f1009c0f0 2024-04-26T23:28:27.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.610+0000 7f6f0fe00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 0x7f6ef006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.610+0000 7f6f0fe00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 0x7f6ef006a8d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0ad000 tx=0x7f6efc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.614+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f00020020 con 0x7f6f1009c0f0 2024-04-26T23:28:27.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.782+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f10159350 con 0x7f6f1009c0f0 2024-04-26T23:28:27.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.782+0000 7f6f0cc00640 1 -- 172.21.15.39:0/1599542691 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16608 (secure 0 0 0) 0x7f6f000074c0 con 0x7f6f1009c0f0 2024-04-26T23:28:27.787 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:27.787 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":63,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:25.028891+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 msgr2=0x7f6ef006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 0x7f6ef006a8d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0ad000 tx=0x7f6efc008040 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 msgr2=0x7f6f10151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c530 tx=0x7f6f0000c9f0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 shutdown_connections 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f6ef0068410 0x7f6ef006a8d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6f1015d170 0x7f6f10153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f100d1640 0x7f6f100b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 --2- 172.21.15.39:0/1599542691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f1009c0f0 0x7f6f10151e70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 >> 172.21.15.39:0/1599542691 conn(0x7f6f100b4b80 msgr2=0x7f6f1009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 shutdown_connections 2024-04-26T23:28:27.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.786+0000 7f6f17c00640 1 -- 172.21.15.39:0/1599542691 wait complete. 2024-04-26T23:28:27.809 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:28:27.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:28:27.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.946+0000 7f111d600640 1 Processor -- start 2024-04-26T23:28:27.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.946+0000 7f111d600640 1 -- start start 2024-04-26T23:28:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f111d600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f111d600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11180cf560 con 0x7f1118145b50 2024-04-26T23:28:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f111d600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11180d1310 con 0x7f1118145770 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f111d600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f11180ce0c0 con 0x7f1118073a00 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f110e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1118145b50 0x7f11180732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42718/0 (socket says 172.21.15.39:42718) 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f110e000640 1 -- 172.21.15.39:0/1263103286 learned_addr learned my addr 172.21.15.39:0/1263103286 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1117400640 1 --2- 172.21.15.39:0/1263103286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519987598 0 0) 0x7f11180cf560 con 0x7f1118145b50 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10fc003530 con 0x7f1118145b50 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415473181 0 0) 0x7f11180d1310 con 0x7f1118145770 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11180cf560 con 0x7f1118145770 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1117400640 1 -- 172.21.15.39:0/1263103286 >> v1:172.21.15.71:6789/0 conn(0x7f1118145770 legacy=0x7f11180d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1117400640 1 -- 172.21.15.39:0/1263103286 >> v1:172.21.15.39:6789/0 conn(0x7f1118145b50 legacy=0x7f11180732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.950+0000 7f1117400640 1 -- 172.21.15.39:0/1263103286 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180d15f0 con 0x7f1118073a00 2024-04-26T23:28:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f1117400640 1 --2- 172.21.15.39:0/1263103286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118166eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f11180ce240 tx=0x7f111001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae4db3f4258ea083 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100b2070 con 0x7f1118073a00 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11100a58b0 con 0x7f1118073a00 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f1116000640 1 -- 172.21.15.39:0/1263103286 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100a5c60 con 0x7f1118073a00 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 -- 172.21.15.39:0/1263103286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 msgr2=0x7f1118166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 --2- 172.21.15.39:0/1263103286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118166eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f11180ce240 tx=0x7f111001c900 comp rx=0 tx=0).stop 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 -- 172.21.15.39:0/1263103286 shutdown_connections 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 --2- 172.21.15.39:0/1263103286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118166eb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 -- 172.21.15.39:0/1263103286 >> 172.21.15.39:0/1263103286 conn(0x7f111806f550 msgr2=0x7f111806f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 -- 172.21.15.39:0/1263103286 shutdown_connections 2024-04-26T23:28:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 -- 172.21.15.39:0/1263103286 wait complete. 2024-04-26T23:28:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.954+0000 7f111d600640 1 Processor -- start 2024-04-26T23:28:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- start start 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1118145770 0x7f111813c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1118169d90 con 0x7f1118145b50 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1118169c10 con 0x7f1118145770 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1118169f10 con 0x7f1118073a00 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43806/0 (socket says 172.21.15.39:43806) 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 -- 172.21.15.39:0/3924702419 learned_addr learned my addr 172.21.15.39:0/3924702419 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f110e000640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1118145770 0x7f111813c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1116a00640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 -- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 msgr2=0x7f1118154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 -- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1118145770 msgr2=0x7f111813c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1118145770 0x7f111813c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 -- 172.21.15.39:0/3924702419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180b1cd0 con 0x7f1118145b50 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f1117400640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f11100b0040 tx=0x7f11100196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100b2050 con 0x7f1118145b50 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11100be070 con 0x7f1118145b50 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11180b1fb0 con 0x7f1118145b50 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100ad850 con 0x7f1118145b50 2024-04-26T23:28:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11180b2570 con 0x7f1118145b50 2024-04-26T23:28:27.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.958+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1118050740 con 0x7f1118145b50 2024-04-26T23:28:27.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.962+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f11100ad9f0 con 0x7f1118145b50 2024-04-26T23:28:27.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.962+0000 7f110f400640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 0x7f10f406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:27.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.962+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f1110121b80 con 0x7f1118145b50 2024-04-26T23:28:27.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.962+0000 7f1116a00640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 0x7f10f406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:27.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.962+0000 7f1116a00640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 0x7f10f406a8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1108001020 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:27.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:27.966+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1110016580 con 0x7f1118145b50 2024-04-26T23:28:28.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.130+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f111815c130 con 0x7f10f4068410 2024-04-26T23:28:28.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.138+0000 7f110f400640 1 -- 172.21.15.39:0/3924702419 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7f111815c130 con 0x7f10f4068410 2024-04-26T23:28:28.145 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:28.146 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 msgr2=0x7f10f406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 0x7f10f406a8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1108001020 tx=0x7f1108009040 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 msgr2=0x7f1118155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f11100b0040 tx=0x7f11100196a0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 shutdown_connections 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f10f4068410 0x7f10f406a8d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1118145b50 0x7f1118155e50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1118145770 0x7f111813c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 --2- 172.21.15.39:0/3924702419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1118073a00 0x7f1118154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 >> 172.21.15.39:0/3924702419 conn(0x7f111806f550 msgr2=0x7f1118142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 shutdown_connections 2024-04-26T23:28:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.142+0000 7f111d600640 1 -- 172.21.15.39:0/3924702419 wait complete. 2024-04-26T23:28:28.164 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-04-26T23:28:27.687743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240048,"kb_used_data":7208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734672,"statfs":{"total":773094113280,"available":772848304128,"internally_reserved":0,"allocated":7380992,"data_stored":3807156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.687417"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154728+0000","last_change":"2024-04-26T23:28:24.051472+0000","last_active":"2024-04-26T23:28:25.154728+0000","last_peered":"2024-04-26T23:28:25.154728+0000","last_clean":"2024-04-26T23:28:25.154728+0000","last_became_active":"2024-04-26T23:28:24.050967+0000","last_became_peered":"2024-04-26T23:28:24.050967+0000","last_unstale":"2024-04-26T23:28:25.154728+0000","last_undegraded":"2024-04-26T23:28:25.154728+0000","last_fullsized":"2024-04-26T23:28:25.154728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:12.074259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043745+0000","last_change":"2024-04-26T23:28:24.043561+0000","last_active":"2024-04-26T23:28:25.043745+0000","last_peered":"2024-04-26T23:28:25.043745+0000","last_clean":"2024-04-26T23:28:25.043745+0000","last_became_active":"2024-04-26T23:28:24.043275+0000","last_became_peered":"2024-04-26T23:28:24.043275+0000","last_unstale":"2024-04-26T23:28:25.043745+0000","last_undegraded":"2024-04-26T23:28:25.043745+0000","last_fullsized":"2024-04-26T23:28:25.043745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688279+0000","last_change":"2024-04-26T23:28:24.037186+0000","last_active":"2024-04-26T23:28:25.688279+0000","last_peered":"2024-04-26T23:28:25.688279+0000","last_clean":"2024-04-26T23:28:25.688279+0000","last_became_active":"2024-04-26T23:28:24.035379+0000","last_became_peered":"2024-04-26T23:28:24.035379+0000","last_unstale":"2024-04-26T23:28:25.688279+0000","last_undegraded":"2024-04-26T23:28:25.688279+0000","last_fullsized":"2024-04-26T23:28:25.688279+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:16:13.252889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551676+0000","last_change":"2024-04-26T23:28:24.057439+0000","last_active":"2024-04-26T23:28:25.551676+0000","last_peered":"2024-04-26T23:28:25.551676+0000","last_clean":"2024-04-26T23:28:25.551676+0000","last_became_active":"2024-04-26T23:28:24.057160+0000","last_became_peered":"2024-04-26T23:28:24.057160+0000","last_unstale":"2024-04-26T23:28:25.551676+0000","last_undegraded":"2024-04-26T23:28:25.551676+0000","last_fullsized":"2024-04-26T23:28:25.551676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:24.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037522+0000","last_change":"2024-04-26T23:28:24.041677+0000","last_active":"2024-04-26T23:28:25.037522+0000","last_peered":"2024-04-26T23:28:25.037522+0000","last_clean":"2024-04-26T23:28:25.037522+0000","last_became_active":"2024-04-26T23:28:24.041407+0000","last_became_peered":"2024-04-26T23:28:24.041407+0000","last_unstale":"2024-04-26T23:28:25.037522+0000","last_undegraded":"2024-04-26T23:28:25.037522+0000","last_fullsized":"2024-04-26T23:28:25.037522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:37.414882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044252+0000","last_change":"2024-04-26T23:28:24.057506+0000","last_active":"2024-04-26T23:28:25.044252+0000","last_peered":"2024-04-26T23:28:25.044252+0000","last_clean":"2024-04-26T23:28:25.044252+0000","last_became_active":"2024-04-26T23:28:24.057165+0000","last_became_peered":"2024-04-26T23:28:24.057165+0000","last_unstale":"2024-04-26T23:28:25.044252+0000","last_undegraded":"2024-04-26T23:28:25.044252+0000","last_fullsized":"2024-04-26T23:28:25.044252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049436+0000","last_change":"2024-04-26T23:28:24.039430+0000","last_active":"2024-04-26T23:28:25.049436+0000","last_peered":"2024-04-26T23:28:25.049436+0000","last_clean":"2024-04-26T23:28:25.049436+0000","last_became_active":"2024-04-26T23:28:24.037763+0000","last_became_peered":"2024-04-26T23:28:24.037763+0000","last_unstale":"2024-04-26T23:28:25.049436+0000","last_undegraded":"2024-04-26T23:28:25.049436+0000","last_fullsized":"2024-04-26T23:28:25.049436+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:09.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044015+0000","last_change":"2024-04-26T23:28:24.059136+0000","last_active":"2024-04-26T23:28:25.044015+0000","last_peered":"2024-04-26T23:28:25.044015+0000","last_clean":"2024-04-26T23:28:25.044015+0000","last_became_active":"2024-04-26T23:28:24.056667+0000","last_became_peered":"2024-04-26T23:28:24.056667+0000","last_unstale":"2024-04-26T23:28:25.044015+0000","last_undegraded":"2024-04-26T23:28:25.044015+0000","last_fullsized":"2024-04-26T23:28:25.044015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038263+0000","last_change":"2024-04-26T23:28:24.049081+0000","last_active":"2024-04-26T23:28:25.038263+0000","last_peered":"2024-04-26T23:28:25.038263+0000","last_clean":"2024-04-26T23:28:25.038263+0000","last_became_active":"2024-04-26T23:28:24.048769+0000","last_became_peered":"2024-04-26T23:28:24.048769+0000","last_unstale":"2024-04-26T23:28:25.038263+0000","last_undegraded":"2024-04-26T23:28:25.038263+0000","last_fullsized":"2024-04-26T23:28:25.038263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:10.055639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042387+0000","last_change":"2024-04-26T23:28:24.046642+0000","last_active":"2024-04-26T23:28:25.042387+0000","last_peered":"2024-04-26T23:28:25.042387+0000","last_clean":"2024-04-26T23:28:25.042387+0000","last_became_active":"2024-04-26T23:28:24.045227+0000","last_became_peered":"2024-04-26T23:28:24.045227+0000","last_unstale":"2024-04-26T23:28:25.042387+0000","last_undegraded":"2024-04-26T23:28:25.042387+0000","last_fullsized":"2024-04-26T23:28:25.042387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:58.833727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154580+0000","last_change":"2024-04-26T23:28:24.043606+0000","last_active":"2024-04-26T23:28:25.154580+0000","last_peered":"2024-04-26T23:28:25.154580+0000","last_clean":"2024-04-26T23:28:25.154580+0000","last_became_active":"2024-04-26T23:28:24.043273+0000","last_became_peered":"2024-04-26T23:28:24.043273+0000","last_unstale":"2024-04-26T23:28:25.154580+0000","last_undegraded":"2024-04-26T23:28:25.154580+0000","last_fullsized":"2024-04-26T23:28:25.154580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:05.719301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551781+0000","last_change":"2024-04-26T23:28:24.040462+0000","last_active":"2024-04-26T23:28:25.551781+0000","last_peered":"2024-04-26T23:28:25.551781+0000","last_clean":"2024-04-26T23:28:25.551781+0000","last_became_active":"2024-04-26T23:28:24.040208+0000","last_became_peered":"2024-04-26T23:28:24.040208+0000","last_unstale":"2024-04-26T23:28:25.551781+0000","last_undegraded":"2024-04-26T23:28:25.551781+0000","last_fullsized":"2024-04-26T23:28:25.551781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051937+0000","last_change":"2024-04-26T23:28:24.047489+0000","last_active":"2024-04-26T23:28:25.051937+0000","last_peered":"2024-04-26T23:28:25.051937+0000","last_clean":"2024-04-26T23:28:25.051937+0000","last_became_active":"2024-04-26T23:28:24.047166+0000","last_became_peered":"2024-04-26T23:28:24.047166+0000","last_unstale":"2024-04-26T23:28:25.051937+0000","last_undegraded":"2024-04-26T23:28:25.051937+0000","last_fullsized":"2024-04-26T23:28:25.051937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:09.683279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037563+0000","last_change":"2024-04-26T23:28:24.037691+0000","last_active":"2024-04-26T23:28:25.037563+0000","last_peered":"2024-04-26T23:28:25.037563+0000","last_clean":"2024-04-26T23:28:25.037563+0000","last_became_active":"2024-04-26T23:28:24.037384+0000","last_became_peered":"2024-04-26T23:28:24.037384+0000","last_unstale":"2024-04-26T23:28:25.037563+0000","last_undegraded":"2024-04-26T23:28:25.037563+0000","last_fullsized":"2024-04-26T23:28:25.037563+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:44.598920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052059+0000","last_change":"2024-04-26T23:28:24.038596+0000","last_active":"2024-04-26T23:28:25.052059+0000","last_peered":"2024-04-26T23:28:25.052059+0000","last_clean":"2024-04-26T23:28:25.052059+0000","last_became_active":"2024-04-26T23:28:24.038300+0000","last_became_peered":"2024-04-26T23:28:24.038300+0000","last_unstale":"2024-04-26T23:28:25.052059+0000","last_undegraded":"2024-04-26T23:28:25.052059+0000","last_fullsized":"2024-04-26T23:28:25.052059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:09.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.041971+0000","last_change":"2024-04-26T23:28:24.045338+0000","last_active":"2024-04-26T23:28:25.041971+0000","last_peered":"2024-04-26T23:28:25.041971+0000","last_clean":"2024-04-26T23:28:25.041971+0000","last_became_active":"2024-04-26T23:28:24.045006+0000","last_became_peered":"2024-04-26T23:28:24.045006+0000","last_unstale":"2024-04-26T23:28:25.041971+0000","last_undegraded":"2024-04-26T23:28:25.041971+0000","last_fullsized":"2024-04-26T23:28:25.041971+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038246+0000","last_change":"2024-04-26T23:28:24.043316+0000","last_active":"2024-04-26T23:28:25.038246+0000","last_peered":"2024-04-26T23:28:25.038246+0000","last_clean":"2024-04-26T23:28:25.038246+0000","last_became_active":"2024-04-26T23:28:24.043067+0000","last_became_peered":"2024-04-26T23:28:24.043067+0000","last_unstale":"2024-04-26T23:28:25.038246+0000","last_undegraded":"2024-04-26T23:28:25.038246+0000","last_fullsized":"2024-04-26T23:28:25.038246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:36.812864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551761+0000","last_change":"2024-04-26T23:28:24.044273+0000","last_active":"2024-04-26T23:28:25.551761+0000","last_peered":"2024-04-26T23:28:25.551761+0000","last_clean":"2024-04-26T23:28:25.551761+0000","last_became_active":"2024-04-26T23:28:24.043992+0000","last_became_peered":"2024-04-26T23:28:24.043992+0000","last_unstale":"2024-04-26T23:28:25.551761+0000","last_undegraded":"2024-04-26T23:28:25.551761+0000","last_fullsized":"2024-04-26T23:28:25.551761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043479+0000","last_change":"2024-04-26T23:28:24.057145+0000","last_active":"2024-04-26T23:28:25.043479+0000","last_peered":"2024-04-26T23:28:25.043479+0000","last_clean":"2024-04-26T23:28:25.043479+0000","last_became_active":"2024-04-26T23:28:24.056844+0000","last_became_peered":"2024-04-26T23:28:24.056844+0000","last_unstale":"2024-04-26T23:28:25.043479+0000","last_undegraded":"2024-04-26T23:28:25.043479+0000","last_fullsized":"2024-04-26T23:28:25.043479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:24.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051893+0000","last_change":"2024-04-26T23:28:24.036405+0000","last_active":"2024-04-26T23:28:25.051893+0000","last_peered":"2024-04-26T23:28:25.051893+0000","last_clean":"2024-04-26T23:28:25.051893+0000","last_became_active":"2024-04-26T23:28:24.033678+0000","last_became_peered":"2024-04-26T23:28:24.033678+0000","last_unstale":"2024-04-26T23:28:25.051893+0000","last_undegraded":"2024-04-26T23:28:25.051893+0000","last_fullsized":"2024-04-26T23:28:25.051893+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:46:32.076248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042491+0000","last_change":"2024-04-26T23:28:24.037049+0000","last_active":"2024-04-26T23:28:25.042491+0000","last_peered":"2024-04-26T23:28:25.042491+0000","last_clean":"2024-04-26T23:28:25.042491+0000","last_became_active":"2024-04-26T23:28:24.036467+0000","last_became_peered":"2024-04-26T23:28:24.036467+0000","last_unstale":"2024-04-26T23:28:25.042491+0000","last_undegraded":"2024-04-26T23:28:25.042491+0000","last_fullsized":"2024-04-26T23:28:25.042491+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:34.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042136+0000","last_change":"2024-04-26T23:28:24.045936+0000","last_active":"2024-04-26T23:28:25.042136+0000","last_peered":"2024-04-26T23:28:25.042136+0000","last_clean":"2024-04-26T23:28:25.042136+0000","last_became_active":"2024-04-26T23:28:24.044876+0000","last_became_peered":"2024-04-26T23:28:24.044876+0000","last_unstale":"2024-04-26T23:28:25.042136+0000","last_undegraded":"2024-04-26T23:28:25.042136+0000","last_fullsized":"2024-04-26T23:28:25.042136+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154379+0000","last_change":"2024-04-26T23:28:24.036863+0000","last_active":"2024-04-26T23:28:25.154379+0000","last_peered":"2024-04-26T23:28:25.154379+0000","last_clean":"2024-04-26T23:28:25.154379+0000","last_became_active":"2024-04-26T23:28:24.036463+0000","last_became_peered":"2024-04-26T23:28:24.036463+0000","last_unstale":"2024-04-26T23:28:25.154379+0000","last_undegraded":"2024-04-26T23:28:25.154379+0000","last_fullsized":"2024-04-26T23:28:25.154379+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:19.321269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154222+0000","last_change":"2024-04-26T23:28:24.044275+0000","last_active":"2024-04-26T23:28:25.154222+0000","last_peered":"2024-04-26T23:28:25.154222+0000","last_clean":"2024-04-26T23:28:25.154222+0000","last_became_active":"2024-04-26T23:28:24.043981+0000","last_became_peered":"2024-04-26T23:28:24.043981+0000","last_unstale":"2024-04-26T23:28:25.154222+0000","last_undegraded":"2024-04-26T23:28:25.154222+0000","last_fullsized":"2024-04-26T23:28:25.154222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.295701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042511+0000","last_change":"2024-04-26T23:28:24.049207+0000","last_active":"2024-04-26T23:28:25.042511+0000","last_peered":"2024-04-26T23:28:25.042511+0000","last_clean":"2024-04-26T23:28:25.042511+0000","last_became_active":"2024-04-26T23:28:24.048950+0000","last_became_peered":"2024-04-26T23:28:24.048950+0000","last_unstale":"2024-04-26T23:28:25.042511+0000","last_undegraded":"2024-04-26T23:28:25.042511+0000","last_fullsized":"2024-04-26T23:28:25.042511+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:27.783525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049775+0000","last_change":"2024-04-26T23:28:24.041030+0000","last_active":"2024-04-26T23:28:25.049775+0000","last_peered":"2024-04-26T23:28:25.049775+0000","last_clean":"2024-04-26T23:28:25.049775+0000","last_became_active":"2024-04-26T23:28:24.040745+0000","last_became_peered":"2024-04-26T23:28:24.040745+0000","last_unstale":"2024-04-26T23:28:25.049775+0000","last_undegraded":"2024-04-26T23:28:25.049775+0000","last_fullsized":"2024-04-26T23:28:25.049775+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:40.885351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688154+0000","last_change":"2024-04-26T23:28:24.034100+0000","last_active":"2024-04-26T23:28:25.688154+0000","last_peered":"2024-04-26T23:28:25.688154+0000","last_clean":"2024-04-26T23:28:25.688154+0000","last_became_active":"2024-04-26T23:28:24.033801+0000","last_became_peered":"2024-04-26T23:28:24.033801+0000","last_unstale":"2024-04-26T23:28:25.688154+0000","last_undegraded":"2024-04-26T23:28:25.688154+0000","last_fullsized":"2024-04-26T23:28:25.688154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:49.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042349+0000","last_change":"2024-04-26T23:28:24.045193+0000","last_active":"2024-04-26T23:28:25.042349+0000","last_peered":"2024-04-26T23:28:25.042349+0000","last_clean":"2024-04-26T23:28:25.042349+0000","last_became_active":"2024-04-26T23:28:24.044903+0000","last_became_peered":"2024-04-26T23:28:24.044903+0000","last_unstale":"2024-04-26T23:28:25.042349+0000","last_undegraded":"2024-04-26T23:28:25.042349+0000","last_fullsized":"2024-04-26T23:28:25.042349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:25.423176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688121+0000","last_change":"2024-04-26T23:28:24.033245+0000","last_active":"2024-04-26T23:28:25.688121+0000","last_peered":"2024-04-26T23:28:25.688121+0000","last_clean":"2024-04-26T23:28:25.688121+0000","last_became_active":"2024-04-26T23:28:24.032918+0000","last_became_peered":"2024-04-26T23:28:24.032918+0000","last_unstale":"2024-04-26T23:28:25.688121+0000","last_undegraded":"2024-04-26T23:28:25.688121+0000","last_fullsized":"2024-04-26T23:28:25.688121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:14:03.508643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049511+0000","last_change":"2024-04-26T23:28:24.044262+0000","last_active":"2024-04-26T23:28:25.049511+0000","last_peered":"2024-04-26T23:28:25.049511+0000","last_clean":"2024-04-26T23:28:25.049511+0000","last_became_active":"2024-04-26T23:28:24.043986+0000","last_became_peered":"2024-04-26T23:28:24.043986+0000","last_unstale":"2024-04-26T23:28:25.049511+0000","last_undegraded":"2024-04-26T23:28:25.049511+0000","last_fullsized":"2024-04-26T23:28:25.049511+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:56.751773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049674+0000","last_change":"2024-04-26T23:28:24.035728+0000","last_active":"2024-04-26T23:28:25.049674+0000","last_peered":"2024-04-26T23:28:25.049674+0000","last_clean":"2024-04-26T23:28:25.049674+0000","last_became_active":"2024-04-26T23:28:24.035395+0000","last_became_peered":"2024-04-26T23:28:24.035395+0000","last_unstale":"2024-04-26T23:28:25.049674+0000","last_undegraded":"2024-04-26T23:28:25.049674+0000","last_fullsized":"2024-04-26T23:28:25.049674+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:04.408214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043936+0000","last_change":"2024-04-26T23:28:24.040945+0000","last_active":"2024-04-26T23:28:25.043936+0000","last_peered":"2024-04-26T23:28:25.043936+0000","last_clean":"2024-04-26T23:28:25.043936+0000","last_became_active":"2024-04-26T23:28:24.040390+0000","last_became_peered":"2024-04-26T23:28:24.040390+0000","last_unstale":"2024-04-26T23:28:25.043936+0000","last_undegraded":"2024-04-26T23:28:25.043936+0000","last_fullsized":"2024-04-26T23:28:25.043936+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154723+0000","last_change":"2024-04-26T23:28:24.060043+0000","last_active":"2024-04-26T23:28:25.154723+0000","last_peered":"2024-04-26T23:28:25.154723+0000","last_clean":"2024-04-26T23:28:25.154723+0000","last_became_active":"2024-04-26T23:28:24.059749+0000","last_became_peered":"2024-04-26T23:28:24.059749+0000","last_unstale":"2024-04-26T23:28:25.154723+0000","last_undegraded":"2024-04-26T23:28:25.154723+0000","last_fullsized":"2024-04-26T23:28:25.154723+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:51.153283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154913+0000","last_change":"2024-04-26T23:28:23.026627+0000","last_active":"2024-04-26T23:28:25.154913+0000","last_peered":"2024-04-26T23:28:25.154913+0000","last_clean":"2024-04-26T23:28:25.154913+0000","last_became_active":"2024-04-26T23:28:23.026354+0000","last_became_peered":"2024-04-26T23:28:23.026354+0000","last_unstale":"2024-04-26T23:28:25.154913+0000","last_undegraded":"2024-04-26T23:28:25.154913+0000","last_fullsized":"2024-04-26T23:28:25.154913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:03.401417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038320+0000","last_change":"2024-04-26T23:28:24.043315+0000","last_active":"2024-04-26T23:28:25.038320+0000","last_peered":"2024-04-26T23:28:25.038320+0000","last_clean":"2024-04-26T23:28:25.038320+0000","last_became_active":"2024-04-26T23:28:24.043020+0000","last_became_peered":"2024-04-26T23:28:24.043020+0000","last_unstale":"2024-04-26T23:28:25.038320+0000","last_undegraded":"2024-04-26T23:28:25.038320+0000","last_fullsized":"2024-04-26T23:28:25.038320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:03.649284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052069+0000","last_change":"2024-04-26T23:28:23.029967+0000","last_active":"2024-04-26T23:28:25.052069+0000","last_peered":"2024-04-26T23:28:25.052069+0000","last_clean":"2024-04-26T23:28:25.052069+0000","last_became_active":"2024-04-26T23:28:23.029584+0000","last_became_peered":"2024-04-26T23:28:23.029584+0000","last_unstale":"2024-04-26T23:28:25.052069+0000","last_undegraded":"2024-04-26T23:28:25.052069+0000","last_fullsized":"2024-04-26T23:28:25.052069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:26.776728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044066+0000","last_change":"2024-04-26T23:28:24.047913+0000","last_active":"2024-04-26T23:28:25.044066+0000","last_peered":"2024-04-26T23:28:25.044066+0000","last_clean":"2024-04-26T23:28:25.044066+0000","last_became_active":"2024-04-26T23:28:24.047531+0000","last_became_peered":"2024-04-26T23:28:24.047531+0000","last_unstale":"2024-04-26T23:28:25.044066+0000","last_undegraded":"2024-04-26T23:28:25.044066+0000","last_fullsized":"2024-04-26T23:28:25.044066+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:58.833727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042522+0000","last_change":"2024-04-26T23:28:23.024262+0000","last_active":"2024-04-26T23:28:25.042522+0000","last_peered":"2024-04-26T23:28:25.042522+0000","last_clean":"2024-04-26T23:28:25.042522+0000","last_became_active":"2024-04-26T23:28:23.023563+0000","last_became_peered":"2024-04-26T23:28:23.023563+0000","last_unstale":"2024-04-26T23:28:25.042522+0000","last_undegraded":"2024-04-26T23:28:25.042522+0000","last_fullsized":"2024-04-26T23:28:25.042522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:25.518931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154625+0000","last_change":"2024-04-26T23:28:24.044232+0000","last_active":"2024-04-26T23:28:25.154625+0000","last_peered":"2024-04-26T23:28:25.154625+0000","last_clean":"2024-04-26T23:28:25.154625+0000","last_became_active":"2024-04-26T23:28:24.044013+0000","last_became_peered":"2024-04-26T23:28:24.044013+0000","last_unstale":"2024-04-26T23:28:25.154625+0000","last_undegraded":"2024-04-26T23:28:25.154625+0000","last_fullsized":"2024-04-26T23:28:25.154625+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:08.969033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044175+0000","last_change":"2024-04-26T23:28:23.030731+0000","last_active":"2024-04-26T23:28:25.044175+0000","last_peered":"2024-04-26T23:28:25.044175+0000","last_clean":"2024-04-26T23:28:25.044175+0000","last_became_active":"2024-04-26T23:28:23.030398+0000","last_became_peered":"2024-04-26T23:28:23.030398+0000","last_unstale":"2024-04-26T23:28:25.044175+0000","last_undegraded":"2024-04-26T23:28:25.044175+0000","last_fullsized":"2024-04-26T23:28:25.044175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:43.581002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049599+0000","last_change":"2024-04-26T23:28:24.036172+0000","last_active":"2024-04-26T23:28:25.049599+0000","last_peered":"2024-04-26T23:28:25.049599+0000","last_clean":"2024-04-26T23:28:25.049599+0000","last_became_active":"2024-04-26T23:28:24.035845+0000","last_became_peered":"2024-04-26T23:28:24.035845+0000","last_unstale":"2024-04-26T23:28:25.049599+0000","last_undegraded":"2024-04-26T23:28:25.049599+0000","last_fullsized":"2024-04-26T23:28:25.049599+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:02.158666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688227+0000","last_change":"2024-04-26T23:28:23.026269+0000","last_active":"2024-04-26T23:28:25.688227+0000","last_peered":"2024-04-26T23:28:25.688227+0000","last_clean":"2024-04-26T23:28:25.688227+0000","last_became_active":"2024-04-26T23:28:23.025947+0000","last_became_peered":"2024-04-26T23:28:23.025947+0000","last_unstale":"2024-04-26T23:28:25.688227+0000","last_undegraded":"2024-04-26T23:28:25.688227+0000","last_fullsized":"2024-04-26T23:28:25.688227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:42.480149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042301+0000","last_change":"2024-04-26T23:28:24.037240+0000","last_active":"2024-04-26T23:28:25.042301+0000","last_peered":"2024-04-26T23:28:25.042301+0000","last_clean":"2024-04-26T23:28:25.042301+0000","last_became_active":"2024-04-26T23:28:24.036847+0000","last_became_peered":"2024-04-26T23:28:24.036847+0000","last_unstale":"2024-04-26T23:28:25.042301+0000","last_undegraded":"2024-04-26T23:28:25.042301+0000","last_fullsized":"2024-04-26T23:28:25.042301+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043514+0000","last_change":"2024-04-26T23:28:23.030290+0000","last_active":"2024-04-26T23:28:25.043514+0000","last_peered":"2024-04-26T23:28:25.043514+0000","last_clean":"2024-04-26T23:28:25.043514+0000","last_became_active":"2024-04-26T23:28:23.029990+0000","last_became_peered":"2024-04-26T23:28:23.029990+0000","last_unstale":"2024-04-26T23:28:25.043514+0000","last_undegraded":"2024-04-26T23:28:25.043514+0000","last_fullsized":"2024-04-26T23:28:25.043514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:06.527621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037203+0000","last_change":"2024-04-26T23:28:24.045079+0000","last_active":"2024-04-26T23:28:25.037203+0000","last_peered":"2024-04-26T23:28:25.037203+0000","last_clean":"2024-04-26T23:28:25.037203+0000","last_became_active":"2024-04-26T23:28:24.044829+0000","last_became_peered":"2024-04-26T23:28:24.044829+0000","last_unstale":"2024-04-26T23:28:25.037203+0000","last_undegraded":"2024-04-26T23:28:25.037203+0000","last_fullsized":"2024-04-26T23:28:25.037203+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:19.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551444+0000","last_change":"2024-04-26T23:28:23.023662+0000","last_active":"2024-04-26T23:28:25.551444+0000","last_peered":"2024-04-26T23:28:25.551444+0000","last_clean":"2024-04-26T23:28:25.551444+0000","last_became_active":"2024-04-26T23:28:23.023334+0000","last_became_peered":"2024-04-26T23:28:23.023334+0000","last_unstale":"2024-04-26T23:28:25.551444+0000","last_undegraded":"2024-04-26T23:28:25.551444+0000","last_fullsized":"2024-04-26T23:28:25.551444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:15.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052135+0000","last_change":"2024-04-26T23:28:24.036760+0000","last_active":"2024-04-26T23:28:25.052135+0000","last_peered":"2024-04-26T23:28:25.052135+0000","last_clean":"2024-04-26T23:28:25.052135+0000","last_became_active":"2024-04-26T23:28:24.035067+0000","last_became_peered":"2024-04-26T23:28:24.035067+0000","last_unstale":"2024-04-26T23:28:25.052135+0000","last_undegraded":"2024-04-26T23:28:25.052135+0000","last_fullsized":"2024-04-26T23:28:25.052135+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:02.158666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037169+0000","last_change":"2024-04-26T23:28:23.022148+0000","last_active":"2024-04-26T23:28:25.037169+0000","last_peered":"2024-04-26T23:28:25.037169+0000","last_clean":"2024-04-26T23:28:25.037169+0000","last_became_active":"2024-04-26T23:28:23.021889+0000","last_became_peered":"2024-04-26T23:28:23.021889+0000","last_unstale":"2024-04-26T23:28:25.037169+0000","last_undegraded":"2024-04-26T23:28:25.037169+0000","last_fullsized":"2024-04-26T23:28:25.037169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:41.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049808+0000","last_change":"2024-04-26T23:28:24.039189+0000","last_active":"2024-04-26T23:28:25.049808+0000","last_peered":"2024-04-26T23:28:25.049808+0000","last_clean":"2024-04-26T23:28:25.049808+0000","last_became_active":"2024-04-26T23:28:24.038911+0000","last_became_peered":"2024-04-26T23:28:24.038911+0000","last_unstale":"2024-04-26T23:28:25.049808+0000","last_undegraded":"2024-04-26T23:28:25.049808+0000","last_fullsized":"2024-04-26T23:28:25.049808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:07.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042633+0000","last_change":"2024-04-26T23:28:23.027147+0000","last_active":"2024-04-26T23:28:25.042633+0000","last_peered":"2024-04-26T23:28:25.042633+0000","last_clean":"2024-04-26T23:28:25.042633+0000","last_became_active":"2024-04-26T23:28:23.026895+0000","last_became_peered":"2024-04-26T23:28:23.026895+0000","last_unstale":"2024-04-26T23:28:25.042633+0000","last_undegraded":"2024-04-26T23:28:25.042633+0000","last_fullsized":"2024-04-26T23:28:25.042633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:00.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154880+0000","last_change":"2024-04-26T23:28:24.058932+0000","last_active":"2024-04-26T23:28:25.154880+0000","last_peered":"2024-04-26T23:28:25.154880+0000","last_clean":"2024-04-26T23:28:25.154880+0000","last_became_active":"2024-04-26T23:28:24.058640+0000","last_became_peered":"2024-04-26T23:28:24.058640+0000","last_unstale":"2024-04-26T23:28:25.154880+0000","last_undegraded":"2024-04-26T23:28:25.154880+0000","last_fullsized":"2024-04-26T23:28:25.154880+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:03.363649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043893+0000","last_change":"2024-04-26T23:28:23.030597+0000","last_active":"2024-04-26T23:28:25.043893+0000","last_peered":"2024-04-26T23:28:25.043893+0000","last_clean":"2024-04-26T23:28:25.043893+0000","last_became_active":"2024-04-26T23:28:23.030276+0000","last_became_peered":"2024-04-26T23:28:23.030276+0000","last_unstale":"2024-04-26T23:28:25.043893+0000","last_undegraded":"2024-04-26T23:28:25.043893+0000","last_fullsized":"2024-04-26T23:28:25.043893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:48.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044220+0000","last_change":"2024-04-26T23:28:24.055283+0000","last_active":"2024-04-26T23:28:25.044220+0000","last_peered":"2024-04-26T23:28:25.044220+0000","last_clean":"2024-04-26T23:28:25.044220+0000","last_became_active":"2024-04-26T23:28:24.055005+0000","last_became_peered":"2024-04-26T23:28:24.055005+0000","last_unstale":"2024-04-26T23:28:25.044220+0000","last_undegraded":"2024-04-26T23:28:25.044220+0000","last_fullsized":"2024-04-26T23:28:25.044220+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:34.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688293+0000","last_change":"2024-04-26T23:28:23.025307+0000","last_active":"2024-04-26T23:28:25.688293+0000","last_peered":"2024-04-26T23:28:25.688293+0000","last_clean":"2024-04-26T23:28:25.688293+0000","last_became_active":"2024-04-26T23:28:23.024972+0000","last_became_peered":"2024-04-26T23:28:23.024972+0000","last_unstale":"2024-04-26T23:28:25.688293+0000","last_undegraded":"2024-04-26T23:28:25.688293+0000","last_fullsized":"2024-04-26T23:28:25.688293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:01.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037823+0000","last_change":"2024-04-26T23:28:24.046389+0000","last_active":"2024-04-26T23:28:25.037823+0000","last_peered":"2024-04-26T23:28:25.037823+0000","last_clean":"2024-04-26T23:28:25.037823+0000","last_became_active":"2024-04-26T23:28:24.044751+0000","last_became_peered":"2024-04-26T23:28:24.044751+0000","last_unstale":"2024-04-26T23:28:25.037823+0000","last_undegraded":"2024-04-26T23:28:25.037823+0000","last_fullsized":"2024-04-26T23:28:25.037823+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:28.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551844+0000","last_change":"2024-04-26T23:28:23.029667+0000","last_active":"2024-04-26T23:28:25.551844+0000","last_peered":"2024-04-26T23:28:25.551844+0000","last_clean":"2024-04-26T23:28:25.551844+0000","last_became_active":"2024-04-26T23:28:23.029407+0000","last_became_peered":"2024-04-26T23:28:23.029407+0000","last_unstale":"2024-04-26T23:28:25.551844+0000","last_undegraded":"2024-04-26T23:28:25.551844+0000","last_fullsized":"2024-04-26T23:28:25.551844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:00.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154319+0000","last_change":"2024-04-26T23:28:24.050166+0000","last_active":"2024-04-26T23:28:25.154319+0000","last_peered":"2024-04-26T23:28:25.154319+0000","last_clean":"2024-04-26T23:28:25.154319+0000","last_became_active":"2024-04-26T23:28:24.049852+0000","last_became_peered":"2024-04-26T23:28:24.049852+0000","last_unstale":"2024-04-26T23:28:25.154319+0000","last_undegraded":"2024-04-26T23:28:25.154319+0000","last_fullsized":"2024-04-26T23:28:25.154319+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:00.935179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551558+0000","last_change":"2024-04-26T23:28:23.026572+0000","last_active":"2024-04-26T23:28:25.551558+0000","last_peered":"2024-04-26T23:28:25.551558+0000","last_clean":"2024-04-26T23:28:25.551558+0000","last_became_active":"2024-04-26T23:28:23.026302+0000","last_became_peered":"2024-04-26T23:28:23.026302+0000","last_unstale":"2024-04-26T23:28:25.551558+0000","last_undegraded":"2024-04-26T23:28:25.551558+0000","last_fullsized":"2024-04-26T23:28:25.551558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:23.971449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049485+0000","last_change":"2024-04-26T23:28:24.028689+0000","last_active":"2024-04-26T23:28:25.049485+0000","last_peered":"2024-04-26T23:28:25.049485+0000","last_clean":"2024-04-26T23:28:25.049485+0000","last_became_active":"2024-04-26T23:28:24.027540+0000","last_became_peered":"2024-04-26T23:28:24.027540+0000","last_unstale":"2024-04-26T23:28:25.049485+0000","last_undegraded":"2024-04-26T23:28:25.049485+0000","last_fullsized":"2024-04-26T23:28:25.049485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:53.664624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043619+0000","last_change":"2024-04-26T23:28:23.030347+0000","last_active":"2024-04-26T23:28:25.043619+0000","last_peered":"2024-04-26T23:28:25.043619+0000","last_clean":"2024-04-26T23:28:25.043619+0000","last_became_active":"2024-04-26T23:28:23.030022+0000","last_became_peered":"2024-04-26T23:28:23.030022+0000","last_unstale":"2024-04-26T23:28:25.043619+0000","last_undegraded":"2024-04-26T23:28:25.043619+0000","last_fullsized":"2024-04-26T23:28:25.043619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:03.925993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052070+0000","last_change":"2024-04-26T23:28:24.049271+0000","last_active":"2024-04-26T23:28:25.052070+0000","last_peered":"2024-04-26T23:28:25.052070+0000","last_clean":"2024-04-26T23:28:25.052070+0000","last_became_active":"2024-04-26T23:28:24.048957+0000","last_became_peered":"2024-04-26T23:28:24.048957+0000","last_unstale":"2024-04-26T23:28:25.052070+0000","last_undegraded":"2024-04-26T23:28:25.052070+0000","last_fullsized":"2024-04-26T23:28:25.052070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:53.664624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049427+0000","last_change":"2024-04-26T23:28:23.024929+0000","last_active":"2024-04-26T23:28:25.049427+0000","last_peered":"2024-04-26T23:28:25.049427+0000","last_clean":"2024-04-26T23:28:25.049427+0000","last_became_active":"2024-04-26T23:28:23.024653+0000","last_became_peered":"2024-04-26T23:28:23.024653+0000","last_unstale":"2024-04-26T23:28:25.049427+0000","last_undegraded":"2024-04-26T23:28:25.049427+0000","last_fullsized":"2024-04-26T23:28:25.049427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:24.416379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037236+0000","last_change":"2024-04-26T23:28:24.036901+0000","last_active":"2024-04-26T23:28:25.037236+0000","last_peered":"2024-04-26T23:28:25.037236+0000","last_clean":"2024-04-26T23:28:25.037236+0000","last_became_active":"2024-04-26T23:28:24.036618+0000","last_became_peered":"2024-04-26T23:28:24.036618+0000","last_unstale":"2024-04-26T23:28:25.037236+0000","last_undegraded":"2024-04-26T23:28:25.037236+0000","last_fullsized":"2024-04-26T23:28:25.037236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:55.727039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042035+0000","last_change":"2024-04-26T23:28:23.020736+0000","last_active":"2024-04-26T23:28:25.042035+0000","last_peered":"2024-04-26T23:28:25.042035+0000","last_clean":"2024-04-26T23:28:25.042035+0000","last_became_active":"2024-04-26T23:28:23.020403+0000","last_became_peered":"2024-04-26T23:28:23.020403+0000","last_unstale":"2024-04-26T23:28:25.042035+0000","last_undegraded":"2024-04-26T23:28:25.042035+0000","last_fullsized":"2024-04-26T23:28:25.042035+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:15.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042664+0000","last_change":"2024-04-26T23:28:24.031369+0000","last_active":"2024-04-26T23:28:25.042664+0000","last_peered":"2024-04-26T23:28:25.042664+0000","last_clean":"2024-04-26T23:28:25.042664+0000","last_became_active":"2024-04-26T23:28:24.030854+0000","last_became_peered":"2024-04-26T23:28:24.030854+0000","last_unstale":"2024-04-26T23:28:25.042664+0000","last_undegraded":"2024-04-26T23:28:25.042664+0000","last_fullsized":"2024-04-26T23:28:25.042664+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:12.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043525+0000","last_change":"2024-04-26T23:28:23.030723+0000","last_active":"2024-04-26T23:28:25.043525+0000","last_peered":"2024-04-26T23:28:25.043525+0000","last_clean":"2024-04-26T23:28:25.043525+0000","last_became_active":"2024-04-26T23:28:23.028192+0000","last_became_peered":"2024-04-26T23:28:23.028192+0000","last_unstale":"2024-04-26T23:28:25.043525+0000","last_undegraded":"2024-04-26T23:28:25.043525+0000","last_fullsized":"2024-04-26T23:28:25.043525+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:09.048842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154846+0000","last_change":"2024-04-26T23:28:24.051249+0000","last_active":"2024-04-26T23:28:25.154846+0000","last_peered":"2024-04-26T23:28:25.154846+0000","last_clean":"2024-04-26T23:28:25.154846+0000","last_became_active":"2024-04-26T23:28:24.048875+0000","last_became_peered":"2024-04-26T23:28:24.048875+0000","last_unstale":"2024-04-26T23:28:25.154846+0000","last_undegraded":"2024-04-26T23:28:25.154846+0000","last_fullsized":"2024-04-26T23:28:25.154846+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:16.824768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042668+0000","last_change":"2024-04-26T23:28:23.023891+0000","last_active":"2024-04-26T23:28:25.042668+0000","last_peered":"2024-04-26T23:28:25.042668+0000","last_clean":"2024-04-26T23:28:25.042668+0000","last_became_active":"2024-04-26T23:28:23.023595+0000","last_became_peered":"2024-04-26T23:28:23.023595+0000","last_unstale":"2024-04-26T23:28:25.042668+0000","last_undegraded":"2024-04-26T23:28:25.042668+0000","last_fullsized":"2024-04-26T23:28:25.042668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:23.971449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551822+0000","last_change":"2024-04-26T23:28:24.038353+0000","last_active":"2024-04-26T23:28:25.551822+0000","last_peered":"2024-04-26T23:28:25.551822+0000","last_clean":"2024-04-26T23:28:25.551822+0000","last_became_active":"2024-04-26T23:28:24.038098+0000","last_became_peered":"2024-04-26T23:28:24.038098+0000","last_unstale":"2024-04-26T23:28:25.551822+0000","last_undegraded":"2024-04-26T23:28:25.551822+0000","last_fullsized":"2024-04-26T23:28:25.551822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043679+0000","last_change":"2024-04-26T23:28:23.029299+0000","last_active":"2024-04-26T23:28:25.043679+0000","last_peered":"2024-04-26T23:28:25.043679+0000","last_clean":"2024-04-26T23:28:25.043679+0000","last_became_active":"2024-04-26T23:28:23.028628+0000","last_became_peered":"2024-04-26T23:28:23.028628+0000","last_unstale":"2024-04-26T23:28:25.043679+0000","last_undegraded":"2024-04-26T23:28:25.043679+0000","last_fullsized":"2024-04-26T23:28:25.043679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:09.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037954+0000","last_change":"2024-04-26T23:28:24.046401+0000","last_active":"2024-04-26T23:28:25.037954+0000","last_peered":"2024-04-26T23:28:25.037954+0000","last_clean":"2024-04-26T23:28:25.037954+0000","last_became_active":"2024-04-26T23:28:24.045124+0000","last_became_peered":"2024-04-26T23:28:24.045124+0000","last_unstale":"2024-04-26T23:28:25.037954+0000","last_undegraded":"2024-04-26T23:28:25.037954+0000","last_fullsized":"2024-04-26T23:28:25.037954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:25.359753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154484+0000","last_change":"2024-04-26T23:28:23.027660+0000","last_active":"2024-04-26T23:28:25.154484+0000","last_peered":"2024-04-26T23:28:25.154484+0000","last_clean":"2024-04-26T23:28:25.154484+0000","last_became_active":"2024-04-26T23:28:23.027196+0000","last_became_peered":"2024-04-26T23:28:23.027196+0000","last_unstale":"2024-04-26T23:28:25.154484+0000","last_undegraded":"2024-04-26T23:28:25.154484+0000","last_fullsized":"2024-04-26T23:28:25.154484+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:57.723838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688105+0000","last_change":"2024-04-26T23:28:24.042585+0000","last_active":"2024-04-26T23:28:25.688105+0000","last_peered":"2024-04-26T23:28:25.688105+0000","last_clean":"2024-04-26T23:28:25.688105+0000","last_became_active":"2024-04-26T23:28:24.042245+0000","last_became_peered":"2024-04-26T23:28:24.042245+0000","last_unstale":"2024-04-26T23:28:25.688105+0000","last_undegraded":"2024-04-26T23:28:25.688105+0000","last_fullsized":"2024-04-26T23:28:25.688105+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:03:42.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043720+0000","last_change":"2024-04-26T23:28:23.028327+0000","last_active":"2024-04-26T23:28:25.043720+0000","last_peered":"2024-04-26T23:28:25.043720+0000","last_clean":"2024-04-26T23:28:25.043720+0000","last_became_active":"2024-04-26T23:28:23.028034+0000","last_became_peered":"2024-04-26T23:28:23.028034+0000","last_unstale":"2024-04-26T23:28:25.043720+0000","last_undegraded":"2024-04-26T23:28:25.043720+0000","last_fullsized":"2024-04-26T23:28:25.043720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:55.874396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688029+0000","last_change":"2024-04-26T23:28:24.042122+0000","last_active":"2024-04-26T23:28:25.688029+0000","last_peered":"2024-04-26T23:28:25.688029+0000","last_clean":"2024-04-26T23:28:25.688029+0000","last_became_active":"2024-04-26T23:28:24.041762+0000","last_became_peered":"2024-04-26T23:28:24.041762+0000","last_unstale":"2024-04-26T23:28:25.688029+0000","last_undegraded":"2024-04-26T23:28:25.688029+0000","last_fullsized":"2024-04-26T23:28:25.688029+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:03.363649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049599+0000","last_change":"2024-04-26T23:28:23.021218+0000","last_active":"2024-04-26T23:28:25.049599+0000","last_peered":"2024-04-26T23:28:25.049599+0000","last_clean":"2024-04-26T23:28:25.049599+0000","last_became_active":"2024-04-26T23:28:23.020957+0000","last_became_peered":"2024-04-26T23:28:23.020957+0000","last_unstale":"2024-04-26T23:28:25.049599+0000","last_undegraded":"2024-04-26T23:28:25.049599+0000","last_fullsized":"2024-04-26T23:28:25.049599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:57.826930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.687933+0000","last_change":"2024-04-26T23:28:24.046807+0000","last_active":"2024-04-26T23:28:25.687933+0000","last_peered":"2024-04-26T23:28:25.687933+0000","last_clean":"2024-04-26T23:28:25.687933+0000","last_became_active":"2024-04-26T23:28:24.046454+0000","last_became_peered":"2024-04-26T23:28:24.046454+0000","last_unstale":"2024-04-26T23:28:25.687933+0000","last_undegraded":"2024-04-26T23:28:25.687933+0000","last_fullsized":"2024-04-26T23:28:25.687933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:33.510843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051806+0000","last_change":"2024-04-26T23:28:23.029684+0000","last_active":"2024-04-26T23:28:25.051806+0000","last_peered":"2024-04-26T23:28:25.051806+0000","last_clean":"2024-04-26T23:28:25.051806+0000","last_became_active":"2024-04-26T23:28:23.029012+0000","last_became_peered":"2024-04-26T23:28:23.029012+0000","last_unstale":"2024-04-26T23:28:25.051806+0000","last_undegraded":"2024-04-26T23:28:25.051806+0000","last_fullsized":"2024-04-26T23:28:25.051806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:57.826930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052135+0000","last_change":"2024-04-26T23:28:24.042346+0000","last_active":"2024-04-26T23:28:25.052135+0000","last_peered":"2024-04-26T23:28:25.052135+0000","last_clean":"2024-04-26T23:28:25.052135+0000","last_became_active":"2024-04-26T23:28:24.042072+0000","last_became_peered":"2024-04-26T23:28:24.042072+0000","last_unstale":"2024-04-26T23:28:25.052135+0000","last_undegraded":"2024-04-26T23:28:25.052135+0000","last_fullsized":"2024-04-26T23:28:25.052135+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:56.751773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043650+0000","last_change":"2024-04-26T23:28:23.029366+0000","last_active":"2024-04-26T23:28:25.043650+0000","last_peered":"2024-04-26T23:28:25.043650+0000","last_clean":"2024-04-26T23:28:25.043650+0000","last_became_active":"2024-04-26T23:28:23.029052+0000","last_became_peered":"2024-04-26T23:28:23.029052+0000","last_unstale":"2024-04-26T23:28:25.043650+0000","last_undegraded":"2024-04-26T23:28:25.043650+0000","last_fullsized":"2024-04-26T23:28:25.043650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:02.642488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049709+0000","last_change":"2024-04-26T23:28:24.040323+0000","last_active":"2024-04-26T23:28:25.049709+0000","last_peered":"2024-04-26T23:28:25.049709+0000","last_clean":"2024-04-26T23:28:25.049709+0000","last_became_active":"2024-04-26T23:28:24.040053+0000","last_became_peered":"2024-04-26T23:28:24.040053+0000","last_unstale":"2024-04-26T23:28:25.049709+0000","last_undegraded":"2024-04-26T23:28:25.049709+0000","last_fullsized":"2024-04-26T23:28:25.049709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:58.730635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051268+0000","last_change":"2024-04-26T23:28:23.024995+0000","last_active":"2024-04-26T23:28:25.051268+0000","last_peered":"2024-04-26T23:28:25.051268+0000","last_clean":"2024-04-26T23:28:25.051268+0000","last_became_active":"2024-04-26T23:28:23.024726+0000","last_became_peered":"2024-04-26T23:28:23.024726+0000","last_unstale":"2024-04-26T23:28:25.051268+0000","last_undegraded":"2024-04-26T23:28:25.051268+0000","last_fullsized":"2024-04-26T23:28:25.051268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:33.353768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154490+0000","last_change":"2024-04-26T23:28:24.045314+0000","last_active":"2024-04-26T23:28:25.154490+0000","last_peered":"2024-04-26T23:28:25.154490+0000","last_clean":"2024-04-26T23:28:25.154490+0000","last_became_active":"2024-04-26T23:28:24.045036+0000","last_became_peered":"2024-04-26T23:28:24.045036+0000","last_unstale":"2024-04-26T23:28:25.154490+0000","last_undegraded":"2024-04-26T23:28:25.154490+0000","last_fullsized":"2024-04-26T23:28:25.154490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:13.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038036+0000","last_change":"2024-04-26T23:28:23.024764+0000","last_active":"2024-04-26T23:28:25.038036+0000","last_peered":"2024-04-26T23:28:25.038036+0000","last_clean":"2024-04-26T23:28:25.038036+0000","last_became_active":"2024-04-26T23:28:23.023438+0000","last_became_peered":"2024-04-26T23:28:23.023438+0000","last_unstale":"2024-04-26T23:28:25.038036+0000","last_undegraded":"2024-04-26T23:28:25.038036+0000","last_fullsized":"2024-04-26T23:28:25.038036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:29:36.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154737+0000","last_change":"2024-04-26T23:28:24.042281+0000","last_active":"2024-04-26T23:28:25.154737+0000","last_peered":"2024-04-26T23:28:25.154737+0000","last_clean":"2024-04-26T23:28:25.154737+0000","last_became_active":"2024-04-26T23:28:24.042019+0000","last_became_peered":"2024-04-26T23:28:24.042019+0000","last_unstale":"2024-04-26T23:28:25.154737+0000","last_undegraded":"2024-04-26T23:28:25.154737+0000","last_fullsized":"2024-04-26T23:28:25.154737+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:33.510843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051928+0000","last_change":"2024-04-26T23:28:23.018442+0000","last_active":"2024-04-26T23:28:25.051928+0000","last_peered":"2024-04-26T23:28:25.051928+0000","last_clean":"2024-04-26T23:28:25.051928+0000","last_became_active":"2024-04-26T23:28:23.018167+0000","last_became_peered":"2024-04-26T23:28:23.018167+0000","last_unstale":"2024-04-26T23:28:25.051928+0000","last_undegraded":"2024-04-26T23:28:25.051928+0000","last_fullsized":"2024-04-26T23:28:25.051928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:33.353768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037620+0000","last_change":"2024-04-26T23:28:24.043756+0000","last_active":"2024-04-26T23:28:25.037620+0000","last_peered":"2024-04-26T23:28:25.037620+0000","last_clean":"2024-04-26T23:28:25.037620+0000","last_became_active":"2024-04-26T23:28:24.043350+0000","last_became_peered":"2024-04-26T23:28:24.043350+0000","last_unstale":"2024-04-26T23:28:25.037620+0000","last_undegraded":"2024-04-26T23:28:25.037620+0000","last_fullsized":"2024-04-26T23:28:25.037620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:24.615728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037584+0000","last_change":"2024-04-26T23:28:23.020353+0000","last_active":"2024-04-26T23:28:25.037584+0000","last_peered":"2024-04-26T23:28:25.037584+0000","last_clean":"2024-04-26T23:28:25.037584+0000","last_became_active":"2024-04-26T23:28:23.020053+0000","last_became_peered":"2024-04-26T23:28:23.020053+0000","last_unstale":"2024-04-26T23:28:25.037584+0000","last_undegraded":"2024-04-26T23:28:25.037584+0000","last_fullsized":"2024-04-26T23:28:25.037584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:11.147821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043297+0000","last_change":"2024-04-26T23:28:24.047620+0000","last_active":"2024-04-26T23:28:25.043297+0000","last_peered":"2024-04-26T23:28:25.043297+0000","last_clean":"2024-04-26T23:28:25.043297+0000","last_became_active":"2024-04-26T23:28:24.047275+0000","last_became_peered":"2024-04-26T23:28:24.047275+0000","last_unstale":"2024-04-26T23:28:25.043297+0000","last_undegraded":"2024-04-26T23:28:25.043297+0000","last_fullsized":"2024-04-26T23:28:25.043297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:07.023168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551402+0000","last_change":"2024-04-26T23:28:23.024077+0000","last_active":"2024-04-26T23:28:25.551402+0000","last_peered":"2024-04-26T23:28:25.551402+0000","last_clean":"2024-04-26T23:28:25.551402+0000","last_became_active":"2024-04-26T23:28:23.023318+0000","last_became_peered":"2024-04-26T23:28:23.023318+0000","last_unstale":"2024-04-26T23:28:25.551402+0000","last_undegraded":"2024-04-26T23:28:25.551402+0000","last_fullsized":"2024-04-26T23:28:25.551402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:32.736217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551544+0000","last_change":"2024-04-26T23:28:24.032089+0000","last_active":"2024-04-26T23:28:25.551544+0000","last_peered":"2024-04-26T23:28:25.551544+0000","last_clean":"2024-04-26T23:28:25.551544+0000","last_became_active":"2024-04-26T23:28:24.030765+0000","last_became_peered":"2024-04-26T23:28:24.030765+0000","last_unstale":"2024-04-26T23:28:25.551544+0000","last_undegraded":"2024-04-26T23:28:25.551544+0000","last_fullsized":"2024-04-26T23:28:25.551544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:07.023168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.041949+0000","last_change":"2024-04-26T23:28:23.022333+0000","last_active":"2024-04-26T23:28:25.041949+0000","last_peered":"2024-04-26T23:28:25.041949+0000","last_clean":"2024-04-26T23:28:25.041949+0000","last_became_active":"2024-04-26T23:28:23.022026+0000","last_became_peered":"2024-04-26T23:28:23.022026+0000","last_unstale":"2024-04-26T23:28:25.041949+0000","last_undegraded":"2024-04-26T23:28:25.041949+0000","last_fullsized":"2024-04-26T23:28:25.041949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:32.736217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044039+0000","last_change":"2024-04-26T23:28:24.054898+0000","last_active":"2024-04-26T23:28:25.044039+0000","last_peered":"2024-04-26T23:28:25.044039+0000","last_clean":"2024-04-26T23:28:25.044039+0000","last_became_active":"2024-04-26T23:28:24.054526+0000","last_became_peered":"2024-04-26T23:28:24.054526+0000","last_unstale":"2024-04-26T23:28:25.044039+0000","last_undegraded":"2024-04-26T23:28:25.044039+0000","last_fullsized":"2024-04-26T23:28:25.044039+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:25.423176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044042+0000","last_change":"2024-04-26T23:28:23.030192+0000","last_active":"2024-04-26T23:28:25.044042+0000","last_peered":"2024-04-26T23:28:25.044042+0000","last_clean":"2024-04-26T23:28:25.044042+0000","last_became_active":"2024-04-26T23:28:23.029809+0000","last_became_peered":"2024-04-26T23:28:23.029809+0000","last_unstale":"2024-04-26T23:28:25.044042+0000","last_undegraded":"2024-04-26T23:28:25.044042+0000","last_fullsized":"2024-04-26T23:28:25.044042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:56.886673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688004+0000","last_change":"2024-04-26T23:28:24.047419+0000","last_active":"2024-04-26T23:28:25.688004+0000","last_peered":"2024-04-26T23:28:25.688004+0000","last_clean":"2024-04-26T23:28:25.688004+0000","last_became_active":"2024-04-26T23:28:24.047142+0000","last_became_peered":"2024-04-26T23:28:24.047142+0000","last_unstale":"2024-04-26T23:28:25.688004+0000","last_undegraded":"2024-04-26T23:28:25.688004+0000","last_fullsized":"2024-04-26T23:28:25.688004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:16.824768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043311+0000","last_change":"2024-04-26T23:28:23.027353+0000","last_active":"2024-04-26T23:28:25.043311+0000","last_peered":"2024-04-26T23:28:25.043311+0000","last_clean":"2024-04-26T23:28:25.043311+0000","last_became_active":"2024-04-26T23:28:23.026996+0000","last_became_peered":"2024-04-26T23:28:23.026996+0000","last_unstale":"2024-04-26T23:28:25.043311+0000","last_undegraded":"2024-04-26T23:28:25.043311+0000","last_fullsized":"2024-04-26T23:28:25.043311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:28.325739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154141+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:28:25.154141+0000","last_peered":"2024-04-26T23:28:25.154141+0000","last_clean":"2024-04-26T23:28:25.154141+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:28:25.154141+0000","last_undegraded":"2024-04-26T23:28:25.154141+0000","last_fullsized":"2024-04-26T23:28:25.154141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1368064,"data_stored":918684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":327792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":327790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":327770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":327812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":778240,"data_stored":329312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":329928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1359872,"data_stored":918068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:28:28.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:28:28.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.342+0000 7efcae200640 1 Processor -- start 2024-04-26T23:28:28.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.342+0000 7efcae200640 1 -- start start 2024-04-26T23:28:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efcae200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efca809c0f0 0x7efca80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efcae200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca809c7a0 con 0x7efca815d170 2024-04-26T23:28:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efcae200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca80d1b70 con 0x7efca80d1640 2024-04-26T23:28:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efcae200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efca80c6be0 con 0x7efca809c0f0 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efca809c0f0 0x7efca80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efca809c0f0 0x7efca80b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43814/0 (socket says 172.21.15.39:43814) 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 -- 172.21.15.39:0/2414238441 learned_addr learned my addr 172.21.15.39:0/2414238441 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca7400640 1 --1- 172.21.15.39:0/2414238441 >> v1:172.21.15.39:6789/0 conn(0x7efca815d170 0x7efca809b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42722/0 (socket says 172.21.15.39:42722) 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 -- 172.21.15.39:0/2414238441 >> v1:172.21.15.71:6789/0 conn(0x7efca80d1640 legacy=0x7efca80c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 -- 172.21.15.39:0/2414238441 >> v1:172.21.15.39:6789/0 conn(0x7efca815d170 legacy=0x7efca809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.346+0000 7efca6a00640 1 -- 172.21.15.39:0/2414238441 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca80d1e50 con 0x7efca809c0f0 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efca6a00640 1 --2- 172.21.15.39:0/2414238441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca80b56a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efc94009870 tx=0x7efc9401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50731f552a50e6b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efca6000640 1 -- 172.21.15.39:0/2414238441 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940b2070 con 0x7efca809c0f0 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efca6000640 1 -- 172.21.15.39:0/2414238441 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc940ad680 con 0x7efca809c0f0 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efca6000640 1 -- 172.21.15.39:0/2414238441 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940ada50 con 0x7efca809c0f0 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- 172.21.15.39:0/2414238441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 msgr2=0x7efca80b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 --2- 172.21.15.39:0/2414238441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca80b56a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efc94009870 tx=0x7efc9401c490 comp rx=0 tx=0).stop 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- 172.21.15.39:0/2414238441 shutdown_connections 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 --2- 172.21.15.39:0/2414238441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca80b56a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- 172.21.15.39:0/2414238441 >> 172.21.15.39:0/2414238441 conn(0x7efca80b4b80 msgr2=0x7efca80b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- 172.21.15.39:0/2414238441 shutdown_connections 2024-04-26T23:28:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- 172.21.15.39:0/2414238441 wait complete. 2024-04-26T23:28:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 Processor -- start 2024-04-26T23:28:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- start start 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efca80d1640 0x7efca815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 0x7efca815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c8920 con 0x7efca809c0f0 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c87a0 con 0x7efca815d170 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.350+0000 7efcae200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efca816af60 con 0x7efca80d1640 2024-04-26T23:28:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43816/0 (socket says 172.21.15.39:43816) 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 -- 172.21.15.39:0/1050044789 learned_addr learned my addr 172.21.15.39:0/1050044789 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca6a00640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efca80d1640 0x7efca815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7e00640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 0x7efca815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 -- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efca80d1640 msgr2=0x7efca815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efca80d1640 0x7efca815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 -- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 msgr2=0x7efca815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 0x7efca815fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 -- 172.21.15.39:0/1050044789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca815ec20 con 0x7efca809c0f0 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7e00640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 0x7efca815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:28.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efca7400640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c370 tx=0x7efc9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc980074e0 con 0x7efca809c0f0 2024-04-26T23:28:28.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc98007680 con 0x7efca809c0f0 2024-04-26T23:28:28.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98004a30 con 0x7efca809c0f0 2024-04-26T23:28:28.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca815ef00 con 0x7efca809c0f0 2024-04-26T23:28:28.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca8165260 con 0x7efca809c0f0 2024-04-26T23:28:28.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca8165050 con 0x7efca809c0f0 2024-04-26T23:28:28.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7efc9801a020 con 0x7efca809c0f0 2024-04-26T23:28:28.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.354+0000 7efc9f400640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 0x7efc8806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.358+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7efc98086200 con 0x7efca809c0f0 2024-04-26T23:28:28.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.358+0000 7efca6a00640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 0x7efc8806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.358+0000 7efca6a00640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 0x7efc8806a8d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efc940af000 tx=0x7efc940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.362+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc980566d0 con 0x7efca809c0f0 2024-04-26T23:28:28.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.522+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efca8050740 con 0x7efc88068410 2024-04-26T23:28:28.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efc9f400640 1 -- 172.21.15.39:0/1050044789 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7efca8050740 con 0x7efc88068410 2024-04-26T23:28:28.535 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:28.536 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 msgr2=0x7efc8806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 0x7efc8806a8d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efc940af000 tx=0x7efc940a7000 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 msgr2=0x7efca815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c370 tx=0x7efc9800c830 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 shutdown_connections 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efc88068410 0x7efc8806a8d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efca815d170 0x7efca815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efca80d1640 0x7efca815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 --2- 172.21.15.39:0/1050044789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efca809c0f0 0x7efca815af20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.530+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 >> 172.21.15.39:0/1050044789 conn(0x7efca80b4b80 msgr2=0x7efca80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:28.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.534+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 shutdown_connections 2024-04-26T23:28:28.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.534+0000 7efcae200640 1 -- 172.21.15.39:0/1050044789 wait complete. 2024-04-26T23:28:28.556 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-04-26T23:28:27.687743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240048,"kb_used_data":7208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734672,"statfs":{"total":773094113280,"available":772848304128,"internally_reserved":0,"allocated":7380992,"data_stored":3807156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.687417"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154728+0000","last_change":"2024-04-26T23:28:24.051472+0000","last_active":"2024-04-26T23:28:25.154728+0000","last_peered":"2024-04-26T23:28:25.154728+0000","last_clean":"2024-04-26T23:28:25.154728+0000","last_became_active":"2024-04-26T23:28:24.050967+0000","last_became_peered":"2024-04-26T23:28:24.050967+0000","last_unstale":"2024-04-26T23:28:25.154728+0000","last_undegraded":"2024-04-26T23:28:25.154728+0000","last_fullsized":"2024-04-26T23:28:25.154728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:12.074259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043745+0000","last_change":"2024-04-26T23:28:24.043561+0000","last_active":"2024-04-26T23:28:25.043745+0000","last_peered":"2024-04-26T23:28:25.043745+0000","last_clean":"2024-04-26T23:28:25.043745+0000","last_became_active":"2024-04-26T23:28:24.043275+0000","last_became_peered":"2024-04-26T23:28:24.043275+0000","last_unstale":"2024-04-26T23:28:25.043745+0000","last_undegraded":"2024-04-26T23:28:25.043745+0000","last_fullsized":"2024-04-26T23:28:25.043745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688279+0000","last_change":"2024-04-26T23:28:24.037186+0000","last_active":"2024-04-26T23:28:25.688279+0000","last_peered":"2024-04-26T23:28:25.688279+0000","last_clean":"2024-04-26T23:28:25.688279+0000","last_became_active":"2024-04-26T23:28:24.035379+0000","last_became_peered":"2024-04-26T23:28:24.035379+0000","last_unstale":"2024-04-26T23:28:25.688279+0000","last_undegraded":"2024-04-26T23:28:25.688279+0000","last_fullsized":"2024-04-26T23:28:25.688279+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:16:13.252889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551676+0000","last_change":"2024-04-26T23:28:24.057439+0000","last_active":"2024-04-26T23:28:25.551676+0000","last_peered":"2024-04-26T23:28:25.551676+0000","last_clean":"2024-04-26T23:28:25.551676+0000","last_became_active":"2024-04-26T23:28:24.057160+0000","last_became_peered":"2024-04-26T23:28:24.057160+0000","last_unstale":"2024-04-26T23:28:25.551676+0000","last_undegraded":"2024-04-26T23:28:25.551676+0000","last_fullsized":"2024-04-26T23:28:25.551676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:24.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037522+0000","last_change":"2024-04-26T23:28:24.041677+0000","last_active":"2024-04-26T23:28:25.037522+0000","last_peered":"2024-04-26T23:28:25.037522+0000","last_clean":"2024-04-26T23:28:25.037522+0000","last_became_active":"2024-04-26T23:28:24.041407+0000","last_became_peered":"2024-04-26T23:28:24.041407+0000","last_unstale":"2024-04-26T23:28:25.037522+0000","last_undegraded":"2024-04-26T23:28:25.037522+0000","last_fullsized":"2024-04-26T23:28:25.037522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:37.414882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044252+0000","last_change":"2024-04-26T23:28:24.057506+0000","last_active":"2024-04-26T23:28:25.044252+0000","last_peered":"2024-04-26T23:28:25.044252+0000","last_clean":"2024-04-26T23:28:25.044252+0000","last_became_active":"2024-04-26T23:28:24.057165+0000","last_became_peered":"2024-04-26T23:28:24.057165+0000","last_unstale":"2024-04-26T23:28:25.044252+0000","last_undegraded":"2024-04-26T23:28:25.044252+0000","last_fullsized":"2024-04-26T23:28:25.044252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049436+0000","last_change":"2024-04-26T23:28:24.039430+0000","last_active":"2024-04-26T23:28:25.049436+0000","last_peered":"2024-04-26T23:28:25.049436+0000","last_clean":"2024-04-26T23:28:25.049436+0000","last_became_active":"2024-04-26T23:28:24.037763+0000","last_became_peered":"2024-04-26T23:28:24.037763+0000","last_unstale":"2024-04-26T23:28:25.049436+0000","last_undegraded":"2024-04-26T23:28:25.049436+0000","last_fullsized":"2024-04-26T23:28:25.049436+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:09.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044015+0000","last_change":"2024-04-26T23:28:24.059136+0000","last_active":"2024-04-26T23:28:25.044015+0000","last_peered":"2024-04-26T23:28:25.044015+0000","last_clean":"2024-04-26T23:28:25.044015+0000","last_became_active":"2024-04-26T23:28:24.056667+0000","last_became_peered":"2024-04-26T23:28:24.056667+0000","last_unstale":"2024-04-26T23:28:25.044015+0000","last_undegraded":"2024-04-26T23:28:25.044015+0000","last_fullsized":"2024-04-26T23:28:25.044015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038263+0000","last_change":"2024-04-26T23:28:24.049081+0000","last_active":"2024-04-26T23:28:25.038263+0000","last_peered":"2024-04-26T23:28:25.038263+0000","last_clean":"2024-04-26T23:28:25.038263+0000","last_became_active":"2024-04-26T23:28:24.048769+0000","last_became_peered":"2024-04-26T23:28:24.048769+0000","last_unstale":"2024-04-26T23:28:25.038263+0000","last_undegraded":"2024-04-26T23:28:25.038263+0000","last_fullsized":"2024-04-26T23:28:25.038263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:10.055639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042387+0000","last_change":"2024-04-26T23:28:24.046642+0000","last_active":"2024-04-26T23:28:25.042387+0000","last_peered":"2024-04-26T23:28:25.042387+0000","last_clean":"2024-04-26T23:28:25.042387+0000","last_became_active":"2024-04-26T23:28:24.045227+0000","last_became_peered":"2024-04-26T23:28:24.045227+0000","last_unstale":"2024-04-26T23:28:25.042387+0000","last_undegraded":"2024-04-26T23:28:25.042387+0000","last_fullsized":"2024-04-26T23:28:25.042387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:58.833727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154580+0000","last_change":"2024-04-26T23:28:24.043606+0000","last_active":"2024-04-26T23:28:25.154580+0000","last_peered":"2024-04-26T23:28:25.154580+0000","last_clean":"2024-04-26T23:28:25.154580+0000","last_became_active":"2024-04-26T23:28:24.043273+0000","last_became_peered":"2024-04-26T23:28:24.043273+0000","last_unstale":"2024-04-26T23:28:25.154580+0000","last_undegraded":"2024-04-26T23:28:25.154580+0000","last_fullsized":"2024-04-26T23:28:25.154580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:05.719301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551781+0000","last_change":"2024-04-26T23:28:24.040462+0000","last_active":"2024-04-26T23:28:25.551781+0000","last_peered":"2024-04-26T23:28:25.551781+0000","last_clean":"2024-04-26T23:28:25.551781+0000","last_became_active":"2024-04-26T23:28:24.040208+0000","last_became_peered":"2024-04-26T23:28:24.040208+0000","last_unstale":"2024-04-26T23:28:25.551781+0000","last_undegraded":"2024-04-26T23:28:25.551781+0000","last_fullsized":"2024-04-26T23:28:25.551781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051937+0000","last_change":"2024-04-26T23:28:24.047489+0000","last_active":"2024-04-26T23:28:25.051937+0000","last_peered":"2024-04-26T23:28:25.051937+0000","last_clean":"2024-04-26T23:28:25.051937+0000","last_became_active":"2024-04-26T23:28:24.047166+0000","last_became_peered":"2024-04-26T23:28:24.047166+0000","last_unstale":"2024-04-26T23:28:25.051937+0000","last_undegraded":"2024-04-26T23:28:25.051937+0000","last_fullsized":"2024-04-26T23:28:25.051937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:09.683279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037563+0000","last_change":"2024-04-26T23:28:24.037691+0000","last_active":"2024-04-26T23:28:25.037563+0000","last_peered":"2024-04-26T23:28:25.037563+0000","last_clean":"2024-04-26T23:28:25.037563+0000","last_became_active":"2024-04-26T23:28:24.037384+0000","last_became_peered":"2024-04-26T23:28:24.037384+0000","last_unstale":"2024-04-26T23:28:25.037563+0000","last_undegraded":"2024-04-26T23:28:25.037563+0000","last_fullsized":"2024-04-26T23:28:25.037563+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:44.598920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052059+0000","last_change":"2024-04-26T23:28:24.038596+0000","last_active":"2024-04-26T23:28:25.052059+0000","last_peered":"2024-04-26T23:28:25.052059+0000","last_clean":"2024-04-26T23:28:25.052059+0000","last_became_active":"2024-04-26T23:28:24.038300+0000","last_became_peered":"2024-04-26T23:28:24.038300+0000","last_unstale":"2024-04-26T23:28:25.052059+0000","last_undegraded":"2024-04-26T23:28:25.052059+0000","last_fullsized":"2024-04-26T23:28:25.052059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:09.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.041971+0000","last_change":"2024-04-26T23:28:24.045338+0000","last_active":"2024-04-26T23:28:25.041971+0000","last_peered":"2024-04-26T23:28:25.041971+0000","last_clean":"2024-04-26T23:28:25.041971+0000","last_became_active":"2024-04-26T23:28:24.045006+0000","last_became_peered":"2024-04-26T23:28:24.045006+0000","last_unstale":"2024-04-26T23:28:25.041971+0000","last_undegraded":"2024-04-26T23:28:25.041971+0000","last_fullsized":"2024-04-26T23:28:25.041971+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:03.823679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038246+0000","last_change":"2024-04-26T23:28:24.043316+0000","last_active":"2024-04-26T23:28:25.038246+0000","last_peered":"2024-04-26T23:28:25.038246+0000","last_clean":"2024-04-26T23:28:25.038246+0000","last_became_active":"2024-04-26T23:28:24.043067+0000","last_became_peered":"2024-04-26T23:28:24.043067+0000","last_unstale":"2024-04-26T23:28:25.038246+0000","last_undegraded":"2024-04-26T23:28:25.038246+0000","last_fullsized":"2024-04-26T23:28:25.038246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:36.812864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551761+0000","last_change":"2024-04-26T23:28:24.044273+0000","last_active":"2024-04-26T23:28:25.551761+0000","last_peered":"2024-04-26T23:28:25.551761+0000","last_clean":"2024-04-26T23:28:25.551761+0000","last_became_active":"2024-04-26T23:28:24.043992+0000","last_became_peered":"2024-04-26T23:28:24.043992+0000","last_unstale":"2024-04-26T23:28:25.551761+0000","last_undegraded":"2024-04-26T23:28:25.551761+0000","last_fullsized":"2024-04-26T23:28:25.551761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043479+0000","last_change":"2024-04-26T23:28:24.057145+0000","last_active":"2024-04-26T23:28:25.043479+0000","last_peered":"2024-04-26T23:28:25.043479+0000","last_clean":"2024-04-26T23:28:25.043479+0000","last_became_active":"2024-04-26T23:28:24.056844+0000","last_became_peered":"2024-04-26T23:28:24.056844+0000","last_unstale":"2024-04-26T23:28:25.043479+0000","last_undegraded":"2024-04-26T23:28:25.043479+0000","last_fullsized":"2024-04-26T23:28:25.043479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:24.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051893+0000","last_change":"2024-04-26T23:28:24.036405+0000","last_active":"2024-04-26T23:28:25.051893+0000","last_peered":"2024-04-26T23:28:25.051893+0000","last_clean":"2024-04-26T23:28:25.051893+0000","last_became_active":"2024-04-26T23:28:24.033678+0000","last_became_peered":"2024-04-26T23:28:24.033678+0000","last_unstale":"2024-04-26T23:28:25.051893+0000","last_undegraded":"2024-04-26T23:28:25.051893+0000","last_fullsized":"2024-04-26T23:28:25.051893+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:46:32.076248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042491+0000","last_change":"2024-04-26T23:28:24.037049+0000","last_active":"2024-04-26T23:28:25.042491+0000","last_peered":"2024-04-26T23:28:25.042491+0000","last_clean":"2024-04-26T23:28:25.042491+0000","last_became_active":"2024-04-26T23:28:24.036467+0000","last_became_peered":"2024-04-26T23:28:24.036467+0000","last_unstale":"2024-04-26T23:28:25.042491+0000","last_undegraded":"2024-04-26T23:28:25.042491+0000","last_fullsized":"2024-04-26T23:28:25.042491+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:34.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042136+0000","last_change":"2024-04-26T23:28:24.045936+0000","last_active":"2024-04-26T23:28:25.042136+0000","last_peered":"2024-04-26T23:28:25.042136+0000","last_clean":"2024-04-26T23:28:25.042136+0000","last_became_active":"2024-04-26T23:28:24.044876+0000","last_became_peered":"2024-04-26T23:28:24.044876+0000","last_unstale":"2024-04-26T23:28:25.042136+0000","last_undegraded":"2024-04-26T23:28:25.042136+0000","last_fullsized":"2024-04-26T23:28:25.042136+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154379+0000","last_change":"2024-04-26T23:28:24.036863+0000","last_active":"2024-04-26T23:28:25.154379+0000","last_peered":"2024-04-26T23:28:25.154379+0000","last_clean":"2024-04-26T23:28:25.154379+0000","last_became_active":"2024-04-26T23:28:24.036463+0000","last_became_peered":"2024-04-26T23:28:24.036463+0000","last_unstale":"2024-04-26T23:28:25.154379+0000","last_undegraded":"2024-04-26T23:28:25.154379+0000","last_fullsized":"2024-04-26T23:28:25.154379+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:19.321269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154222+0000","last_change":"2024-04-26T23:28:24.044275+0000","last_active":"2024-04-26T23:28:25.154222+0000","last_peered":"2024-04-26T23:28:25.154222+0000","last_clean":"2024-04-26T23:28:25.154222+0000","last_became_active":"2024-04-26T23:28:24.043981+0000","last_became_peered":"2024-04-26T23:28:24.043981+0000","last_unstale":"2024-04-26T23:28:25.154222+0000","last_undegraded":"2024-04-26T23:28:25.154222+0000","last_fullsized":"2024-04-26T23:28:25.154222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.295701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042511+0000","last_change":"2024-04-26T23:28:24.049207+0000","last_active":"2024-04-26T23:28:25.042511+0000","last_peered":"2024-04-26T23:28:25.042511+0000","last_clean":"2024-04-26T23:28:25.042511+0000","last_became_active":"2024-04-26T23:28:24.048950+0000","last_became_peered":"2024-04-26T23:28:24.048950+0000","last_unstale":"2024-04-26T23:28:25.042511+0000","last_undegraded":"2024-04-26T23:28:25.042511+0000","last_fullsized":"2024-04-26T23:28:25.042511+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:27.783525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049775+0000","last_change":"2024-04-26T23:28:24.041030+0000","last_active":"2024-04-26T23:28:25.049775+0000","last_peered":"2024-04-26T23:28:25.049775+0000","last_clean":"2024-04-26T23:28:25.049775+0000","last_became_active":"2024-04-26T23:28:24.040745+0000","last_became_peered":"2024-04-26T23:28:24.040745+0000","last_unstale":"2024-04-26T23:28:25.049775+0000","last_undegraded":"2024-04-26T23:28:25.049775+0000","last_fullsized":"2024-04-26T23:28:25.049775+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:40.885351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688154+0000","last_change":"2024-04-26T23:28:24.034100+0000","last_active":"2024-04-26T23:28:25.688154+0000","last_peered":"2024-04-26T23:28:25.688154+0000","last_clean":"2024-04-26T23:28:25.688154+0000","last_became_active":"2024-04-26T23:28:24.033801+0000","last_became_peered":"2024-04-26T23:28:24.033801+0000","last_unstale":"2024-04-26T23:28:25.688154+0000","last_undegraded":"2024-04-26T23:28:25.688154+0000","last_fullsized":"2024-04-26T23:28:25.688154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:49.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042349+0000","last_change":"2024-04-26T23:28:24.045193+0000","last_active":"2024-04-26T23:28:25.042349+0000","last_peered":"2024-04-26T23:28:25.042349+0000","last_clean":"2024-04-26T23:28:25.042349+0000","last_became_active":"2024-04-26T23:28:24.044903+0000","last_became_peered":"2024-04-26T23:28:24.044903+0000","last_unstale":"2024-04-26T23:28:25.042349+0000","last_undegraded":"2024-04-26T23:28:25.042349+0000","last_fullsized":"2024-04-26T23:28:25.042349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:25.423176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688121+0000","last_change":"2024-04-26T23:28:24.033245+0000","last_active":"2024-04-26T23:28:25.688121+0000","last_peered":"2024-04-26T23:28:25.688121+0000","last_clean":"2024-04-26T23:28:25.688121+0000","last_became_active":"2024-04-26T23:28:24.032918+0000","last_became_peered":"2024-04-26T23:28:24.032918+0000","last_unstale":"2024-04-26T23:28:25.688121+0000","last_undegraded":"2024-04-26T23:28:25.688121+0000","last_fullsized":"2024-04-26T23:28:25.688121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:14:03.508643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049511+0000","last_change":"2024-04-26T23:28:24.044262+0000","last_active":"2024-04-26T23:28:25.049511+0000","last_peered":"2024-04-26T23:28:25.049511+0000","last_clean":"2024-04-26T23:28:25.049511+0000","last_became_active":"2024-04-26T23:28:24.043986+0000","last_became_peered":"2024-04-26T23:28:24.043986+0000","last_unstale":"2024-04-26T23:28:25.049511+0000","last_undegraded":"2024-04-26T23:28:25.049511+0000","last_fullsized":"2024-04-26T23:28:25.049511+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:56.751773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049674+0000","last_change":"2024-04-26T23:28:24.035728+0000","last_active":"2024-04-26T23:28:25.049674+0000","last_peered":"2024-04-26T23:28:25.049674+0000","last_clean":"2024-04-26T23:28:25.049674+0000","last_became_active":"2024-04-26T23:28:24.035395+0000","last_became_peered":"2024-04-26T23:28:24.035395+0000","last_unstale":"2024-04-26T23:28:25.049674+0000","last_undegraded":"2024-04-26T23:28:25.049674+0000","last_fullsized":"2024-04-26T23:28:25.049674+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:04.408214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043936+0000","last_change":"2024-04-26T23:28:24.040945+0000","last_active":"2024-04-26T23:28:25.043936+0000","last_peered":"2024-04-26T23:28:25.043936+0000","last_clean":"2024-04-26T23:28:25.043936+0000","last_became_active":"2024-04-26T23:28:24.040390+0000","last_became_peered":"2024-04-26T23:28:24.040390+0000","last_unstale":"2024-04-26T23:28:25.043936+0000","last_undegraded":"2024-04-26T23:28:25.043936+0000","last_fullsized":"2024-04-26T23:28:25.043936+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154723+0000","last_change":"2024-04-26T23:28:24.060043+0000","last_active":"2024-04-26T23:28:25.154723+0000","last_peered":"2024-04-26T23:28:25.154723+0000","last_clean":"2024-04-26T23:28:25.154723+0000","last_became_active":"2024-04-26T23:28:24.059749+0000","last_became_peered":"2024-04-26T23:28:24.059749+0000","last_unstale":"2024-04-26T23:28:25.154723+0000","last_undegraded":"2024-04-26T23:28:25.154723+0000","last_fullsized":"2024-04-26T23:28:25.154723+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:51.153283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154913+0000","last_change":"2024-04-26T23:28:23.026627+0000","last_active":"2024-04-26T23:28:25.154913+0000","last_peered":"2024-04-26T23:28:25.154913+0000","last_clean":"2024-04-26T23:28:25.154913+0000","last_became_active":"2024-04-26T23:28:23.026354+0000","last_became_peered":"2024-04-26T23:28:23.026354+0000","last_unstale":"2024-04-26T23:28:25.154913+0000","last_undegraded":"2024-04-26T23:28:25.154913+0000","last_fullsized":"2024-04-26T23:28:25.154913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:03.401417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038320+0000","last_change":"2024-04-26T23:28:24.043315+0000","last_active":"2024-04-26T23:28:25.038320+0000","last_peered":"2024-04-26T23:28:25.038320+0000","last_clean":"2024-04-26T23:28:25.038320+0000","last_became_active":"2024-04-26T23:28:24.043020+0000","last_became_peered":"2024-04-26T23:28:24.043020+0000","last_unstale":"2024-04-26T23:28:25.038320+0000","last_undegraded":"2024-04-26T23:28:25.038320+0000","last_fullsized":"2024-04-26T23:28:25.038320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:03.649284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052069+0000","last_change":"2024-04-26T23:28:23.029967+0000","last_active":"2024-04-26T23:28:25.052069+0000","last_peered":"2024-04-26T23:28:25.052069+0000","last_clean":"2024-04-26T23:28:25.052069+0000","last_became_active":"2024-04-26T23:28:23.029584+0000","last_became_peered":"2024-04-26T23:28:23.029584+0000","last_unstale":"2024-04-26T23:28:25.052069+0000","last_undegraded":"2024-04-26T23:28:25.052069+0000","last_fullsized":"2024-04-26T23:28:25.052069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:26.776728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044066+0000","last_change":"2024-04-26T23:28:24.047913+0000","last_active":"2024-04-26T23:28:25.044066+0000","last_peered":"2024-04-26T23:28:25.044066+0000","last_clean":"2024-04-26T23:28:25.044066+0000","last_became_active":"2024-04-26T23:28:24.047531+0000","last_became_peered":"2024-04-26T23:28:24.047531+0000","last_unstale":"2024-04-26T23:28:25.044066+0000","last_undegraded":"2024-04-26T23:28:25.044066+0000","last_fullsized":"2024-04-26T23:28:25.044066+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:58.833727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042522+0000","last_change":"2024-04-26T23:28:23.024262+0000","last_active":"2024-04-26T23:28:25.042522+0000","last_peered":"2024-04-26T23:28:25.042522+0000","last_clean":"2024-04-26T23:28:25.042522+0000","last_became_active":"2024-04-26T23:28:23.023563+0000","last_became_peered":"2024-04-26T23:28:23.023563+0000","last_unstale":"2024-04-26T23:28:25.042522+0000","last_undegraded":"2024-04-26T23:28:25.042522+0000","last_fullsized":"2024-04-26T23:28:25.042522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:25.518931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154625+0000","last_change":"2024-04-26T23:28:24.044232+0000","last_active":"2024-04-26T23:28:25.154625+0000","last_peered":"2024-04-26T23:28:25.154625+0000","last_clean":"2024-04-26T23:28:25.154625+0000","last_became_active":"2024-04-26T23:28:24.044013+0000","last_became_peered":"2024-04-26T23:28:24.044013+0000","last_unstale":"2024-04-26T23:28:25.154625+0000","last_undegraded":"2024-04-26T23:28:25.154625+0000","last_fullsized":"2024-04-26T23:28:25.154625+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:08.969033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044175+0000","last_change":"2024-04-26T23:28:23.030731+0000","last_active":"2024-04-26T23:28:25.044175+0000","last_peered":"2024-04-26T23:28:25.044175+0000","last_clean":"2024-04-26T23:28:25.044175+0000","last_became_active":"2024-04-26T23:28:23.030398+0000","last_became_peered":"2024-04-26T23:28:23.030398+0000","last_unstale":"2024-04-26T23:28:25.044175+0000","last_undegraded":"2024-04-26T23:28:25.044175+0000","last_fullsized":"2024-04-26T23:28:25.044175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:43.581002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049599+0000","last_change":"2024-04-26T23:28:24.036172+0000","last_active":"2024-04-26T23:28:25.049599+0000","last_peered":"2024-04-26T23:28:25.049599+0000","last_clean":"2024-04-26T23:28:25.049599+0000","last_became_active":"2024-04-26T23:28:24.035845+0000","last_became_peered":"2024-04-26T23:28:24.035845+0000","last_unstale":"2024-04-26T23:28:25.049599+0000","last_undegraded":"2024-04-26T23:28:25.049599+0000","last_fullsized":"2024-04-26T23:28:25.049599+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:02.158666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688227+0000","last_change":"2024-04-26T23:28:23.026269+0000","last_active":"2024-04-26T23:28:25.688227+0000","last_peered":"2024-04-26T23:28:25.688227+0000","last_clean":"2024-04-26T23:28:25.688227+0000","last_became_active":"2024-04-26T23:28:23.025947+0000","last_became_peered":"2024-04-26T23:28:23.025947+0000","last_unstale":"2024-04-26T23:28:25.688227+0000","last_undegraded":"2024-04-26T23:28:25.688227+0000","last_fullsized":"2024-04-26T23:28:25.688227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:42.480149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042301+0000","last_change":"2024-04-26T23:28:24.037240+0000","last_active":"2024-04-26T23:28:25.042301+0000","last_peered":"2024-04-26T23:28:25.042301+0000","last_clean":"2024-04-26T23:28:25.042301+0000","last_became_active":"2024-04-26T23:28:24.036847+0000","last_became_peered":"2024-04-26T23:28:24.036847+0000","last_unstale":"2024-04-26T23:28:25.042301+0000","last_undegraded":"2024-04-26T23:28:25.042301+0000","last_fullsized":"2024-04-26T23:28:25.042301+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043514+0000","last_change":"2024-04-26T23:28:23.030290+0000","last_active":"2024-04-26T23:28:25.043514+0000","last_peered":"2024-04-26T23:28:25.043514+0000","last_clean":"2024-04-26T23:28:25.043514+0000","last_became_active":"2024-04-26T23:28:23.029990+0000","last_became_peered":"2024-04-26T23:28:23.029990+0000","last_unstale":"2024-04-26T23:28:25.043514+0000","last_undegraded":"2024-04-26T23:28:25.043514+0000","last_fullsized":"2024-04-26T23:28:25.043514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:06.527621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037203+0000","last_change":"2024-04-26T23:28:24.045079+0000","last_active":"2024-04-26T23:28:25.037203+0000","last_peered":"2024-04-26T23:28:25.037203+0000","last_clean":"2024-04-26T23:28:25.037203+0000","last_became_active":"2024-04-26T23:28:24.044829+0000","last_became_peered":"2024-04-26T23:28:24.044829+0000","last_unstale":"2024-04-26T23:28:25.037203+0000","last_undegraded":"2024-04-26T23:28:25.037203+0000","last_fullsized":"2024-04-26T23:28:25.037203+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:19.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551444+0000","last_change":"2024-04-26T23:28:23.023662+0000","last_active":"2024-04-26T23:28:25.551444+0000","last_peered":"2024-04-26T23:28:25.551444+0000","last_clean":"2024-04-26T23:28:25.551444+0000","last_became_active":"2024-04-26T23:28:23.023334+0000","last_became_peered":"2024-04-26T23:28:23.023334+0000","last_unstale":"2024-04-26T23:28:25.551444+0000","last_undegraded":"2024-04-26T23:28:25.551444+0000","last_fullsized":"2024-04-26T23:28:25.551444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:15.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052135+0000","last_change":"2024-04-26T23:28:24.036760+0000","last_active":"2024-04-26T23:28:25.052135+0000","last_peered":"2024-04-26T23:28:25.052135+0000","last_clean":"2024-04-26T23:28:25.052135+0000","last_became_active":"2024-04-26T23:28:24.035067+0000","last_became_peered":"2024-04-26T23:28:24.035067+0000","last_unstale":"2024-04-26T23:28:25.052135+0000","last_undegraded":"2024-04-26T23:28:25.052135+0000","last_fullsized":"2024-04-26T23:28:25.052135+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:02.158666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037169+0000","last_change":"2024-04-26T23:28:23.022148+0000","last_active":"2024-04-26T23:28:25.037169+0000","last_peered":"2024-04-26T23:28:25.037169+0000","last_clean":"2024-04-26T23:28:25.037169+0000","last_became_active":"2024-04-26T23:28:23.021889+0000","last_became_peered":"2024-04-26T23:28:23.021889+0000","last_unstale":"2024-04-26T23:28:25.037169+0000","last_undegraded":"2024-04-26T23:28:25.037169+0000","last_fullsized":"2024-04-26T23:28:25.037169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:41.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049808+0000","last_change":"2024-04-26T23:28:24.039189+0000","last_active":"2024-04-26T23:28:25.049808+0000","last_peered":"2024-04-26T23:28:25.049808+0000","last_clean":"2024-04-26T23:28:25.049808+0000","last_became_active":"2024-04-26T23:28:24.038911+0000","last_became_peered":"2024-04-26T23:28:24.038911+0000","last_unstale":"2024-04-26T23:28:25.049808+0000","last_undegraded":"2024-04-26T23:28:25.049808+0000","last_fullsized":"2024-04-26T23:28:25.049808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:07.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042633+0000","last_change":"2024-04-26T23:28:23.027147+0000","last_active":"2024-04-26T23:28:25.042633+0000","last_peered":"2024-04-26T23:28:25.042633+0000","last_clean":"2024-04-26T23:28:25.042633+0000","last_became_active":"2024-04-26T23:28:23.026895+0000","last_became_peered":"2024-04-26T23:28:23.026895+0000","last_unstale":"2024-04-26T23:28:25.042633+0000","last_undegraded":"2024-04-26T23:28:25.042633+0000","last_fullsized":"2024-04-26T23:28:25.042633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:00.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154880+0000","last_change":"2024-04-26T23:28:24.058932+0000","last_active":"2024-04-26T23:28:25.154880+0000","last_peered":"2024-04-26T23:28:25.154880+0000","last_clean":"2024-04-26T23:28:25.154880+0000","last_became_active":"2024-04-26T23:28:24.058640+0000","last_became_peered":"2024-04-26T23:28:24.058640+0000","last_unstale":"2024-04-26T23:28:25.154880+0000","last_undegraded":"2024-04-26T23:28:25.154880+0000","last_fullsized":"2024-04-26T23:28:25.154880+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:03.363649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043893+0000","last_change":"2024-04-26T23:28:23.030597+0000","last_active":"2024-04-26T23:28:25.043893+0000","last_peered":"2024-04-26T23:28:25.043893+0000","last_clean":"2024-04-26T23:28:25.043893+0000","last_became_active":"2024-04-26T23:28:23.030276+0000","last_became_peered":"2024-04-26T23:28:23.030276+0000","last_unstale":"2024-04-26T23:28:25.043893+0000","last_undegraded":"2024-04-26T23:28:25.043893+0000","last_fullsized":"2024-04-26T23:28:25.043893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:48.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044220+0000","last_change":"2024-04-26T23:28:24.055283+0000","last_active":"2024-04-26T23:28:25.044220+0000","last_peered":"2024-04-26T23:28:25.044220+0000","last_clean":"2024-04-26T23:28:25.044220+0000","last_became_active":"2024-04-26T23:28:24.055005+0000","last_became_peered":"2024-04-26T23:28:24.055005+0000","last_unstale":"2024-04-26T23:28:25.044220+0000","last_undegraded":"2024-04-26T23:28:25.044220+0000","last_fullsized":"2024-04-26T23:28:25.044220+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:34.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688293+0000","last_change":"2024-04-26T23:28:23.025307+0000","last_active":"2024-04-26T23:28:25.688293+0000","last_peered":"2024-04-26T23:28:25.688293+0000","last_clean":"2024-04-26T23:28:25.688293+0000","last_became_active":"2024-04-26T23:28:23.024972+0000","last_became_peered":"2024-04-26T23:28:23.024972+0000","last_unstale":"2024-04-26T23:28:25.688293+0000","last_undegraded":"2024-04-26T23:28:25.688293+0000","last_fullsized":"2024-04-26T23:28:25.688293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:01.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037823+0000","last_change":"2024-04-26T23:28:24.046389+0000","last_active":"2024-04-26T23:28:25.037823+0000","last_peered":"2024-04-26T23:28:25.037823+0000","last_clean":"2024-04-26T23:28:25.037823+0000","last_became_active":"2024-04-26T23:28:24.044751+0000","last_became_peered":"2024-04-26T23:28:24.044751+0000","last_unstale":"2024-04-26T23:28:25.037823+0000","last_undegraded":"2024-04-26T23:28:25.037823+0000","last_fullsized":"2024-04-26T23:28:25.037823+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:28.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551844+0000","last_change":"2024-04-26T23:28:23.029667+0000","last_active":"2024-04-26T23:28:25.551844+0000","last_peered":"2024-04-26T23:28:25.551844+0000","last_clean":"2024-04-26T23:28:25.551844+0000","last_became_active":"2024-04-26T23:28:23.029407+0000","last_became_peered":"2024-04-26T23:28:23.029407+0000","last_unstale":"2024-04-26T23:28:25.551844+0000","last_undegraded":"2024-04-26T23:28:25.551844+0000","last_fullsized":"2024-04-26T23:28:25.551844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:00.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154319+0000","last_change":"2024-04-26T23:28:24.050166+0000","last_active":"2024-04-26T23:28:25.154319+0000","last_peered":"2024-04-26T23:28:25.154319+0000","last_clean":"2024-04-26T23:28:25.154319+0000","last_became_active":"2024-04-26T23:28:24.049852+0000","last_became_peered":"2024-04-26T23:28:24.049852+0000","last_unstale":"2024-04-26T23:28:25.154319+0000","last_undegraded":"2024-04-26T23:28:25.154319+0000","last_fullsized":"2024-04-26T23:28:25.154319+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:00.935179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551558+0000","last_change":"2024-04-26T23:28:23.026572+0000","last_active":"2024-04-26T23:28:25.551558+0000","last_peered":"2024-04-26T23:28:25.551558+0000","last_clean":"2024-04-26T23:28:25.551558+0000","last_became_active":"2024-04-26T23:28:23.026302+0000","last_became_peered":"2024-04-26T23:28:23.026302+0000","last_unstale":"2024-04-26T23:28:25.551558+0000","last_undegraded":"2024-04-26T23:28:25.551558+0000","last_fullsized":"2024-04-26T23:28:25.551558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:23.971449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049485+0000","last_change":"2024-04-26T23:28:24.028689+0000","last_active":"2024-04-26T23:28:25.049485+0000","last_peered":"2024-04-26T23:28:25.049485+0000","last_clean":"2024-04-26T23:28:25.049485+0000","last_became_active":"2024-04-26T23:28:24.027540+0000","last_became_peered":"2024-04-26T23:28:24.027540+0000","last_unstale":"2024-04-26T23:28:25.049485+0000","last_undegraded":"2024-04-26T23:28:25.049485+0000","last_fullsized":"2024-04-26T23:28:25.049485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:53.664624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043619+0000","last_change":"2024-04-26T23:28:23.030347+0000","last_active":"2024-04-26T23:28:25.043619+0000","last_peered":"2024-04-26T23:28:25.043619+0000","last_clean":"2024-04-26T23:28:25.043619+0000","last_became_active":"2024-04-26T23:28:23.030022+0000","last_became_peered":"2024-04-26T23:28:23.030022+0000","last_unstale":"2024-04-26T23:28:25.043619+0000","last_undegraded":"2024-04-26T23:28:25.043619+0000","last_fullsized":"2024-04-26T23:28:25.043619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:03.925993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052070+0000","last_change":"2024-04-26T23:28:24.049271+0000","last_active":"2024-04-26T23:28:25.052070+0000","last_peered":"2024-04-26T23:28:25.052070+0000","last_clean":"2024-04-26T23:28:25.052070+0000","last_became_active":"2024-04-26T23:28:24.048957+0000","last_became_peered":"2024-04-26T23:28:24.048957+0000","last_unstale":"2024-04-26T23:28:25.052070+0000","last_undegraded":"2024-04-26T23:28:25.052070+0000","last_fullsized":"2024-04-26T23:28:25.052070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:53.664624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049427+0000","last_change":"2024-04-26T23:28:23.024929+0000","last_active":"2024-04-26T23:28:25.049427+0000","last_peered":"2024-04-26T23:28:25.049427+0000","last_clean":"2024-04-26T23:28:25.049427+0000","last_became_active":"2024-04-26T23:28:23.024653+0000","last_became_peered":"2024-04-26T23:28:23.024653+0000","last_unstale":"2024-04-26T23:28:25.049427+0000","last_undegraded":"2024-04-26T23:28:25.049427+0000","last_fullsized":"2024-04-26T23:28:25.049427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:24.416379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037236+0000","last_change":"2024-04-26T23:28:24.036901+0000","last_active":"2024-04-26T23:28:25.037236+0000","last_peered":"2024-04-26T23:28:25.037236+0000","last_clean":"2024-04-26T23:28:25.037236+0000","last_became_active":"2024-04-26T23:28:24.036618+0000","last_became_peered":"2024-04-26T23:28:24.036618+0000","last_unstale":"2024-04-26T23:28:25.037236+0000","last_undegraded":"2024-04-26T23:28:25.037236+0000","last_fullsized":"2024-04-26T23:28:25.037236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:55.727039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042035+0000","last_change":"2024-04-26T23:28:23.020736+0000","last_active":"2024-04-26T23:28:25.042035+0000","last_peered":"2024-04-26T23:28:25.042035+0000","last_clean":"2024-04-26T23:28:25.042035+0000","last_became_active":"2024-04-26T23:28:23.020403+0000","last_became_peered":"2024-04-26T23:28:23.020403+0000","last_unstale":"2024-04-26T23:28:25.042035+0000","last_undegraded":"2024-04-26T23:28:25.042035+0000","last_fullsized":"2024-04-26T23:28:25.042035+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:15.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042664+0000","last_change":"2024-04-26T23:28:24.031369+0000","last_active":"2024-04-26T23:28:25.042664+0000","last_peered":"2024-04-26T23:28:25.042664+0000","last_clean":"2024-04-26T23:28:25.042664+0000","last_became_active":"2024-04-26T23:28:24.030854+0000","last_became_peered":"2024-04-26T23:28:24.030854+0000","last_unstale":"2024-04-26T23:28:25.042664+0000","last_undegraded":"2024-04-26T23:28:25.042664+0000","last_fullsized":"2024-04-26T23:28:25.042664+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:12.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043525+0000","last_change":"2024-04-26T23:28:23.030723+0000","last_active":"2024-04-26T23:28:25.043525+0000","last_peered":"2024-04-26T23:28:25.043525+0000","last_clean":"2024-04-26T23:28:25.043525+0000","last_became_active":"2024-04-26T23:28:23.028192+0000","last_became_peered":"2024-04-26T23:28:23.028192+0000","last_unstale":"2024-04-26T23:28:25.043525+0000","last_undegraded":"2024-04-26T23:28:25.043525+0000","last_fullsized":"2024-04-26T23:28:25.043525+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:09.048842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154846+0000","last_change":"2024-04-26T23:28:24.051249+0000","last_active":"2024-04-26T23:28:25.154846+0000","last_peered":"2024-04-26T23:28:25.154846+0000","last_clean":"2024-04-26T23:28:25.154846+0000","last_became_active":"2024-04-26T23:28:24.048875+0000","last_became_peered":"2024-04-26T23:28:24.048875+0000","last_unstale":"2024-04-26T23:28:25.154846+0000","last_undegraded":"2024-04-26T23:28:25.154846+0000","last_fullsized":"2024-04-26T23:28:25.154846+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:16.824768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.042668+0000","last_change":"2024-04-26T23:28:23.023891+0000","last_active":"2024-04-26T23:28:25.042668+0000","last_peered":"2024-04-26T23:28:25.042668+0000","last_clean":"2024-04-26T23:28:25.042668+0000","last_became_active":"2024-04-26T23:28:23.023595+0000","last_became_peered":"2024-04-26T23:28:23.023595+0000","last_unstale":"2024-04-26T23:28:25.042668+0000","last_undegraded":"2024-04-26T23:28:25.042668+0000","last_fullsized":"2024-04-26T23:28:25.042668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:23.971449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551822+0000","last_change":"2024-04-26T23:28:24.038353+0000","last_active":"2024-04-26T23:28:25.551822+0000","last_peered":"2024-04-26T23:28:25.551822+0000","last_clean":"2024-04-26T23:28:25.551822+0000","last_became_active":"2024-04-26T23:28:24.038098+0000","last_became_peered":"2024-04-26T23:28:24.038098+0000","last_unstale":"2024-04-26T23:28:25.551822+0000","last_undegraded":"2024-04-26T23:28:25.551822+0000","last_fullsized":"2024-04-26T23:28:25.551822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:57.217402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043679+0000","last_change":"2024-04-26T23:28:23.029299+0000","last_active":"2024-04-26T23:28:25.043679+0000","last_peered":"2024-04-26T23:28:25.043679+0000","last_clean":"2024-04-26T23:28:25.043679+0000","last_became_active":"2024-04-26T23:28:23.028628+0000","last_became_peered":"2024-04-26T23:28:23.028628+0000","last_unstale":"2024-04-26T23:28:25.043679+0000","last_undegraded":"2024-04-26T23:28:25.043679+0000","last_fullsized":"2024-04-26T23:28:25.043679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:09.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037954+0000","last_change":"2024-04-26T23:28:24.046401+0000","last_active":"2024-04-26T23:28:25.037954+0000","last_peered":"2024-04-26T23:28:25.037954+0000","last_clean":"2024-04-26T23:28:25.037954+0000","last_became_active":"2024-04-26T23:28:24.045124+0000","last_became_peered":"2024-04-26T23:28:24.045124+0000","last_unstale":"2024-04-26T23:28:25.037954+0000","last_undegraded":"2024-04-26T23:28:25.037954+0000","last_fullsized":"2024-04-26T23:28:25.037954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:25.359753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154484+0000","last_change":"2024-04-26T23:28:23.027660+0000","last_active":"2024-04-26T23:28:25.154484+0000","last_peered":"2024-04-26T23:28:25.154484+0000","last_clean":"2024-04-26T23:28:25.154484+0000","last_became_active":"2024-04-26T23:28:23.027196+0000","last_became_peered":"2024-04-26T23:28:23.027196+0000","last_unstale":"2024-04-26T23:28:25.154484+0000","last_undegraded":"2024-04-26T23:28:25.154484+0000","last_fullsized":"2024-04-26T23:28:25.154484+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:57.723838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688105+0000","last_change":"2024-04-26T23:28:24.042585+0000","last_active":"2024-04-26T23:28:25.688105+0000","last_peered":"2024-04-26T23:28:25.688105+0000","last_clean":"2024-04-26T23:28:25.688105+0000","last_became_active":"2024-04-26T23:28:24.042245+0000","last_became_peered":"2024-04-26T23:28:24.042245+0000","last_unstale":"2024-04-26T23:28:25.688105+0000","last_undegraded":"2024-04-26T23:28:25.688105+0000","last_fullsized":"2024-04-26T23:28:25.688105+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:03:42.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043720+0000","last_change":"2024-04-26T23:28:23.028327+0000","last_active":"2024-04-26T23:28:25.043720+0000","last_peered":"2024-04-26T23:28:25.043720+0000","last_clean":"2024-04-26T23:28:25.043720+0000","last_became_active":"2024-04-26T23:28:23.028034+0000","last_became_peered":"2024-04-26T23:28:23.028034+0000","last_unstale":"2024-04-26T23:28:25.043720+0000","last_undegraded":"2024-04-26T23:28:25.043720+0000","last_fullsized":"2024-04-26T23:28:25.043720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:55.874396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688029+0000","last_change":"2024-04-26T23:28:24.042122+0000","last_active":"2024-04-26T23:28:25.688029+0000","last_peered":"2024-04-26T23:28:25.688029+0000","last_clean":"2024-04-26T23:28:25.688029+0000","last_became_active":"2024-04-26T23:28:24.041762+0000","last_became_peered":"2024-04-26T23:28:24.041762+0000","last_unstale":"2024-04-26T23:28:25.688029+0000","last_undegraded":"2024-04-26T23:28:25.688029+0000","last_fullsized":"2024-04-26T23:28:25.688029+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:03.363649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049599+0000","last_change":"2024-04-26T23:28:23.021218+0000","last_active":"2024-04-26T23:28:25.049599+0000","last_peered":"2024-04-26T23:28:25.049599+0000","last_clean":"2024-04-26T23:28:25.049599+0000","last_became_active":"2024-04-26T23:28:23.020957+0000","last_became_peered":"2024-04-26T23:28:23.020957+0000","last_unstale":"2024-04-26T23:28:25.049599+0000","last_undegraded":"2024-04-26T23:28:25.049599+0000","last_fullsized":"2024-04-26T23:28:25.049599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:57.826930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.687933+0000","last_change":"2024-04-26T23:28:24.046807+0000","last_active":"2024-04-26T23:28:25.687933+0000","last_peered":"2024-04-26T23:28:25.687933+0000","last_clean":"2024-04-26T23:28:25.687933+0000","last_became_active":"2024-04-26T23:28:24.046454+0000","last_became_peered":"2024-04-26T23:28:24.046454+0000","last_unstale":"2024-04-26T23:28:25.687933+0000","last_undegraded":"2024-04-26T23:28:25.687933+0000","last_fullsized":"2024-04-26T23:28:25.687933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:33.510843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051806+0000","last_change":"2024-04-26T23:28:23.029684+0000","last_active":"2024-04-26T23:28:25.051806+0000","last_peered":"2024-04-26T23:28:25.051806+0000","last_clean":"2024-04-26T23:28:25.051806+0000","last_became_active":"2024-04-26T23:28:23.029012+0000","last_became_peered":"2024-04-26T23:28:23.029012+0000","last_unstale":"2024-04-26T23:28:25.051806+0000","last_undegraded":"2024-04-26T23:28:25.051806+0000","last_fullsized":"2024-04-26T23:28:25.051806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:57.826930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.052135+0000","last_change":"2024-04-26T23:28:24.042346+0000","last_active":"2024-04-26T23:28:25.052135+0000","last_peered":"2024-04-26T23:28:25.052135+0000","last_clean":"2024-04-26T23:28:25.052135+0000","last_became_active":"2024-04-26T23:28:24.042072+0000","last_became_peered":"2024-04-26T23:28:24.042072+0000","last_unstale":"2024-04-26T23:28:25.052135+0000","last_undegraded":"2024-04-26T23:28:25.052135+0000","last_fullsized":"2024-04-26T23:28:25.052135+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:56.751773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043650+0000","last_change":"2024-04-26T23:28:23.029366+0000","last_active":"2024-04-26T23:28:25.043650+0000","last_peered":"2024-04-26T23:28:25.043650+0000","last_clean":"2024-04-26T23:28:25.043650+0000","last_became_active":"2024-04-26T23:28:23.029052+0000","last_became_peered":"2024-04-26T23:28:23.029052+0000","last_unstale":"2024-04-26T23:28:25.043650+0000","last_undegraded":"2024-04-26T23:28:25.043650+0000","last_fullsized":"2024-04-26T23:28:25.043650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:02.642488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.049709+0000","last_change":"2024-04-26T23:28:24.040323+0000","last_active":"2024-04-26T23:28:25.049709+0000","last_peered":"2024-04-26T23:28:25.049709+0000","last_clean":"2024-04-26T23:28:25.049709+0000","last_became_active":"2024-04-26T23:28:24.040053+0000","last_became_peered":"2024-04-26T23:28:24.040053+0000","last_unstale":"2024-04-26T23:28:25.049709+0000","last_undegraded":"2024-04-26T23:28:25.049709+0000","last_fullsized":"2024-04-26T23:28:25.049709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:58.730635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051268+0000","last_change":"2024-04-26T23:28:23.024995+0000","last_active":"2024-04-26T23:28:25.051268+0000","last_peered":"2024-04-26T23:28:25.051268+0000","last_clean":"2024-04-26T23:28:25.051268+0000","last_became_active":"2024-04-26T23:28:23.024726+0000","last_became_peered":"2024-04-26T23:28:23.024726+0000","last_unstale":"2024-04-26T23:28:25.051268+0000","last_undegraded":"2024-04-26T23:28:25.051268+0000","last_fullsized":"2024-04-26T23:28:25.051268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:33.353768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154490+0000","last_change":"2024-04-26T23:28:24.045314+0000","last_active":"2024-04-26T23:28:25.154490+0000","last_peered":"2024-04-26T23:28:25.154490+0000","last_clean":"2024-04-26T23:28:25.154490+0000","last_became_active":"2024-04-26T23:28:24.045036+0000","last_became_peered":"2024-04-26T23:28:24.045036+0000","last_unstale":"2024-04-26T23:28:25.154490+0000","last_undegraded":"2024-04-26T23:28:25.154490+0000","last_fullsized":"2024-04-26T23:28:25.154490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:13.656882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.038036+0000","last_change":"2024-04-26T23:28:23.024764+0000","last_active":"2024-04-26T23:28:25.038036+0000","last_peered":"2024-04-26T23:28:25.038036+0000","last_clean":"2024-04-26T23:28:25.038036+0000","last_became_active":"2024-04-26T23:28:23.023438+0000","last_became_peered":"2024-04-26T23:28:23.023438+0000","last_unstale":"2024-04-26T23:28:25.038036+0000","last_undegraded":"2024-04-26T23:28:25.038036+0000","last_fullsized":"2024-04-26T23:28:25.038036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:29:36.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154737+0000","last_change":"2024-04-26T23:28:24.042281+0000","last_active":"2024-04-26T23:28:25.154737+0000","last_peered":"2024-04-26T23:28:25.154737+0000","last_clean":"2024-04-26T23:28:25.154737+0000","last_became_active":"2024-04-26T23:28:24.042019+0000","last_became_peered":"2024-04-26T23:28:24.042019+0000","last_unstale":"2024-04-26T23:28:25.154737+0000","last_undegraded":"2024-04-26T23:28:25.154737+0000","last_fullsized":"2024-04-26T23:28:25.154737+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:33.510843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.051928+0000","last_change":"2024-04-26T23:28:23.018442+0000","last_active":"2024-04-26T23:28:25.051928+0000","last_peered":"2024-04-26T23:28:25.051928+0000","last_clean":"2024-04-26T23:28:25.051928+0000","last_became_active":"2024-04-26T23:28:23.018167+0000","last_became_peered":"2024-04-26T23:28:23.018167+0000","last_unstale":"2024-04-26T23:28:25.051928+0000","last_undegraded":"2024-04-26T23:28:25.051928+0000","last_fullsized":"2024-04-26T23:28:25.051928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:33.353768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037620+0000","last_change":"2024-04-26T23:28:24.043756+0000","last_active":"2024-04-26T23:28:25.037620+0000","last_peered":"2024-04-26T23:28:25.037620+0000","last_clean":"2024-04-26T23:28:25.037620+0000","last_became_active":"2024-04-26T23:28:24.043350+0000","last_became_peered":"2024-04-26T23:28:24.043350+0000","last_unstale":"2024-04-26T23:28:25.037620+0000","last_undegraded":"2024-04-26T23:28:25.037620+0000","last_fullsized":"2024-04-26T23:28:25.037620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:24.615728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.037584+0000","last_change":"2024-04-26T23:28:23.020353+0000","last_active":"2024-04-26T23:28:25.037584+0000","last_peered":"2024-04-26T23:28:25.037584+0000","last_clean":"2024-04-26T23:28:25.037584+0000","last_became_active":"2024-04-26T23:28:23.020053+0000","last_became_peered":"2024-04-26T23:28:23.020053+0000","last_unstale":"2024-04-26T23:28:25.037584+0000","last_undegraded":"2024-04-26T23:28:25.037584+0000","last_fullsized":"2024-04-26T23:28:25.037584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:11.147821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043297+0000","last_change":"2024-04-26T23:28:24.047620+0000","last_active":"2024-04-26T23:28:25.043297+0000","last_peered":"2024-04-26T23:28:25.043297+0000","last_clean":"2024-04-26T23:28:25.043297+0000","last_became_active":"2024-04-26T23:28:24.047275+0000","last_became_peered":"2024-04-26T23:28:24.047275+0000","last_unstale":"2024-04-26T23:28:25.043297+0000","last_undegraded":"2024-04-26T23:28:25.043297+0000","last_fullsized":"2024-04-26T23:28:25.043297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:07.023168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551402+0000","last_change":"2024-04-26T23:28:23.024077+0000","last_active":"2024-04-26T23:28:25.551402+0000","last_peered":"2024-04-26T23:28:25.551402+0000","last_clean":"2024-04-26T23:28:25.551402+0000","last_became_active":"2024-04-26T23:28:23.023318+0000","last_became_peered":"2024-04-26T23:28:23.023318+0000","last_unstale":"2024-04-26T23:28:25.551402+0000","last_undegraded":"2024-04-26T23:28:25.551402+0000","last_fullsized":"2024-04-26T23:28:25.551402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:32.736217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.551544+0000","last_change":"2024-04-26T23:28:24.032089+0000","last_active":"2024-04-26T23:28:25.551544+0000","last_peered":"2024-04-26T23:28:25.551544+0000","last_clean":"2024-04-26T23:28:25.551544+0000","last_became_active":"2024-04-26T23:28:24.030765+0000","last_became_peered":"2024-04-26T23:28:24.030765+0000","last_unstale":"2024-04-26T23:28:25.551544+0000","last_undegraded":"2024-04-26T23:28:25.551544+0000","last_fullsized":"2024-04-26T23:28:25.551544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:07.023168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.041949+0000","last_change":"2024-04-26T23:28:23.022333+0000","last_active":"2024-04-26T23:28:25.041949+0000","last_peered":"2024-04-26T23:28:25.041949+0000","last_clean":"2024-04-26T23:28:25.041949+0000","last_became_active":"2024-04-26T23:28:23.022026+0000","last_became_peered":"2024-04-26T23:28:23.022026+0000","last_unstale":"2024-04-26T23:28:25.041949+0000","last_undegraded":"2024-04-26T23:28:25.041949+0000","last_fullsized":"2024-04-26T23:28:25.041949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:32.736217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044039+0000","last_change":"2024-04-26T23:28:24.054898+0000","last_active":"2024-04-26T23:28:25.044039+0000","last_peered":"2024-04-26T23:28:25.044039+0000","last_clean":"2024-04-26T23:28:25.044039+0000","last_became_active":"2024-04-26T23:28:24.054526+0000","last_became_peered":"2024-04-26T23:28:24.054526+0000","last_unstale":"2024-04-26T23:28:25.044039+0000","last_undegraded":"2024-04-26T23:28:25.044039+0000","last_fullsized":"2024-04-26T23:28:25.044039+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:25.423176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.044042+0000","last_change":"2024-04-26T23:28:23.030192+0000","last_active":"2024-04-26T23:28:25.044042+0000","last_peered":"2024-04-26T23:28:25.044042+0000","last_clean":"2024-04-26T23:28:25.044042+0000","last_became_active":"2024-04-26T23:28:23.029809+0000","last_became_peered":"2024-04-26T23:28:23.029809+0000","last_unstale":"2024-04-26T23:28:25.044042+0000","last_undegraded":"2024-04-26T23:28:25.044042+0000","last_fullsized":"2024-04-26T23:28:25.044042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:56.886673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.688004+0000","last_change":"2024-04-26T23:28:24.047419+0000","last_active":"2024-04-26T23:28:25.688004+0000","last_peered":"2024-04-26T23:28:25.688004+0000","last_clean":"2024-04-26T23:28:25.688004+0000","last_became_active":"2024-04-26T23:28:24.047142+0000","last_became_peered":"2024-04-26T23:28:24.047142+0000","last_unstale":"2024-04-26T23:28:25.688004+0000","last_undegraded":"2024-04-26T23:28:25.688004+0000","last_fullsized":"2024-04-26T23:28:25.688004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:22.999403+0000","last_clean_scrub_stamp":"2024-04-26T23:28:22.999403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:16.824768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.043311+0000","last_change":"2024-04-26T23:28:23.027353+0000","last_active":"2024-04-26T23:28:25.043311+0000","last_peered":"2024-04-26T23:28:25.043311+0000","last_clean":"2024-04-26T23:28:25.043311+0000","last_became_active":"2024-04-26T23:28:23.026996+0000","last_became_peered":"2024-04-26T23:28:23.026996+0000","last_unstale":"2024-04-26T23:28:25.043311+0000","last_undegraded":"2024-04-26T23:28:25.043311+0000","last_fullsized":"2024-04-26T23:28:25.043311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:28:21.992607+0000","last_clean_scrub_stamp":"2024-04-26T23:28:21.992607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:28.325739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:28:25.154141+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:28:25.154141+0000","last_peered":"2024-04-26T23:28:25.154141+0000","last_clean":"2024-04-26T23:28:25.154141+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:28:25.154141+0000","last_undegraded":"2024-04-26T23:28:25.154141+0000","last_fullsized":"2024-04-26T23:28:25.154141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1368064,"data_stored":918684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":327792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":327790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":327770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":327812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":778240,"data_stored":329312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":329928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1359872,"data_stored":918068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:28:28.561 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:28:28.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:28:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.742+0000 7efc0d200640 1 Processor -- start 2024-04-26T23:28:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.742+0000 7efc0d200640 1 -- start start 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc0d200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc081598a0 0x7efc0806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc0d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efc0806c910 0x7efc080b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc0d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc080b5970 con 0x7efc080b52d0 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc0d200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efc080b5740 con 0x7efc081598a0 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc0d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7efc08160070 con 0x7efc0806c910 2024-04-26T23:28:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc081598a0 0x7efc0806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc081598a0 0x7efc0806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43822/0 (socket says 172.21.15.39:43822) 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 -- 172.21.15.39:0/3115236214 learned_addr learned my addr 172.21.15.39:0/3115236214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 -- 172.21.15.39:0/3115236214 >> v2:172.21.15.71:3300/0 conn(0x7efc0806c910 msgr2=0x7efc080b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 --2- 172.21.15.39:0/3115236214 >> v2:172.21.15.71:3300/0 conn(0x7efc0806c910 0x7efc080b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 -- 172.21.15.39:0/3115236214 >> v1:172.21.15.71:6789/0 conn(0x7efc080b52d0 legacy=0x7efc08162cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.746+0000 7efc07400640 1 -- 172.21.15.39:0/3115236214 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0815f740 con 0x7efc081598a0 2024-04-26T23:28:28.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc07400640 1 --2- 172.21.15.39:0/3115236214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc081598a0 0x7efc0806c3d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efc080b6a50 tx=0x7efbf801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1907964c1e968e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc06a00640 1 -- 172.21.15.39:0/3115236214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80b0070 con 0x7efc081598a0 2024-04-26T23:28:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc06a00640 1 -- 172.21.15.39:0/3115236214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf80ab600 con 0x7efc081598a0 2024-04-26T23:28:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc06a00640 1 -- 172.21.15.39:0/3115236214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab9d0 con 0x7efc081598a0 2024-04-26T23:28:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- 172.21.15.39:0/3115236214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc081598a0 msgr2=0x7efc0806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- 172.21.15.39:0/3115236214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc081598a0 0x7efc0806c3d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efc080b6a50 tx=0x7efbf801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- 172.21.15.39:0/3115236214 shutdown_connections 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- 172.21.15.39:0/3115236214 >> v2:172.21.15.71:3300/0 conn(0x7efc0806c910 0x7efc080b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- 172.21.15.39:0/3115236214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc081598a0 0x7efc0806c3d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- 172.21.15.39:0/3115236214 >> 172.21.15.39:0/3115236214 conn(0x7efc0806d4e0 msgr2=0x7efc0806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- 172.21.15.39:0/3115236214 shutdown_connections 2024-04-26T23:28:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- 172.21.15.39:0/3115236214 wait complete. 2024-04-26T23:28:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 Processor -- start 2024-04-26T23:28:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- start start 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc080b52d0 0x7efc0806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc081598a0 0x7efc080704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc08160680 con 0x7efc0806c910 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc08160500 con 0x7efc081598a0 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc0d200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efc0816be10 con 0x7efc080b52d0 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc07400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc07400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43836/0 (socket says 172.21.15.39:43836) 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.750+0000 7efc07400640 1 -- 172.21.15.39:0/3992227192 learned_addr learned my addr 172.21.15.39:0/3992227192 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 -- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc080b52d0 msgr2=0x7efc0806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc080b52d0 0x7efc0806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 -- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc081598a0 msgr2=0x7efc080704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc081598a0 0x7efc080704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 -- 172.21.15.39:0/3992227192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc081583c0 con 0x7efc0806c910 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc07400640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ae040 tx=0x7efbf801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ba020 con 0x7efc0806c910 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf80b6640 con 0x7efc0806c910 2024-04-26T23:28:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80b0040 con 0x7efc0806c910 2024-04-26T23:28:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc081586a0 con 0x7efc0806c910 2024-04-26T23:28:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc08158c60 con 0x7efc0806c910 2024-04-26T23:28:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc080506d0 con 0x7efc0806c910 2024-04-26T23:28:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7efbf80bd020 con 0x7efc0806c910 2024-04-26T23:28:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 0x7efbe406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.754+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7efbf8120f40 con 0x7efc0806c910 2024-04-26T23:28:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.758+0000 7efbffe00640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 0x7efbe406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.758+0000 7efbffe00640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 0x7efbe406a8d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efc080d1990 tx=0x7efbf0006c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:28.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.762+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efbf80c4030 con 0x7efc0806c910 2024-04-26T23:28:28.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.982+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efc080b3800 con 0x7efc0806c910 2024-04-26T23:28:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efbff400640 1 -- 172.21.15.39:0/3992227192 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7efbf80160d0 con 0x7efc0806c910 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDXNyxmF4BDChAAhbSSU6F5/Q1F5t5zFIsr3g== 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: caps mds = "allow" 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: caps mon = "allow r" 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:28:28.990 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2024-04-26T23:28:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 msgr2=0x7efbe406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 0x7efbe406a8d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efc080d1990 tx=0x7efbf0006c00 comp rx=0 tx=0).stop 2024-04-26T23:28:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 msgr2=0x7efc0814f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ae040 tx=0x7efbf801ad20 comp rx=0 tx=0).stop 2024-04-26T23:28:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 shutdown_connections 2024-04-26T23:28:28.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efbe4068410 0x7efbe406a8d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc081598a0 0x7efc080704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efc080b52d0 0x7efc0806ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 --2- 172.21.15.39:0/3992227192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0806c910 0x7efc0814f400 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:28.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 >> 172.21.15.39:0/3992227192 conn(0x7efc0806d4e0 msgr2=0x7efc08155900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:28.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 shutdown_connections 2024-04-26T23:28:28.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:28.986+0000 7efc0d200640 1 -- 172.21.15.39:0/3992227192 wait complete. 2024-04-26T23:28:28.996 INFO:tasks.ceph.mds.c.smithi039.stderr:2024-04-26T23:28:28.994+0000 7fd7e6800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:28:29.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:28:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 Processor -- start 2024-04-26T23:28:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 -- start start 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2edc0af050 0x7f2edc0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2edc0af430 0x7f2edc1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2edc0720c0 con 0x7f2edc0afdc0 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2edc160d60 con 0x7f2edc0af430 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ee0c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2edc072330 con 0x7f2edc0af050 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2edc0af430 0x7f2edc1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2edbe00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2edc0afdc0 0x7f2edc0cc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42730/0 (socket says 172.21.15.39:42730) 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2edbe00640 1 -- 172.21.15.39:0/4205350212 learned_addr learned my addr 172.21.15.39:0/4205350212 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/4205350212 >> v2:172.21.15.39:3300/0 conn(0x7f2edc0af430 0x7f2edc1617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43848/0 (socket says 172.21.15.39:43848) 2024-04-26T23:28:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2edb400640 1 --2- 172.21.15.39:0/4205350212 >> v2:172.21.15.71:3300/0 conn(0x7f2edc0af050 0x7f2edc0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 -- 172.21.15.39:0/4205350212 >> v2:172.21.15.71:3300/0 conn(0x7f2edc0af050 msgr2=0x7f2edc0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/4205350212 >> v2:172.21.15.71:3300/0 conn(0x7f2edc0af050 0x7f2edc0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 -- 172.21.15.39:0/4205350212 >> v1:172.21.15.39:6789/0 conn(0x7f2edc0afdc0 legacy=0x7f2edc0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.150+0000 7f2ed2a00640 1 -- 172.21.15.39:0/4205350212 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc160fb0 con 0x7f2edc0af430 2024-04-26T23:28:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/4205350212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1617b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0ce870 tx=0x7f2ec401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a0be0003d7660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2edaa00640 1 -- 172.21.15.39:0/4205350212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40b0070 con 0x7f2edc0af430 2024-04-26T23:28:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2edaa00640 1 -- 172.21.15.39:0/4205350212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4004230 con 0x7f2edc0af430 2024-04-26T23:28:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2edaa00640 1 -- 172.21.15.39:0/4205350212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4003620 con 0x7f2edc0af430 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 -- 172.21.15.39:0/4205350212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 msgr2=0x7f2edc1617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/4205350212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1617b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0ce870 tx=0x7f2ec401c330 comp rx=0 tx=0).stop 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 -- 172.21.15.39:0/4205350212 shutdown_connections 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/4205350212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1617b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/4205350212 >> v2:172.21.15.71:3300/0 conn(0x7f2edc0af050 0x7f2edc0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 -- 172.21.15.39:0/4205350212 >> 172.21.15.39:0/4205350212 conn(0x7f2edc0d0d80 msgr2=0x7f2edc0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 -- 172.21.15.39:0/4205350212 shutdown_connections 2024-04-26T23:28:29.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.154+0000 7f2ee0c00640 1 -- 172.21.15.39:0/4205350212 wait complete. 2024-04-26T23:28:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 Processor -- start 2024-04-26T23:28:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- start start 2024-04-26T23:28:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 0x7f2edc0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2edc0afdc0 0x7f2edc09d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc15d200 con 0x7f2edc0af430 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc0cd2d0 con 0x7f2edc0afdc0 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2edc15d380 con 0x7f2edc0af050 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43864/0 (socket says 172.21.15.39:43864) 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 -- 172.21.15.39:0/3016598886 learned_addr learned my addr 172.21.15.39:0/3016598886 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2edb400640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 0x7f2edc0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 -- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 msgr2=0x7f2edc0cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 0x7f2edc0cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 -- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2edc0afdc0 msgr2=0x7f2edc09d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2edc0afdc0 0x7f2edc09d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 -- 172.21.15.39:0/3016598886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc15c1d0 con 0x7f2edc0af430 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2edb400640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 0x7f2edc0cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed2a00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4018f40 tx=0x7f2ec40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40b9020 con 0x7f2edc0af430 2024-04-26T23:28:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec40043e0 con 0x7f2edc0af430 2024-04-26T23:28:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40b0040 con 0x7f2edc0af430 2024-04-26T23:28:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2edc0cc500 con 0x7f2edc0af430 2024-04-26T23:28:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.158+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2edc09cb60 con 0x7f2edc0af430 2024-04-26T23:28:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2edc0690e0 con 0x7f2edc0af430 2024-04-26T23:28:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2ec40bc020 con 0x7f2edc0af430 2024-04-26T23:28:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2ed3e00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 0x7f2eb806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f2ec4120b20 con 0x7f2edc0af430 2024-04-26T23:28:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2edb400640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 0x7f2eb806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.162+0000 7f2edb400640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 0x7f2eb806a8d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0c6910 tx=0x7f2ecc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.166+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ec40c3030 con 0x7f2edc0af430 2024-04-26T23:28:29.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.362+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2edc06fbc0 con 0x7f2edc0af430 2024-04-26T23:28:29.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.362+0000 7f2ed3e00640 1 -- 172.21.15.39:0/3016598886 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5183 (secure 0 0 0) 0x7f2edc15c1d0 con 0x7f2edc0af430 2024-04-26T23:28:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:28:29.367 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:28:29.368 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 39 2024-04-26T23:28:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 msgr2=0x7f2eb806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 0x7f2eb806a8d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0c6910 tx=0x7f2ecc008040 comp rx=0 tx=0).stop 2024-04-26T23:28:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 msgr2=0x7f2edc1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4018f40 tx=0x7f2ec40190d0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 shutdown_connections 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2eb8068410 0x7f2eb806a8d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2edc0afdc0 0x7f2edc09d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2edc0af430 0x7f2edc1590d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 --2- 172.21.15.39:0/3016598886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2edc0af050 0x7f2edc0cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 >> 172.21.15.39:0/3016598886 conn(0x7f2edc0d0d80 msgr2=0x7f2edc0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 shutdown_connections 2024-04-26T23:28:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.366+0000 7f2ee0c00640 1 -- 172.21.15.39:0/3016598886 wait complete. 2024-04-26T23:28:29.792 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:28:23.404620+0000', 'modified': '2024-04-26T23:28:26.439107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5907}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5907': {'gid': 5907, 'name': 'c', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6835/1889655166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6833', 'nonce': 1889655166}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 1889655166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5907, 'qdb_cluster': [5907]} 2024-04-26T23:28:29.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:28:29.793 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T23:28:29.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 Processor -- start 2024-04-26T23:28:29.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 -- start start 2024-04-26T23:28:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0510161850 0x7f05100d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051006e500 con 0x7f05100d1720 2024-04-26T23:28:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051006e7e0 con 0x7f0510140170 2024-04-26T23:28:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0514a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f051006f110 con 0x7f0510161850 2024-04-26T23:28:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050e800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f05100d1720 0x7f05100cf6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42732/0 (socket says 172.21.15.39:42732) 2024-04-26T23:28:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050e800640 1 -- 172.21.15.39:0/2389560636 learned_addr learned my addr 172.21.15.39:0/2389560636 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0507e00640 1 --2- 172.21.15.39:0/2389560636 >> v2:172.21.15.71:3300/0 conn(0x7f0510161850 0x7f05100d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707551785 0 0) 0x7f051006e500 con 0x7f05100d1720 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f4003530 con 0x7f05100d1720 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579249970 0 0) 0x7f051006e7e0 con 0x7f0510140170 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f051006e500 con 0x7f0510140170 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4001160982 0 0) 0x7f04f4003530 con 0x7f05100d1720 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.934+0000 7f0507e00640 1 -- 172.21.15.39:0/2389560636 >> v1:172.21.15.71:6789/0 conn(0x7f0510140170 legacy=0x7f051015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0507e00640 1 -- 172.21.15.39:0/2389560636 >> v1:172.21.15.39:6789/0 conn(0x7f05100d1720 legacy=0x7f05100cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0507e00640 1 -- 172.21.15.39:0/2389560636 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051006eac0 con 0x7f0510161850 2024-04-26T23:28:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0507e00640 1 --2- 172.21.15.39:0/2389560636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0510161850 0x7f05100d11e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04f80097c0 tx=0x7f04f801cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d7d1324e70a99f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b0070 con 0x7f0510161850 2024-04-26T23:28:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80a4e50 con 0x7f0510161850 2024-04-26T23:28:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f050d400640 1 -- 172.21.15.39:0/2389560636 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508001a00 con 0x7f0510161850 2024-04-26T23:28:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 -- 172.21.15.39:0/2389560636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0510161850 msgr2=0x7f05100d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 --2- 172.21.15.39:0/2389560636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0510161850 0x7f05100d11e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04f80097c0 tx=0x7f04f801cd90 comp rx=0 tx=0).stop 2024-04-26T23:28:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 -- 172.21.15.39:0/2389560636 shutdown_connections 2024-04-26T23:28:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 --2- 172.21.15.39:0/2389560636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0510161850 0x7f05100d11e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 -- 172.21.15.39:0/2389560636 >> 172.21.15.39:0/2389560636 conn(0x7f051006c7d0 msgr2=0x7f051006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.938+0000 7f0514a00640 1 -- 172.21.15.39:0/2389560636 shutdown_connections 2024-04-26T23:28:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- 172.21.15.39:0/2389560636 wait complete. 2024-04-26T23:28:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 Processor -- start 2024-04-26T23:28:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- start start 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 0x7f0510140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0510161850 0x7f05100720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d09a0 con 0x7f0510140170 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d0820 con 0x7f05100d1720 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f051016afc0 con 0x7f0510161850 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43880/0 (socket says 172.21.15.39:43880) 2024-04-26T23:28:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 -- 172.21.15.39:0/4204107205 learned_addr learned my addr 172.21.15.39:0/4204107205 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f050de00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 0x7f0510140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 -- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0510161850 msgr2=0x7f05100720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0510161850 0x7f05100720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 -- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 msgr2=0x7f0510140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 0x7f0510140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 -- 172.21.15.39:0/4204107205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0510140a90 con 0x7f0510140170 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f050de00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 0x7f0510140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0507e00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f04f8019f60 tx=0x7f04f80190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0506000640 1 -- 172.21.15.39:0/4204107205 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b0070 con 0x7f0510140170 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0506000640 1 -- 172.21.15.39:0/4204107205 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80ba070 con 0x7f0510140170 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0510140d30 con 0x7f0510140170 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0506000640 1 -- 172.21.15.39:0/4204107205 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8003c30 con 0x7f0510140170 2024-04-26T23:28:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.942+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05101412f0 con 0x7f0510140170 2024-04-26T23:28:29.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f0506000640 1 -- 172.21.15.39:0/4204107205 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f04f80bf460 con 0x7f0510140170 2024-04-26T23:28:29.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f0506000640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 0x7f04ec06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f0506000640 1 -- 172.21.15.39:0/4204107205 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f04f8120920 con 0x7f0510140170 2024-04-26T23:28:29.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f0517f51000 1 Processor -- start 2024-04-26T23:28:29.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f0517f51000 1 -- start start 2024-04-26T23:28:29.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.946+0000 7f050de00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 0x7f04ec06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3d55610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d55f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3c09140 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3b9ee00 con 0x55c6b3d55b50 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55c6b3b57a00 con 0x55c6b3d9f410 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 0x7f04ec06a8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f05000011f0 tx=0x7f0500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43888/0 (socket says 172.21.15.39:43888) 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 -- 172.21.15.39:0/1337723437 learned_addr learned my addr 172.21.15.39:0/1337723437 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0507e00640 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3d55610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050e800640 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d55f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 -- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 msgr2=0x55c6b3d55610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3d55610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 -- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 msgr2=0x55c6b3d55f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d55f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 -- 172.21.15.39:0/1337723437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b3b5c0e0 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f050de00640 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f050000da30 tx=0x7f0500010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dce61e6f9c24478 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f04fea00640 1 -- 172.21.15.39:0/1337723437 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500024070 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f04fea00640 1 -- 172.21.15.39:0/1337723437 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500014db0 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f04fea00640 1 -- 172.21.15.39:0/1337723437 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050001f600 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- 172.21.15.39:0/1337723437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 msgr2=0x55c6b3d9eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f050000da30 tx=0x7f0500010000 comp rx=0 tx=0).stop 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- 172.21.15.39:0/1337723437 shutdown_connections 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d55f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3d55610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 --2- 172.21.15.39:0/1337723437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d9eed0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- 172.21.15.39:0/1337723437 >> 172.21.15.39:0/1337723437 conn(0x55c6b3d51b00 msgr2=0x55c6b3d53ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- 172.21.15.39:0/1337723437 shutdown_connections 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- 172.21.15.39:0/1337723437 wait complete. 2024-04-26T23:28:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 -- start start 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.950+0000 7f0517f51000 1 Processor -- start 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 0x55c6b3d8d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3bac200 con 0x55c6b3d9f410 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3b42e80 con 0x55c6b3d55b50 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55c6b3b99ae0 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 10 client.0 _ll_register_callbacks cb 0x55c6b3babda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43892/0 (socket says 172.21.15.39:43892) 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 -- 172.21.15.39:0/2241452650 learned_addr learned my addr 172.21.15.39:0/2241452650 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050de00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0507e00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 0x55c6b3d8d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 -- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 msgr2=0x55c6b3d8d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 0x55c6b3d8d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 -- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 msgr2=0x55c6b3d8d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 -- 172.21.15.39:0/2241452650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b3b3e4e0 con 0x55c6b3d9f410 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050de00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0507e00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 0x55c6b3d8d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050e800640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f050800fc40 tx=0x7f050800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc159f3c6ebecb1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050800dc30 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f050800ddd0 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0500014db0 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0508020050 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 10 client.6051 fetch_fsmap learned FSMap version 39 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55c6b3b24e80 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500014db0 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f0508023020 con 0x55c6b3d9f410 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 10 client.6051 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 10 client.6051 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 20 client.6051 populate_metadata read hostname 'smithi039' 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3daeb90 0x55c6b3db0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 4 client.6051 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 --> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6b3b37bc0 con 0x55c6b3daeb90 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050de00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3daeb90 0x55c6b3db0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f04f3400640 10 client.6051 ms_handle_connect on v2:172.21.15.39:6833/1889655166 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.954+0000 7f050de00640 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3daeb90 0x55c6b3db0f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79445799069661dc server_cookie=d8d58c2c7478b945 in_seq=0 out_seq=0 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f04f3400640 1 -- 172.21.15.39:0/2241452650 <== mds.0 v2:172.21.15.39:6833/1889655166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c6b3b37bc0 con 0x55c6b3daeb90 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f04f3400640 10 client.6051 handle_command_reply: tid=0 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 client.6051 shutdown 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 msgr2=0x55c6b3d8dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f050800fc40 tx=0x7f050800d520 comp rx=0 tx=0).stop 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 shutdown_connections 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3daeb90 0x55c6b3db0f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9f410 0x55c6b3d8dbf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9eaf0 0x55c6b3d8d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 --2- 172.21.15.39:0/2241452650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f04f3400640 0 client.6051 ms_handle_reset on v2:172.21.15.39:6833/1889655166 2024-04-26T23:28:29.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 >> 172.21.15.39:0/2241452650 conn(0x55c6b3d51b00 msgr2=0x55c6b3d567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 shutdown_connections 2024-04-26T23:28:29.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 1 -- 172.21.15.39:0/2241452650 wait complete. 2024-04-26T23:28:29.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.958+0000 7f0517f51000 20 client.6051 trim_cache size 0 max 16384 2024-04-26T23:28:29.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 Processor -- start 2024-04-26T23:28:29.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 -- start start 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3db0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05100b5f60 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05100b52c0 con 0x55c6b3d55b50 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f05100b5910 con 0x55c6b3d9f410 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43906/0 (socket says 172.21.15.39:43906) 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.974+0000 7f0507e00640 1 -- 172.21.15.39:0/1724458300 learned_addr learned my addr 172.21.15.39:0/1724458300 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f050de00640 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f050e800640 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3db0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 msgr2=0x55c6b3db0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3db0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 msgr2=0x55c6b3d8bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/1724458300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b3b57c50 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f04f801cdd0 tx=0x7f04f80ec980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957019568f60fb55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f04fe000640 1 -- 172.21.15.39:0/1724458300 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80f9240 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f04fe000640 1 -- 172.21.15.39:0/1724458300 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80b1040 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f04fe000640 1 -- 172.21.15.39:0/1724458300 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f811ef30 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- 172.21.15.39:0/1724458300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 msgr2=0x55c6b3d8c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f04f801cdd0 tx=0x7f04f80ec980 comp rx=0 tx=0).stop 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- 172.21.15.39:0/1724458300 shutdown_connections 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3db0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3d8c050 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- 172.21.15.39:0/1724458300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3d8bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- 172.21.15.39:0/1724458300 >> 172.21.15.39:0/1724458300 conn(0x55c6b3d51b00 msgr2=0x55c6b3dabec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- 172.21.15.39:0/1724458300 shutdown_connections 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- 172.21.15.39:0/1724458300 wait complete. 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- start start 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 Processor -- start 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3db4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3dcb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3b9e110 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c6b3b347b0 con 0x55c6b3d55b50 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55c6b3ba3430 con 0x55c6b3d9f410 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0517f51000 10 client.0 _ll_register_callbacks cb 0x7f0508001e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43918/0 (socket says 172.21.15.39:43918) 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/3924195760 learned_addr learned my addr 172.21.15.39:0/3924195760 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f050de00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3db4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f050e800640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3dcb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 msgr2=0x55c6b3dcb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3dcb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 msgr2=0x55c6b3db4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3db4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f0507e00640 1 -- 172.21.15.39:0/3924195760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b3c21160 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.978+0000 7f050e800640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3dcb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0507e00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f04f80ee910 tx=0x7f04f8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5120886b196a503 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80f9240 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f04f80bd360 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f80b1040 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f04f80bd560 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 10 client.6057 fetch_fsmap learned FSMap version 39 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55c6b38580c0 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80b1040 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f04f80f08c0 con 0x55c6b3d9eaf0 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 10 client.6057 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 10 client.6057 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:28:29.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 20 client.6057 populate_metadata read hostname 'smithi039' 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3e0e780 0x55c6b3e0eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 4 client.6057 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 --> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] -- command(tid 0: {"prefix": "status"}) -- 0x55c6b3d4d540 con 0x55c6b3e0e780 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f050de00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3e0e780 0x55c6b3e0eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f050de00640 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3e0e780 0x55c6b3e0eb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a314e1f4d3b1020 server_cookie=f26ee7315460f39f in_seq=0 out_seq=0 2024-04-26T23:28:29.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 10 client.6057 ms_handle_connect on v2:172.21.15.39:6833/1889655166 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 1 -- 172.21.15.39:0/3924195760 <== mds.0 v2:172.21.15.39:6833/1889655166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c6b3d4d540 con 0x55c6b3e0e780 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 10 client.6057 handle_command_reply: tid=0 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 client.6057 shutdown 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 msgr2=0x55c6b3dcab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f04f80ee910 tx=0x7f04f8009190 comp rx=0 tx=0).stop 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 shutdown_connections 2024-04-26T23:28:29.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:6833/1889655166,v1:172.21.15.39:6835/1889655166] conn(0x55c6b3e0e780 0x55c6b3e0eb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55c6b3d9f410 0x55c6b3dcb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c6b3d9eaf0 0x55c6b3dcab10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 --2- 172.21.15.39:0/3924195760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6b3d55b50 0x55c6b3db4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f04f3400640 0 client.6057 ms_handle_reset on v2:172.21.15.39:6833/1889655166 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 >> 172.21.15.39:0/3924195760 conn(0x55c6b3d51b00 msgr2=0x55c6b3d8bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 shutdown_connections 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 1 -- 172.21.15.39:0/3924195760 wait complete. 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0517f51000 20 client.6057 trim_cache size 0 max 16384 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:28:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "65ff9fdb-1208-4558-966c-a36e641138f0", 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5907, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 5.9526687440000003, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 39, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 63, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 63, 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 11.815379085 2024-04-26T23:28:29.992 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 msgr2=0x7f04ec06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 0x7f04ec06a8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f05000011f0 tx=0x7f0500009040 comp rx=0 tx=0).stop 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 msgr2=0x7f0510141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f04f8019f60 tx=0x7f04f80190d0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 shutdown_connections 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f04ec068410 0x7f04ec06a8d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0510161850 0x7f05100720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0510140170 0x7f0510141dd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 --2- 172.21.15.39:0/4204107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05100d1720 0x7f0510140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:29.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 >> 172.21.15.39:0/4204107205 conn(0x7f051006c7d0 msgr2=0x7f051006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:29.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 shutdown_connections 2024-04-26T23:28:29.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:29.982+0000 7f0514a00640 1 -- 172.21.15.39:0/4204107205 wait complete. 2024-04-26T23:28:30.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:28:30.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.142+0000 7f2297200640 1 Processor -- start 2024-04-26T23:28:30.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.142+0000 7f2297200640 1 -- start start 2024-04-26T23:28:30.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f229815cf60 0x7f22980d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2298161500 0x7f22980cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f22980b6220 con 0x7f229815cf60 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2298161950 con 0x7f2298161500 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2297200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f22980d1a20 con 0x7f2298160b60 2024-04-26T23:28:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f229815cf60 0x7f22980d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f229815cf60 0x7f22980d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55594/0 (socket says 172.21.15.39:55594) 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 -- 172.21.15.39:0/133215351 learned_addr learned my addr 172.21.15.39:0/133215351 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2296800640 1 --2- 172.21.15.39:0/133215351 >> v2:172.21.15.71:3300/0 conn(0x7f2298161500 0x7f22980cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f228fe00640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 -- 172.21.15.39:0/133215351 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 msgr2=0x7f2298160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 -- 172.21.15.39:0/133215351 >> v2:172.21.15.71:3300/0 conn(0x7f2298161500 msgr2=0x7f22980cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 --2- 172.21.15.39:0/133215351 >> v2:172.21.15.71:3300/0 conn(0x7f2298161500 0x7f22980cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 -- 172.21.15.39:0/133215351 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22980d1d00 con 0x7f229815cf60 2024-04-26T23:28:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f228fe00640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.146+0000 7f2295e00640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980d12d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f22980740d0 tx=0x7f228801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae4458b3595fe41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295400640 1 -- 172.21.15.39:0/133215351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880b0070 con 0x7f229815cf60 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295400640 1 -- 172.21.15.39:0/133215351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22880ab600 con 0x7f229815cf60 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295400640 1 -- 172.21.15.39:0/133215351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880ab9d0 con 0x7f229815cf60 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- 172.21.15.39:0/133215351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 msgr2=0x7f22980d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980d12d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f22980740d0 tx=0x7f228801c490 comp rx=0 tx=0).stop 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- 172.21.15.39:0/133215351 shutdown_connections 2024-04-26T23:28:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- 172.21.15.39:0/133215351 >> v2:172.21.15.71:3300/0 conn(0x7f2298161500 0x7f22980cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- 172.21.15.39:0/133215351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980d12d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- 172.21.15.39:0/133215351 >> 172.21.15.39:0/133215351 conn(0x7f22980d2d80 msgr2=0x7f22980d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- 172.21.15.39:0/133215351 shutdown_connections 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- 172.21.15.39:0/133215351 wait complete. 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 Processor -- start 2024-04-26T23:28:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- start start 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 0x7f229815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f22980b6830 con 0x7f229815cf60 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22980b66b0 con 0x7f2298161500 2024-04-26T23:28:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2297200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f22980b69b0 con 0x7f2298160b60 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55608/0 (socket says 172.21.15.39:55608) 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f2295e00640 1 -- 172.21.15.39:0/3131190339 learned_addr learned my addr 172.21.15.39:0/3131190339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.150+0000 7f228fe00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2296800640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 0x7f229815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 -- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 msgr2=0x7f2298150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 -- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 msgr2=0x7f229815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 0x7f229815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 -- 172.21.15.39:0/3131190339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2298156be0 con 0x7f229815cf60 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2296800640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 0x7f229815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228fe00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2295e00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f228801cd30 tx=0x7f2288019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880b0040 con 0x7f229815cf60 2024-04-26T23:28:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288005ba0 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229815fae0 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880ab7b0 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981600a0 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22980506d0 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f22880bb060 con 0x7f229815cf60 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 0x7f227406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f228811fb60 con 0x7f229815cf60 2024-04-26T23:28:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.154+0000 7f228fe00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 0x7f227406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.158+0000 7f228fe00640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 0x7f227406a900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f22980c9cd0 tx=0x7f2280008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.158+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2288016110 con 0x7f229815cf60 2024-04-26T23:28:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22980c65c0 con 0x7f229815cf60 2024-04-26T23:28:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f228e000640 1 -- 172.21.15.39:0/3131190339 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f22880effb0 con 0x7f229815cf60 2024-04-26T23:28:30.366 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 msgr2=0x7f227406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 0x7f227406a900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f22980c9cd0 tx=0x7f2280008040 comp rx=0 tx=0).stop 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 msgr2=0x7f22980c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f228801cd30 tx=0x7f2288019230 comp rx=0 tx=0).stop 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 shutdown_connections 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2274068440 0x7f227406a900 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298161500 0x7f229815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2298160b60 0x7f2298150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 --2- 172.21.15.39:0/3131190339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229815cf60 0x7f22980c9dc0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 >> 172.21.15.39:0/3131190339 conn(0x7f22980d2d80 msgr2=0x7f2298070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 shutdown_connections 2024-04-26T23:28:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30.362+0000 7f2297200640 1 -- 172.21.15.39:0/3131190339 wait complete. 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:28:30.387 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:28:30.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.388 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-04-26T23:28:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42319sec preferred_lft 42319sec 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.398 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:23:a8:f7:18 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:28:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:28:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:30.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.401 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:28:30.462 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-04-26T23:28:30.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.464 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-04-26T23:28:30.517 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-04-26T23:28:30.517 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:28:30.517 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:28:30.518 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:28:30.518 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:28:30.518 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:28:30.518 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-04-26T23:28:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:28:30.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:30.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.662 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:28:30.671 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:28:30.671 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:28:30.671 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:28:30.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-04-26T23:28:30.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:30.736 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:28:30.792 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:28:30.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:30.793 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:28:30.847 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:28:30.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.848 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:28:30.940 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:28:30.940 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:28:30.940 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:28:30.956 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:28:30.956 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:28:30.956 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:28:30.956 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:30.956 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:30.967 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:28:30.967 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:28:30.967 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-04-26T23:28:30.967 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:30.968 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:30.968 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:28:30.968 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:28:30.968 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:28:30.971 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:28:30.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:30.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:28:30.992 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:28:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:28:31.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:31.101 INFO:teuthology.orchestra.run.smithi039.stdout:client6010 2024-04-26T23:28:31.101 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:31.101 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:31.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:28:31.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.290+0000 7f0d82a00640 1 Processor -- start 2024-04-26T23:28:31.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.290+0000 7f0d82a00640 1 -- start start 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c15f500 0x7f0d7c0d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d82a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d7c0b7250 0x7f0d7c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d82a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c163ce0 con 0x7f0d7c0b4b10 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d82a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7c0b54b0 con 0x7f0d7c0b7250 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d82a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c0d1390 con 0x7f0d7c15f500 2024-04-26T23:28:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d80a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d7c0b7250 0x7f0d7c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c15f500 0x7f0d7c0d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d73e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0d7c0b4b10 0x7f0d7c06d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:42670/0 (socket says 172.21.15.39:42670) 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d73e00640 1 -- 172.21.15.39:0/2277440942 learned_addr learned my addr 172.21.15.39:0/2277440942 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d80a00640 1 -- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c15f500 msgr2=0x7f0d7c0d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d80a00640 1 --2- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c15f500 0x7f0d7c0d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d80a00640 1 -- 172.21.15.39:0/2277440942 >> v1:172.21.15.71:6789/0 conn(0x7f0d7c0b4b10 legacy=0x7f0d7c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.294+0000 7f0d80a00640 1 -- 172.21.15.39:0/2277440942 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c0d0dd0 con 0x7f0d7c0b7250 2024-04-26T23:28:31.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d80a00640 1 --2- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b7250 0x7f0d7c0b4f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009d90 tx=0x7f0d7401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75421a9eb8f7890 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:31.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d7b400640 1 -- 172.21.15.39:0/2277440942 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740b2070 con 0x7f0d7c0b7250 2024-04-26T23:28:31.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d7b400640 1 -- 172.21.15.39:0/2277440942 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740a5740 con 0x7f0d7c0b7250 2024-04-26T23:28:31.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d7b400640 1 -- 172.21.15.39:0/2277440942 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740a5b10 con 0x7f0d7c0b7250 2024-04-26T23:28:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b7250 msgr2=0x7f0d7c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 --2- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b7250 0x7f0d7c0b4f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009d90 tx=0x7f0d7401c850 comp rx=0 tx=0).stop 2024-04-26T23:28:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- 172.21.15.39:0/2277440942 shutdown_connections 2024-04-26T23:28:31.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 --2- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b7250 0x7f0d7c0b4f70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 --2- 172.21.15.39:0/2277440942 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c15f500 0x7f0d7c0d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- 172.21.15.39:0/2277440942 >> 172.21.15.39:0/2277440942 conn(0x7f0d7c068140 msgr2=0x7f0d7c068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:31.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- 172.21.15.39:0/2277440942 shutdown_connections 2024-04-26T23:28:31.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- 172.21.15.39:0/2277440942 wait complete. 2024-04-26T23:28:31.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 Processor -- start 2024-04-26T23:28:31.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.298+0000 7f0d82a00640 1 -- start start 2024-04-26T23:28:31.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b4b10 0x7f0d7c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c0b7250 0x7f0d7c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c163ac0 con 0x7f0d7c15f500 2024-04-26T23:28:31.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c163940 con 0x7f0d7c0b4b10 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c16c2d0 con 0x7f0d7c0b7250 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55610/0 (socket says 172.21.15.39:55610) 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 -- 172.21.15.39:0/962956230 learned_addr learned my addr 172.21.15.39:0/962956230 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d7be00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b4b10 0x7f0d7c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d73e00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c0b7250 0x7f0d7c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 -- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c0b7250 msgr2=0x7f0d7c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c0b7250 0x7f0d7c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 -- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b4b10 msgr2=0x7f0d7c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b4b10 0x7f0d7c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 -- 172.21.15.39:0/962956230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c0d0580 con 0x7f0d7c15f500 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d80a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0d740b0040 tx=0x7f0d740195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:31.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740bd020 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740b8470 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c0cb0c0 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740b2040 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c0cb680 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c050740 con 0x7f0d7c15f500 2024-04-26T23:28:31.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.302+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f0d740c0020 con 0x7f0d7c15f500 2024-04-26T23:28:31.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.306+0000 7f0d78c00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 0x7f0d5806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:31.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.306+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f0d741216c0 con 0x7f0d7c15f500 2024-04-26T23:28:31.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.306+0000 7f0d7be00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 0x7f0d5806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:31.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.306+0000 7f0d7be00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 0x7f0d5806a8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009b60 tx=0x7f0d6c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:31.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.310+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0d740c7030 con 0x7f0d7c15f500 2024-04-26T23:28:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.510+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0d7c0b3070 con 0x7f0d7c15f500 2024-04-26T23:28:31.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.510+0000 7f0d78c00640 1 -- 172.21.15.39:0/962956230 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f0d74016560 con 0x7f0d7c15f500 2024-04-26T23:28:31.515 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:28:31.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 msgr2=0x7f0d5806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 0x7f0d5806a8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009b60 tx=0x7f0d6c009190 comp rx=0 tx=0).stop 2024-04-26T23:28:31.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 msgr2=0x7f0d7c15a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:31.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0d740b0040 tx=0x7f0d740195f0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 shutdown_connections 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0d58068410 0x7f0d5806a8d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d7c15f500 0x7f0d7c15a880 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d7c0b7250 0x7f0d7c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 --2- 172.21.15.39:0/962956230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d7c0b4b10 0x7f0d7c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 >> 172.21.15.39:0/962956230 conn(0x7f0d7c068140 msgr2=0x7f0d7c0cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 shutdown_connections 2024-04-26T23:28:31.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:31.514+0000 7f0d82a00640 1 -- 172.21.15.39:0/962956230 wait complete. 2024-04-26T23:28:31.536 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:28:31.537 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:28:31.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.537 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42286sec preferred_lft 42286sec 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 02:42:96:98:d1:ab brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:28:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:28:31.549 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:28:31.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.550 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:28:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-26T23:28:31.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.613 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:28:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:28:31.669 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:28:31.669 INFO:teuthology.orchestra.run.smithi071.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:28:31.669 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:28:31.669 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-26T23:28:31.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:28:31.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:31.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.813 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:28:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:28:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:28:31.823 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:28:31.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-26T23:28:31.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:31.892 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:31.947 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:28:31.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:28:31.947 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:31.998 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:28:31.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:31.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:32.090 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:32.090 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:32.090 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:32.106 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:32.106 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:32.106 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:32.106 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:32.106 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:invalid new device string format 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790" 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.71:6789,172.21.15.71:6790:/ 2024-04-26T23:28:32.115 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=65ff9fdb-1208-4558-966c-a36e641138f0" will pass to kernel 2024-04-26T23:28:32.119 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:28:32.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:32.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:28:32.138 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:28:32.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:28:32.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T23:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:28:32.235 INFO:teuthology.orchestra.run.smithi071.stdout:client6022 2024-04-26T23:28:32.235 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:28:32.235 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:32.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-26T23:28:32.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 Processor -- start 2024-04-26T23:28:32.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 -- start start 2024-04-26T23:28:32.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 0x7f0468074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:32.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04680b4280 con 0x7f04680b3df0 2024-04-26T23:28:32.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046806f020 con 0x7f04681468a0 2024-04-26T23:28:32.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f046806edd0 con 0x7f04681613d0 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f045f400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f04680b3df0 0x7f0468072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35140/0 (socket says 172.21.15.39:35140) 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f045f400640 1 -- 172.21.15.39:0/2156991747 learned_addr learned my addr 172.21.15.39:0/2156991747 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046d200640 1 --2- 172.21.15.39:0/2156991747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 0x7f0468074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218152057 0 0) 0x7f04680b4280 con 0x7f04680b3df0 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f044c003530 con 0x7f04680b3df0 2024-04-26T23:28:32.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412149394 0 0) 0x7f046806f020 con 0x7f04681468a0 2024-04-26T23:28:32.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04680b4280 con 0x7f04681468a0 2024-04-26T23:28:32.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046d200640 1 -- 172.21.15.39:0/2156991747 >> v1:172.21.15.71:6789/0 conn(0x7f04681468a0 legacy=0x7f0468160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:32.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046d200640 1 -- 172.21.15.39:0/2156991747 >> v1:172.21.15.39:6789/0 conn(0x7f04680b3df0 legacy=0x7f0468072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:32.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.386+0000 7f046d200640 1 -- 172.21.15.39:0/2156991747 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046806f300 con 0x7f04681613d0 2024-04-26T23:28:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046d200640 1 --2- 172.21.15.39:0/2156991747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 0x7f0468074180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f046806ef50 tx=0x7f046001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336926adab3173b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600b0070 con 0x7f04681613d0 2024-04-26T23:28:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04600ab600 con 0x7f04681613d0 2024-04-26T23:28:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f0467400640 1 -- 172.21.15.39:0/2156991747 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600ab9d0 con 0x7f04681613d0 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 -- 172.21.15.39:0/2156991747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 msgr2=0x7f0468074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 --2- 172.21.15.39:0/2156991747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 0x7f0468074180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f046806ef50 tx=0x7f046001c3a0 comp rx=0 tx=0).stop 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 -- 172.21.15.39:0/2156991747 shutdown_connections 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 --2- 172.21.15.39:0/2156991747 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681613d0 0x7f0468074180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 -- 172.21.15.39:0/2156991747 >> 172.21.15.39:0/2156991747 conn(0x7f04680b2cc0 msgr2=0x7f04680b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 -- 172.21.15.39:0/2156991747 shutdown_connections 2024-04-26T23:28:32.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.390+0000 7f046f200640 1 -- 172.21.15.39:0/2156991747 wait complete. 2024-04-26T23:28:32.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 Processor -- start 2024-04-26T23:28:32.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- start start 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681468a0 0x7f04681526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046813fb80 0x7f04681455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0468073750 con 0x7f04681613d0 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04680735d0 con 0x7f046813fb80 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f046816b880 con 0x7f04681468a0 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55620/0 (socket says 172.21.15.39:55620) 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 -- 172.21.15.39:0/3093810945 learned_addr learned my addr 172.21.15.39:0/3093810945 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046d200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046813fb80 0x7f04681455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f0467e00640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681468a0 0x7f04681526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:32.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 -- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681468a0 msgr2=0x7f04681526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:32.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681468a0 0x7f04681526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 -- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046813fb80 msgr2=0x7f04681455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046813fb80 0x7f04681455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 -- 172.21.15.39:0/3093810945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0468140020 con 0x7f04681613d0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f045f400640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0450005890 tx=0x7f045000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450017070 con 0x7f04681613d0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0450005cf0 con 0x7f04681613d0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04681423d0 con 0x7f04681613d0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500072d0 con 0x7f04681613d0 2024-04-26T23:28:32.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.394+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0468142990 con 0x7f04681613d0 2024-04-26T23:28:32.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0468050740 con 0x7f04681613d0 2024-04-26T23:28:32.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f045001a070 con 0x7f04681613d0 2024-04-26T23:28:32.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f0464c00640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 0x7f044406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:32.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f0450085d30 con 0x7f04681613d0 2024-04-26T23:28:32.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f0467e00640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 0x7f044406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.398+0000 7f0467e00640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 0x7f044406a8d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0458007fd0 tx=0x7f0458009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:32.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.402+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0450055c40 con 0x7f04681613d0 2024-04-26T23:28:32.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:32.606+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0468155640 con 0x7f04681613d0 2024-04-26T23:28:33.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.102+0000 7f0464c00640 1 -- 172.21.15.39:0/3093810945 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) ==== 136+0+0 (secure 0 0 0) 0x7f0450059f40 con 0x7f04681613d0 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 msgr2=0x7f044406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 0x7f044406a8d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0458007fd0 tx=0x7f0458009040 comp rx=0 tx=0).stop 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 msgr2=0x7f0468155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0450005890 tx=0x7f045000c8b0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 shutdown_connections 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0444068410 0x7f044406a8d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046813fb80 0x7f04681455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04681613d0 0x7f0468155100 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 --2- 172.21.15.39:0/3093810945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04681468a0 0x7f04681526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 >> 172.21.15.39:0/3093810945 conn(0x7f04680b2cc0 msgr2=0x7f04680b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 shutdown_connections 2024-04-26T23:28:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.106+0000 7f046f200640 1 -- 172.21.15.39:0/3093810945 wait complete. 2024-04-26T23:28:33.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:28:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 Processor -- start 2024-04-26T23:28:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 -- start start 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c06d4e0 0x7fd04c06d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c0d01e0 con 0x7fd04c0d10d0 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd04c06dfa0 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd051600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c06e280 con 0x7fd04c06d4e0 2024-04-26T23:28:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55624/0 (socket says 172.21.15.39:55624) 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 -- 172.21.15.39:0/3021085697 learned_addr learned my addr 172.21.15.39:0/3021085697 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd042000640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c06d4e0 0x7fd04c06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 -- 172.21.15.39:0/3021085697 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c06d4e0 msgr2=0x7fd04c06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c06d4e0 0x7fd04c06d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 -- 172.21.15.39:0/3021085697 >> v1:172.21.15.71:6789/0 conn(0x7fd04c0d10d0 legacy=0x7fd04c0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.274+0000 7fd04aa00640 1 -- 172.21.15.39:0/3021085697 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c06e560 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd04aa00640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009870 tx=0x7fd03c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6627be4f5de120dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd04a000640 1 -- 172.21.15.39:0/3021085697 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0a95f0 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd04a000640 1 -- 172.21.15.39:0/3021085697 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03c0a9790 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd04a000640 1 -- 172.21.15.39:0/3021085697 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0a9b60 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- 172.21.15.39:0/3021085697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c0cf8c0 msgr2=0x7fd04c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009870 tx=0x7fd03c01c530 comp rx=0 tx=0).stop 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- 172.21.15.39:0/3021085697 shutdown_connections 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c06d4e0 0x7fd04c06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 --2- 172.21.15.39:0/3021085697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c0cfca0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- 172.21.15.39:0/3021085697 >> 172.21.15.39:0/3021085697 conn(0x7fd04c0d3040 msgr2=0x7fd04c0d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- 172.21.15.39:0/3021085697 shutdown_connections 2024-04-26T23:28:33.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- 172.21.15.39:0/3021085697 wait complete. 2024-04-26T23:28:33.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 Processor -- start 2024-04-26T23:28:33.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.278+0000 7fd051600640 1 -- start start 2024-04-26T23:28:33.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c0d10d0 0x7fd04c14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c15f570 con 0x7fd04c06d4e0 2024-04-26T23:28:33.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0b4730 con 0x7fd04c0cf8c0 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c15f6f0 con 0x7fd04c0d10d0 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55630/0 (socket says 172.21.15.39:55630) 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 -- 172.21.15.39:0/367765758 learned_addr learned my addr 172.21.15.39:0/367765758 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04b400640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c0d10d0 0x7fd04c14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd042000640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 -- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c0d10d0 msgr2=0x7fd04c14eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c0d10d0 0x7fd04c14eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 -- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c0cf8c0 msgr2=0x7fd04c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 -- 172.21.15.39:0/367765758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c14af40 con 0x7fd04c06d4e0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd04aa00640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd03c01abe0 tx=0x7fd03c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0a95f0 con 0x7fd04c06d4e0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03c0b1800 con 0x7fd04c06d4e0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c14b220 con 0x7fd04c06d4e0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0b1bf0 con 0x7fd04c06d4e0 2024-04-26T23:28:33.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c0cb340 con 0x7fd04c06d4e0 2024-04-26T23:28:33.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c06a720 con 0x7fd04c06d4e0 2024-04-26T23:28:33.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.282+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd03c0c43f0 con 0x7fd04c06d4e0 2024-04-26T23:28:33.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.286+0000 7fd043400640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 0x7fd02806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.286+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fd03c121240 con 0x7fd04c06d4e0 2024-04-26T23:28:33.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.286+0000 7fd042000640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 0x7fd02806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.286+0000 7fd042000640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 0x7fd02806a8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0b8ee0 tx=0x7fd034008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.290+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd03c0ad020 con 0x7fd04c06d4e0 2024-04-26T23:28:33.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.474+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd04c0cb110 con 0x7fd028068410 2024-04-26T23:28:33.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd043400640 1 -- 172.21.15.39:0/367765758 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd04c0cb110 con 0x7fd028068410 2024-04-26T23:28:33.481 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-04-26T23:28:33.482 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-04-26T23:28:33.482 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephfs" 2024-04-26T23:28:33.482 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-04-26T23:28:33.482 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 msgr2=0x7fd02806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 0x7fd02806a8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0b8ee0 tx=0x7fd034008040 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 msgr2=0x7fd04c13c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd03c01abe0 tx=0x7fd03c0192d0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 shutdown_connections 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd028068410 0x7fd02806a8d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd04c0d10d0 0x7fd04c14eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c0cf8c0 0x7fd04c14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 --2- 172.21.15.39:0/367765758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd04c06d4e0 0x7fd04c13c2c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 >> 172.21.15.39:0/367765758 conn(0x7fd04c0d3040 msgr2=0x7fd04c153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 shutdown_connections 2024-04-26T23:28:33.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.478+0000 7fd051600640 1 -- 172.21.15.39:0/367765758 wait complete. 2024-04-26T23:28:33.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:28:33.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 Processor -- start 2024-04-26T23:28:33.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 -- start start 2024-04-26T23:28:33.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f146c160820 0x7f146c0ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 0x7f146c0d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c0cf020 con 0x7f146c0d1e30 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f146c161d00 con 0x7f146c160820 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1473c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f146c0b5b70 con 0x7f146c0b5740 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f146c160820 0x7f146c0ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f146c160820 0x7f146c0ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55640/0 (socket says 172.21.15.39:55640) 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 -- 172.21.15.39:0/1966052769 learned_addr learned my addr 172.21.15.39:0/1966052769 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1463e00640 1 --2- 172.21.15.39:0/1966052769 >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 0x7f146c0d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 -- 172.21.15.39:0/1966052769 >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 msgr2=0x7f146c0d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 --2- 172.21.15.39:0/1966052769 >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 0x7f146c0d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 -- 172.21.15.39:0/1966052769 >> v1:172.21.15.71:6789/0 conn(0x7f146c0d1e30 legacy=0x7f146c160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1471200640 1 -- 172.21.15.39:0/1966052769 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c160c00 con 0x7f146c160820 2024-04-26T23:28:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.642+0000 7f1463e00640 1 --2- 172.21.15.39:0/1966052769 >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 0x7f146c0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:28:33.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1471200640 1 --2- 172.21.15.39:0/1966052769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c160820 0x7f146c0ce710 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f146c073b00 tx=0x7f145c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e3d4567d83fea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f146be00640 1 -- 172.21.15.39:0/1966052769 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0b0070 con 0x7f146c160820 2024-04-26T23:28:33.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f146be00640 1 -- 172.21.15.39:0/1966052769 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c0ab600 con 0x7f146c160820 2024-04-26T23:28:33.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f146be00640 1 -- 172.21.15.39:0/1966052769 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0ab9d0 con 0x7f146c160820 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 -- 172.21.15.39:0/1966052769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c160820 msgr2=0x7f146c0ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 --2- 172.21.15.39:0/1966052769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c160820 0x7f146c0ce710 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f146c073b00 tx=0x7f145c01c450 comp rx=0 tx=0).stop 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 -- 172.21.15.39:0/1966052769 shutdown_connections 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 --2- 172.21.15.39:0/1966052769 >> v2:172.21.15.71:3300/0 conn(0x7f146c0b5740 0x7f146c0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 --2- 172.21.15.39:0/1966052769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c160820 0x7f146c0ce710 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 -- 172.21.15.39:0/1966052769 >> 172.21.15.39:0/1966052769 conn(0x7f146c0b4c20 msgr2=0x7f146c0b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 -- 172.21.15.39:0/1966052769 shutdown_connections 2024-04-26T23:28:33.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.646+0000 7f1473c00640 1 -- 172.21.15.39:0/1966052769 wait complete. 2024-04-26T23:28:33.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 Processor -- start 2024-04-26T23:28:33.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- start start 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c0b5740 0x7f146c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 0x7f146c1663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0c7490 con 0x7f146c0d1e30 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0d13d0 con 0x7f146c0b5740 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f146c0c7610 con 0x7f146c160820 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55656/0 (socket says 172.21.15.39:55656) 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 -- 172.21.15.39:0/3138486343 learned_addr learned my addr 172.21.15.39:0/3138486343 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:33.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1471200640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c0b5740 0x7f146c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1471c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 0x7f146c1663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 -- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 msgr2=0x7f146c1663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 0x7f146c1663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 -- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c0b5740 msgr2=0x7f146c15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c0b5740 0x7f146c15c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 -- 172.21.15.39:0/3138486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c06ea70 con 0x7f146c0d1e30 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1471c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 0x7f146c1663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1463e00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f145400c7f0 tx=0x7f145400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454015070 con 0x7f146c0d1e30 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454007820 con 0x7f146c0d1e30 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c15f430 con 0x7f146c0d1e30 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454007c10 con 0x7f146c0d1e30 2024-04-26T23:28:33.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.650+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c15f9f0 con 0x7f146c0d1e30 2024-04-26T23:28:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.654+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146c06a720 con 0x7f146c0d1e30 2024-04-26T23:28:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.654+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f1454018070 con 0x7f146c0d1e30 2024-04-26T23:28:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.654+0000 7f1469600640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 0x7f144806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.654+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f1454086bb0 con 0x7f146c0d1e30 2024-04-26T23:28:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.654+0000 7f1471200640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 0x7f144806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.658+0000 7f1471200640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 0x7f144806a900 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f146c069e50 tx=0x7f145c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:33.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.658+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f14540569b0 con 0x7f146c0d1e30 2024-04-26T23:28:33.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.826+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f146c070f90 con 0x7f146c0d1e30 2024-04-26T23:28:33.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.826+0000 7f1469600640 1 -- 172.21.15.39:0/3138486343 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f145405acb0 con 0x7f146c0d1e30 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 msgr2=0x7f144806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 0x7f144806a900 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f146c069e50 tx=0x7f145c008040 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 msgr2=0x7f146c15ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f145400c7f0 tx=0x7f145400ccb0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 shutdown_connections 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1448068440 0x7f144806a900 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f146c160820 0x7f146c1663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f146c0d1e30 0x7f146c15ea50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 --2- 172.21.15.39:0/3138486343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c0b5740 0x7f146c15c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 >> 172.21.15.39:0/3138486343 conn(0x7f146c0b4c20 msgr2=0x7f146c14fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 shutdown_connections 2024-04-26T23:28:33.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.830+0000 7f1473c00640 1 -- 172.21.15.39:0/3138486343 wait complete. 2024-04-26T23:28:33.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol62860 --mode=777 2024-04-26T23:28:33.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 Processor -- start 2024-04-26T23:28:33.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 -- start start 2024-04-26T23:28:33.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a880b3df0 0x7f7a88074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7a881613d0 0x7f7a880b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:33.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a880b4280 con 0x7f7a881468a0 2024-04-26T23:28:33.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8806edd0 con 0x7f7a881613d0 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a8e200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7a88072620 con 0x7f7a880b3df0 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7a881613d0 0x7f7a880b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7a881468a0 0x7f7a88160cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35142/0 (socket says 172.21.15.39:35142) 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87400640 1 -- 172.21.15.39:0/3063394816 learned_addr learned my addr 172.21.15.39:0/3063394816 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a86a00640 1 --2- 172.21.15.39:0/3063394816 >> v2:172.21.15.71:3300/0 conn(0x7f7a880b3df0 0x7f7a88074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87e00640 1 -- 172.21.15.39:0/3063394816 >> v2:172.21.15.71:3300/0 conn(0x7f7a880b3df0 msgr2=0x7f7a88074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87e00640 1 --2- 172.21.15.39:0/3063394816 >> v2:172.21.15.71:3300/0 conn(0x7f7a880b3df0 0x7f7a88074180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87e00640 1 -- 172.21.15.39:0/3063394816 >> v1:172.21.15.39:6789/0 conn(0x7f7a881468a0 legacy=0x7f7a88160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.994+0000 7f7a87e00640 1 -- 172.21.15.39:0/3063394816 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8806f020 con 0x7f7a881613d0 2024-04-26T23:28:34.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a87e00640 1 --2- 172.21.15.39:0/3063394816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a881613d0 0x7f7a880b5970 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009d90 tx=0x7f7a8001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bee536b079542d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a86000640 1 -- 172.21.15.39:0/3063394816 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800a66e0 con 0x7f7a881613d0 2024-04-26T23:28:34.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a86000640 1 -- 172.21.15.39:0/3063394816 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800a6880 con 0x7f7a881613d0 2024-04-26T23:28:34.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a86000640 1 -- 172.21.15.39:0/3063394816 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800a6c50 con 0x7f7a881613d0 2024-04-26T23:28:34.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 -- 172.21.15.39:0/3063394816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a881613d0 msgr2=0x7f7a880b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3063394816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a881613d0 0x7f7a880b5970 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009d90 tx=0x7f7a8001c810 comp rx=0 tx=0).stop 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 -- 172.21.15.39:0/3063394816 shutdown_connections 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3063394816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a881613d0 0x7f7a880b5970 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3063394816 >> v2:172.21.15.71:3300/0 conn(0x7f7a880b3df0 0x7f7a88074180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 -- 172.21.15.39:0/3063394816 >> 172.21.15.39:0/3063394816 conn(0x7f7a880b2cc0 msgr2=0x7f7a880b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 -- 172.21.15.39:0/3063394816 shutdown_connections 2024-04-26T23:28:34.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:33.998+0000 7f7a8e200640 1 -- 172.21.15.39:0/3063394816 wait complete. 2024-04-26T23:28:34.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 Processor -- start 2024-04-26T23:28:34.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- start start 2024-04-26T23:28:34.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 0x7f7a8815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7a881613d0 0x7f7a881430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88073440 con 0x7f7a8813d850 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880732c0 con 0x7f7a881468a0 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880735c0 con 0x7f7a881613d0 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55672/0 (socket says 172.21.15.39:55672) 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 -- 172.21.15.39:0/3648155215 learned_addr learned my addr 172.21.15.39:0/3648155215 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a86a00640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7a881613d0 0x7f7a881430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87400640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 0x7f7a8815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 -- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7a881613d0 msgr2=0x7f7a881430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7a881613d0 0x7f7a881430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 -- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 msgr2=0x7f7a8815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 0x7f7a8815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 -- 172.21.15.39:0/3648155215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8813dd10 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87400640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 0x7f7a8815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a87e00640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001a440 tx=0x7f7a800195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800be070 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800b8630 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800b89e0 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8813dff0 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.002+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8813e5b0 con 0x7f7a8813d850 2024-04-26T23:28:34.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a88050740 con 0x7f7a8813d850 2024-04-26T23:28:34.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7a800c1070 con 0x7f7a8813d850 2024-04-26T23:28:34.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a7f400640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 0x7f7a6806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f7a801218b0 con 0x7f7a8813d850 2024-04-26T23:28:34.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a87400640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 0x7f7a6806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.006+0000 7f7a87400640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 0x7f7a6806a900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a8806e6d0 tx=0x7f7a78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.010+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a800c8070 con 0x7f7a8813d850 2024-04-26T23:28:34.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.206+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol62860", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f7a8806ffa0 con 0x7f7a68068440 2024-04-26T23:28:34.217 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:34.211+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:34.217 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:34.211+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:34.217 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:34.211+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:34.217 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:34.211+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:34.217 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-04-26T23:28:34.211+0000 7f8d31200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:28:34.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a7f400640 1 -- 172.21.15.39:0/3648155215 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7a8806ffa0 con 0x7f7a68068440 2024-04-26T23:28:34.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 msgr2=0x7f7a6806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 0x7f7a6806a900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a8806e6d0 tx=0x7f7a78009040 comp rx=0 tx=0).stop 2024-04-26T23:28:34.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 msgr2=0x7f7a880b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001a440 tx=0x7f7a800195b0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 shutdown_connections 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f7a68068440 0x7f7a6806a900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a8813d850 0x7f7a880b6170 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7a881613d0 0x7f7a881430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 --2- 172.21.15.39:0/3648155215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a881468a0 0x7f7a8815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 >> 172.21.15.39:0/3648155215 conn(0x7f7a880b2cc0 msgr2=0x7f7a880ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 shutdown_connections 2024-04-26T23:28:34.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.366+0000 7f7a8e200640 1 -- 172.21.15.39:0/3648155215 wait complete. 2024-04-26T23:28:34.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol62860 2024-04-26T23:28:34.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 Processor -- start 2024-04-26T23:28:34.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 -- start start 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f21b4073400 0x7f21b4072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b4072180 con 0x7f21b41458d0 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b40739a0 con 0x7f21b4072e50 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b9e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f21b4073c80 con 0x7f21b4073400 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21abe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f21b4073400 0x7f21b4072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b2a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f21b41458d0 0x7f21b40b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35148/0 (socket says 172.21.15.39:35148) 2024-04-26T23:28:34.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.530+0000 7f21b2a00640 1 -- 172.21.15.39:0/967745815 learned_addr learned my addr 172.21.15.39:0/967745815 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:28:34.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21abe00640 1 -- 172.21.15.39:0/967745815 >> v1:172.21.15.71:6789/0 conn(0x7f21b4072e50 legacy=0x7f21b40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21abe00640 1 -- 172.21.15.39:0/967745815 >> v1:172.21.15.39:6789/0 conn(0x7f21b41458d0 legacy=0x7f21b40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21abe00640 1 -- 172.21.15.39:0/967745815 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b4145cb0 con 0x7f21b4073400 2024-04-26T23:28:34.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21abe00640 1 --2- 172.21.15.39:0/967745815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b4072910 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097f0 tx=0x7f219c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3f8fc39af357e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b2000640 1 -- 172.21.15.39:0/967745815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b0070 con 0x7f21b4073400 2024-04-26T23:28:34.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b2000640 1 -- 172.21.15.39:0/967745815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0ab600 con 0x7f21b4073400 2024-04-26T23:28:34.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b2000640 1 -- 172.21.15.39:0/967745815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0ab9d0 con 0x7f21b4073400 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b9e00640 1 -- 172.21.15.39:0/967745815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 msgr2=0x7f21b4072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b9e00640 1 --2- 172.21.15.39:0/967745815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b4072910 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097f0 tx=0x7f219c01c410 comp rx=0 tx=0).stop 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b9e00640 1 -- 172.21.15.39:0/967745815 shutdown_connections 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b9e00640 1 --2- 172.21.15.39:0/967745815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b4072910 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.534+0000 7f21b9e00640 1 -- 172.21.15.39:0/967745815 >> 172.21.15.39:0/967745815 conn(0x7f21b406c7d0 msgr2=0x7f21b406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- 172.21.15.39:0/967745815 shutdown_connections 2024-04-26T23:28:34.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- 172.21.15.39:0/967745815 wait complete. 2024-04-26T23:28:34.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 Processor -- start 2024-04-26T23:28:34.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- start start 2024-04-26T23:28:34.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 0x7f21b4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 0x7f21b4144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40cef00 con 0x7f21b4073400 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4073260 con 0x7f21b4072e50 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f21b416a160 con 0x7f21b41458d0 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55676/0 (socket says 172.21.15.39:55676) 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 -- 172.21.15.39:0/1171499842 learned_addr learned my addr 172.21.15.39:0/1171499842 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b2a00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 0x7f21b4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b3400640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 0x7f21b4144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 -- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 msgr2=0x7f21b4144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 0x7f21b4144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 -- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 msgr2=0x7f21b4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 0x7f21b4159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 -- 172.21.15.39:0/1171499842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b40aec50 con 0x7f21b4073400 2024-04-26T23:28:34.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b3400640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 0x7f21b4144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b2a00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 0x7f21b4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21abe00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f219c0ae040 tx=0x7f219c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b8020 con 0x7f21b4073400 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0b4630 con 0x7f21b4073400 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b0040 con 0x7f21b4073400 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.538+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b40aef30 con 0x7f21b4073400 2024-04-26T23:28:34.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b40af4f0 con 0x7f21b4073400 2024-04-26T23:28:34.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b406a720 con 0x7f21b4073400 2024-04-26T23:28:34.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f219c0bb020 con 0x7f21b4073400 2024-04-26T23:28:34.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21ab400640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 0x7f219006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:28:34.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f219c1207c0 con 0x7f21b4073400 2024-04-26T23:28:34.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21b2a00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 0x7f219006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:28:34.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.542+0000 7f21b2a00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 0x7f219006a8d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21a4005890 tx=0x7f21a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:28:34.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.546+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f219c0c2030 con 0x7f21b4073400 2024-04-26T23:28:34.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.738+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol62860", "target": ["mon-mgr", ""]}) -- 0x7f21b40b50b0 con 0x7f2190068410 2024-04-26T23:28:34.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.742+0000 7f21ab400640 1 -- 172.21.15.39:0/1171499842 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f21b40b50b0 con 0x7f2190068410 2024-04-26T23:28:34.746 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e 2024-04-26T23:28:34.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.742+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 msgr2=0x7f219006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.742+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 0x7f219006a8d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21a4005890 tx=0x7f21a4009040 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.742+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 msgr2=0x7f21b40ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.742+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f219c0ae040 tx=0x7f219c0191b0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 shutdown_connections 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2190068410 0x7f219006a8d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21b41458d0 0x7f21b4144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b4073400 0x7f21b40ae3a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 --2- 172.21.15.39:0/1171499842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b4072e50 0x7f21b4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 >> 172.21.15.39:0/1171499842 conn(0x7f21b406c7d0 msgr2=0x7f21b406e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 shutdown_connections 2024-04-26T23:28:34.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:28:34.746+0000 7f21b9e00640 1 -- 172.21.15.39:0/1171499842 wait complete. 2024-04-26T23:28:34.768 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol62860 with 3000 files each 0MB size under directory volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e 2024-04-26T23:28:34.768 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:34.768 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:34.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:34.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140317 s, 0.0 kB/s 2024-04-26T23:28:34.842 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:34.842 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:34.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:34.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125781 s, 0.0 kB/s 2024-04-26T23:28:34.946 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:34.946 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:34.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:34.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.053 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125158 s, 0.0 kB/s 2024-04-26T23:28:35.053 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132496 s, 0.0 kB/s 2024-04-26T23:28:35.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125175 s, 0.0 kB/s 2024-04-26T23:28:35.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127012 s, 0.0 kB/s 2024-04-26T23:28:35.375 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.375 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.425 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127299 s, 0.0 kB/s 2024-04-26T23:28:35.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132228 s, 0.0 kB/s 2024-04-26T23:28:35.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125455 s, 0.0 kB/s 2024-04-26T23:28:35.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.694 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133287 s, 0.0 kB/s 2024-04-26T23:28:35.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:35.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:35.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:35.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126136 s, 0.0 kB/s 2024-04-26T23:28:35.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:35.910 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:35.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:35.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.017 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133501 s, 0.0 kB/s 2024-04-26T23:28:36.018 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.018 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.073 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.126 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000164097 s, 0.0 kB/s 2024-04-26T23:28:36.127 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133128 s, 0.0 kB/s 2024-04-26T23:28:36.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134315 s, 0.0 kB/s 2024-04-26T23:28:36.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.393 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.451 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.451 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.451 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137178 s, 0.0 kB/s 2024-04-26T23:28:36.451 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.451 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133718 s, 0.0 kB/s 2024-04-26T23:28:36.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130181 s, 0.0 kB/s 2024-04-26T23:28:36.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.712 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133496 s, 0.0 kB/s 2024-04-26T23:28:36.766 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.766 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.816 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131791 s, 0.0 kB/s 2024-04-26T23:28:36.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:36.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:36.920 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134897 s, 0.0 kB/s 2024-04-26T23:28:36.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:36.975 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.025 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.078 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.078 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133305 s, 0.0 kB/s 2024-04-26T23:28:37.079 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.079 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139825 s, 0.0 kB/s 2024-04-26T23:28:37.187 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.187 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.290 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146808 s, 0.0 kB/s 2024-04-26T23:28:37.291 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.291 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.341 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.394 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.394 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.394 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147125 s, 0.0 kB/s 2024-04-26T23:28:37.398 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.398 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.453 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152209 s, 0.0 kB/s 2024-04-26T23:28:37.507 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.507 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.557 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.610 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.610 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.610 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141559 s, 0.0 kB/s 2024-04-26T23:28:37.611 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.611 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142258 s, 0.0 kB/s 2024-04-26T23:28:37.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142537 s, 0.0 kB/s 2024-04-26T23:28:37.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.878 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140048 s, 0.0 kB/s 2024-04-26T23:28:37.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:37.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:37.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:37.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142281 s, 0.0 kB/s 2024-04-26T23:28:38.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.038 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.089 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.147 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.147 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150424 s, 0.0 kB/s 2024-04-26T23:28:38.147 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.148 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.249 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139236 s, 0.0 kB/s 2024-04-26T23:28:38.250 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.250 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.301 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148905 s, 0.0 kB/s 2024-04-26T23:28:38.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145101 s, 0.0 kB/s 2024-04-26T23:28:38.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.562 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146506 s, 0.0 kB/s 2024-04-26T23:28:38.563 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.564 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:28:38.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:28:38.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.670 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148938 s, 0.0 kB/s 2024-04-26T23:28:38.671 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.671 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.757 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147295 s, 0.0 kB/s 2024-04-26T23:28:38.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:38.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:38.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:38.913 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149523 s, 0.0 kB/s 2024-04-26T23:28:38.914 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:38.914 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:38.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:38.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146675 s, 0.0 kB/s 2024-04-26T23:28:39.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.069 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013724 s, 0.0 kB/s 2024-04-26T23:28:39.122 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.123 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.173 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138087 s, 0.0 kB/s 2024-04-26T23:28:39.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146832 s, 0.0 kB/s 2024-04-26T23:28:39.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.393 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.449 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142612 s, 0.0 kB/s 2024-04-26T23:28:39.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.558 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014184 s, 0.0 kB/s 2024-04-26T23:28:39.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146557 s, 0.0 kB/s 2024-04-26T23:28:39.663 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153114 s, 0.0 kB/s 2024-04-26T23:28:39.770 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135379 s, 0.0 kB/s 2024-04-26T23:28:39.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:39.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:39.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135844 s, 0.0 kB/s 2024-04-26T23:28:39.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:39.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013886 s, 0.0 kB/s 2024-04-26T23:28:40.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.189 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134228 s, 0.0 kB/s 2024-04-26T23:28:40.190 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.190 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.293 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129847 s, 0.0 kB/s 2024-04-26T23:28:40.294 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.294 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.344 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129839 s, 0.0 kB/s 2024-04-26T23:28:40.398 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.453 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.505 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134835 s, 0.0 kB/s 2024-04-26T23:28:40.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.506 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.556 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132596 s, 0.0 kB/s 2024-04-26T23:28:40.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.661 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136771 s, 0.0 kB/s 2024-04-26T23:28:40.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.765 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.817 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129411 s, 0.0 kB/s 2024-04-26T23:28:40.818 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.818 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:40.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:40.922 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:40.922 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135022 s, 0.0 kB/s 2024-04-26T23:28:40.923 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:40.923 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:40.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:40.978 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133128 s, 0.0 kB/s 2024-04-26T23:28:41.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.086 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137591 s, 0.0 kB/s 2024-04-26T23:28:41.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.246 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139168 s, 0.0 kB/s 2024-04-26T23:28:41.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.247 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.298 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.350 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148368 s, 0.0 kB/s 2024-04-26T23:28:41.351 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.351 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145924 s, 0.0 kB/s 2024-04-26T23:28:41.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144281 s, 0.0 kB/s 2024-04-26T23:28:41.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137101 s, 0.0 kB/s 2024-04-26T23:28:41.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.662 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014508 s, 0.0 kB/s 2024-04-26T23:28:41.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135449 s, 0.0 kB/s 2024-04-26T23:28:41.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:41.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:41.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:41.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:41.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:41.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126466 s, 0.0 kB/s 2024-04-26T23:28:41.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:41.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.085 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127511 s, 0.0 kB/s 2024-04-26T23:28:42.086 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.086 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.141 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.193 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132208 s, 0.0 kB/s 2024-04-26T23:28:42.194 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.194 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.245 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135636 s, 0.0 kB/s 2024-04-26T23:28:42.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.350 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127947 s, 0.0 kB/s 2024-04-26T23:28:42.403 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.403 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.456 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.513 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134045 s, 0.0 kB/s 2024-04-26T23:28:42.514 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.514 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.569 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013522 s, 0.0 kB/s 2024-04-26T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.673 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.726 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142537 s, 0.0 kB/s 2024-04-26T23:28:42.727 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.727 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012698 s, 0.0 kB/s 2024-04-26T23:28:42.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.880 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:42.935 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:42.935 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:42.935 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132579 s, 0.0 kB/s 2024-04-26T23:28:42.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:42.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:42.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:42.984 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130729 s, 0.0 kB/s 2024-04-26T23:28:43.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.038 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.089 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140203 s, 0.0 kB/s 2024-04-26T23:28:43.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.194 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133788 s, 0.0 kB/s 2024-04-26T23:28:43.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.247 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129281 s, 0.0 kB/s 2024-04-26T23:28:43.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128754 s, 0.0 kB/s 2024-04-26T23:28:43.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137386 s, 0.0 kB/s 2024-04-26T23:28:43.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.570 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.620 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131966 s, 0.0 kB/s 2024-04-26T23:28:43.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.674 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.725 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.777 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013551 s, 0.0 kB/s 2024-04-26T23:28:43.778 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.778 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.829 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.881 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.881 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.881 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012905 s, 0.0 kB/s 2024-04-26T23:28:43.882 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.882 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:43.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:43.984 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:43.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:43.985 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128459 s, 0.0 kB/s 2024-04-26T23:28:43.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:43.986 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.037 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.089 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132591 s, 0.0 kB/s 2024-04-26T23:28:44.090 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.090 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.141 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129623 s, 0.0 kB/s 2024-04-26T23:28:44.195 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.195 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.244 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126667 s, 0.0 kB/s 2024-04-26T23:28:44.299 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.299 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.402 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126912 s, 0.0 kB/s 2024-04-26T23:28:44.403 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.403 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.453 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129406 s, 0.0 kB/s 2024-04-26T23:28:44.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.507 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.556 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.610 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.610 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013024 s, 0.0 kB/s 2024-04-26T23:28:44.611 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.611 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.722 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132983 s, 0.0 kB/s 2024-04-26T23:28:44.723 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.723 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136924 s, 0.0 kB/s 2024-04-26T23:28:44.835 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:44.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:44.889 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:44.947 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:44.947 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:44.947 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145176 s, 0.0 kB/s 2024-04-26T23:28:44.948 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:44.948 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.058 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148792 s, 0.0 kB/s 2024-04-26T23:28:45.059 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.162 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.162 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.162 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014169 s, 0.0 kB/s 2024-04-26T23:28:45.163 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.163 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.271 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154281 s, 0.0 kB/s 2024-04-26T23:28:45.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.272 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.321 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.374 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145909 s, 0.0 kB/s 2024-04-26T23:28:45.386 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.386 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138898 s, 0.0 kB/s 2024-04-26T23:28:45.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144438 s, 0.0 kB/s 2024-04-26T23:28:45.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.698 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014773 s, 0.0 kB/s 2024-04-26T23:28:45.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.699 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.806 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146795 s, 0.0 kB/s 2024-04-26T23:28:45.807 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.807 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.858 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146127 s, 0.0 kB/s 2024-04-26T23:28:45.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:45.910 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:45.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:45.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142649 s, 0.0 kB/s 2024-04-26T23:28:46.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.074 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147666 s, 0.0 kB/s 2024-04-26T23:28:46.131 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.131 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.242 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143312 s, 0.0 kB/s 2024-04-26T23:28:46.244 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.244 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140172 s, 0.0 kB/s 2024-04-26T23:28:46.350 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.350 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138508 s, 0.0 kB/s 2024-04-26T23:28:46.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.456 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.506 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001353 s, 0.0 kB/s 2024-04-26T23:28:46.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.662 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135928 s, 0.0 kB/s 2024-04-26T23:28:46.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144557 s, 0.0 kB/s 2024-04-26T23:28:46.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.822 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143304 s, 0.0 kB/s 2024-04-26T23:28:46.875 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.875 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:46.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:46.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:46.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:46.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:46.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142403 s, 0.0 kB/s 2024-04-26T23:28:46.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:46.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.034 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145 s, 0.0 kB/s 2024-04-26T23:28:47.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.139 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.190 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.190 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141402 s, 0.0 kB/s 2024-04-26T23:28:47.191 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.191 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.241 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.294 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144317 s, 0.0 kB/s 2024-04-26T23:28:47.295 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.295 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.350 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.402 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144886 s, 0.0 kB/s 2024-04-26T23:28:47.403 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.403 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.453 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.510 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142845 s, 0.0 kB/s 2024-04-26T23:28:47.511 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.511 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.565 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.622 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145529 s, 0.0 kB/s 2024-04-26T23:28:47.623 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.623 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145138 s, 0.0 kB/s 2024-04-26T23:28:47.735 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.735 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.790 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.843 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.844 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.844 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143889 s, 0.0 kB/s 2024-04-26T23:28:47.845 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.845 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:47.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:47.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014627 s, 0.0 kB/s 2024-04-26T23:28:47.951 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:47.951 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144526 s, 0.0 kB/s 2024-04-26T23:28:48.060 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.060 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.118 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142959 s, 0.0 kB/s 2024-04-26T23:28:48.175 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.176 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.226 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148666 s, 0.0 kB/s 2024-04-26T23:28:48.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144187 s, 0.0 kB/s 2024-04-26T23:28:48.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.441 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.498 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148372 s, 0.0 kB/s 2024-04-26T23:28:48.499 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.606 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.606 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014614 s, 0.0 kB/s 2024-04-26T23:28:48.607 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.607 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.659 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147518 s, 0.0 kB/s 2024-04-26T23:28:48.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142694 s, 0.0 kB/s 2024-04-26T23:28:48.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.874 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:48.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:48.926 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:48.926 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146285 s, 0.0 kB/s 2024-04-26T23:28:48.927 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:48.927 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:48.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:48.981 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014464 s, 0.0 kB/s 2024-04-26T23:28:49.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014497 s, 0.0 kB/s 2024-04-26T23:28:49.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.194 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.246 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146229 s, 0.0 kB/s 2024-04-26T23:28:49.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.248 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.350 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143779 s, 0.0 kB/s 2024-04-26T23:28:49.351 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.351 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145373 s, 0.0 kB/s 2024-04-26T23:28:49.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156854 s, 0.0 kB/s 2024-04-26T23:28:49.567 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.567 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001482 s, 0.0 kB/s 2024-04-26T23:28:49.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.675 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.726 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.783 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.783 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.783 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152758 s, 0.0 kB/s 2024-04-26T23:28:49.784 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.784 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.838 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:49.891 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147078 s, 0.0 kB/s 2024-04-26T23:28:49.892 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:49.892 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:49.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:49.945 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.001 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.001 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145039 s, 0.0 kB/s 2024-04-26T23:28:50.002 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.003 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.054 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.105 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130079 s, 0.0 kB/s 2024-04-26T23:28:50.106 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.106 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.157 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125646 s, 0.0 kB/s 2024-04-26T23:28:50.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.260 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127828 s, 0.0 kB/s 2024-04-26T23:28:50.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126791 s, 0.0 kB/s 2024-04-26T23:28:50.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128499 s, 0.0 kB/s 2024-04-26T23:28:50.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123604 s, 0.0 kB/s 2024-04-26T23:28:50.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.740 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125905 s, 0.0 kB/s 2024-04-26T23:28:50.741 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.741 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124711 s, 0.0 kB/s 2024-04-26T23:28:50.849 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:50.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:50.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123744 s, 0.0 kB/s 2024-04-26T23:28:50.953 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:50.953 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130286 s, 0.0 kB/s 2024-04-26T23:28:51.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.111 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122757 s, 0.0 kB/s 2024-04-26T23:28:51.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124162 s, 0.0 kB/s 2024-04-26T23:28:51.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121131 s, 0.0 kB/s 2024-04-26T23:28:51.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.425 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121035 s, 0.0 kB/s 2024-04-26T23:28:51.478 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.529 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012119 s, 0.0 kB/s 2024-04-26T23:28:51.581 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.581 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.633 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125191 s, 0.0 kB/s 2024-04-26T23:28:51.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.742 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128334 s, 0.0 kB/s 2024-04-26T23:28:51.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:51.900 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:51.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:51.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119531 s, 0.0 kB/s 2024-04-26T23:28:51.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:51.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:51.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:51.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000117416 s, 0.0 kB/s 2024-04-26T23:28:52.009 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.009 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.064 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.117 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.117 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012426 s, 0.0 kB/s 2024-04-26T23:28:52.118 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.118 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.224 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.224 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.224 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121586 s, 0.0 kB/s 2024-04-26T23:28:52.226 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.226 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.276 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121854 s, 0.0 kB/s 2024-04-26T23:28:52.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.333 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.384 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.442 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124914 s, 0.0 kB/s 2024-04-26T23:28:52.442 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.443 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128472 s, 0.0 kB/s 2024-04-26T23:28:52.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.604 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.660 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119754 s, 0.0 kB/s 2024-04-26T23:28:52.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.662 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.767 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.767 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121268 s, 0.0 kB/s 2024-04-26T23:28:52.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.816 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121006 s, 0.0 kB/s 2024-04-26T23:28:52.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:52.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:52.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:52.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:52.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:52.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125632 s, 0.0 kB/s 2024-04-26T23:28:52.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:52.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.032 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.085 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128587 s, 0.0 kB/s 2024-04-26T23:28:53.086 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.086 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.136 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.190 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133671 s, 0.0 kB/s 2024-04-26T23:28:53.190 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.191 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.244 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125587 s, 0.0 kB/s 2024-04-26T23:28:53.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.352 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124462 s, 0.0 kB/s 2024-04-26T23:28:53.410 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.410 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.460 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.512 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.513 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123625 s, 0.0 kB/s 2024-04-26T23:28:53.514 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.514 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.565 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.617 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145399 s, 0.0 kB/s 2024-04-26T23:28:53.618 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.618 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.668 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.721 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012233 s, 0.0 kB/s 2024-04-26T23:28:53.722 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.722 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.825 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013267 s, 0.0 kB/s 2024-04-26T23:28:53.826 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.826 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:53.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:53.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:53.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125006 s, 0.0 kB/s 2024-04-26T23:28:53.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:53.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:53.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:53.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.032 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.033 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126347 s, 0.0 kB/s 2024-04-26T23:28:54.034 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.034 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126415 s, 0.0 kB/s 2024-04-26T23:28:54.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012743 s, 0.0 kB/s 2024-04-26T23:28:54.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.348 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.348 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.348 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012573 s, 0.0 kB/s 2024-04-26T23:28:54.349 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.350 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.453 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138598 s, 0.0 kB/s 2024-04-26T23:28:54.453 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.454 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.504 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124414 s, 0.0 kB/s 2024-04-26T23:28:54.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.669 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122641 s, 0.0 kB/s 2024-04-26T23:28:54.670 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.670 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.724 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.781 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.781 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.781 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012745 s, 0.0 kB/s 2024-04-26T23:28:54.782 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.782 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.833 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124359 s, 0.0 kB/s 2024-04-26T23:28:54.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:54.936 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:54.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:54.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:54.989 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128867 s, 0.0 kB/s 2024-04-26T23:28:54.990 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:54.990 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125295 s, 0.0 kB/s 2024-04-26T23:28:55.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.144 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.197 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124036 s, 0.0 kB/s 2024-04-26T23:28:55.202 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.202 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125961 s, 0.0 kB/s 2024-04-26T23:28:55.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.413 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122074 s, 0.0 kB/s 2024-04-26T23:28:55.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.414 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.468 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124348 s, 0.0 kB/s 2024-04-26T23:28:55.522 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.522 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001298 s, 0.0 kB/s 2024-04-26T23:28:55.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125748 s, 0.0 kB/s 2024-04-26T23:28:55.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.730 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.839 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133158 s, 0.0 kB/s 2024-04-26T23:28:55.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.888 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121272 s, 0.0 kB/s 2024-04-26T23:28:55.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:55.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:55.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:55.992 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127489 s, 0.0 kB/s 2024-04-26T23:28:56.047 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.047 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.101 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.156 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.156 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.156 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000118261 s, 0.0 kB/s 2024-04-26T23:28:56.157 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.157 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.208 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.261 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121826 s, 0.0 kB/s 2024-04-26T23:28:56.262 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.262 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119059 s, 0.0 kB/s 2024-04-26T23:28:56.366 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.366 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.416 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.469 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000118953 s, 0.0 kB/s 2024-04-26T23:28:56.470 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.470 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120039 s, 0.0 kB/s 2024-04-26T23:28:56.573 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.624 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.677 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.677 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146814 s, 0.0 kB/s 2024-04-26T23:28:56.678 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.678 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.728 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.784 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119008 s, 0.0 kB/s 2024-04-26T23:28:56.785 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.785 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.836 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.888 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122863 s, 0.0 kB/s 2024-04-26T23:28:56.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:56.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:56.940 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:56.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:56.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:56.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128244 s, 0.0 kB/s 2024-04-26T23:28:56.998 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:56.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129576 s, 0.0 kB/s 2024-04-26T23:28:57.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.152 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127054 s, 0.0 kB/s 2024-04-26T23:28:57.206 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.206 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124922 s, 0.0 kB/s 2024-04-26T23:28:57.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.412 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.413 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125643 s, 0.0 kB/s 2024-04-26T23:28:57.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.414 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128274 s, 0.0 kB/s 2024-04-26T23:28:57.517 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.568 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128881 s, 0.0 kB/s 2024-04-26T23:28:57.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.672 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127825 s, 0.0 kB/s 2024-04-26T23:28:57.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.833 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.833 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.833 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136575 s, 0.0 kB/s 2024-04-26T23:28:57.834 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.834 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.890 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:57.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:57.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:57.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125126 s, 0.0 kB/s 2024-04-26T23:28:57.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:57.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:57.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:57.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.053 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130319 s, 0.0 kB/s 2024-04-26T23:28:58.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126701 s, 0.0 kB/s 2024-04-26T23:28:58.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125022 s, 0.0 kB/s 2024-04-26T23:28:58.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128008 s, 0.0 kB/s 2024-04-26T23:28:58.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.421 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.473 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128673 s, 0.0 kB/s 2024-04-26T23:28:58.474 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.474 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.524 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.577 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123032 s, 0.0 kB/s 2024-04-26T23:28:58.577 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.578 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.680 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128446 s, 0.0 kB/s 2024-04-26T23:28:58.682 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.682 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.737 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128888 s, 0.0 kB/s 2024-04-26T23:28:58.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137823 s, 0.0 kB/s 2024-04-26T23:28:58.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:58.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:58.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:58.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143489 s, 0.0 kB/s 2024-04-26T23:28:59.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.065 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147403 s, 0.0 kB/s 2024-04-26T23:28:59.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141468 s, 0.0 kB/s 2024-04-26T23:28:59.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142418 s, 0.0 kB/s 2024-04-26T23:28:59.327 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.327 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.377 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.430 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150976 s, 0.0 kB/s 2024-04-26T23:28:59.431 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.431 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149197 s, 0.0 kB/s 2024-04-26T23:28:59.539 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.539 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.589 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143191 s, 0.0 kB/s 2024-04-26T23:28:59.643 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.643 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144603 s, 0.0 kB/s 2024-04-26T23:28:59.755 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.755 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.809 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.862 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.863 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.863 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141298 s, 0.0 kB/s 2024-04-26T23:28:59.864 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.864 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:28:59.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:28:59.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:28:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:28:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:28:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138544 s, 0.0 kB/s 2024-04-26T23:28:59.971 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:28:59.971 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.075 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.075 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.075 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137697 s, 0.0 kB/s 2024-04-26T23:29:00.076 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.076 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.135 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.186 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.186 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.186 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144773 s, 0.0 kB/s 2024-04-26T23:29:00.187 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.187 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.290 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150717 s, 0.0 kB/s 2024-04-26T23:29:00.291 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.292 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.345 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.398 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.398 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.398 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146261 s, 0.0 kB/s 2024-04-26T23:29:00.399 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.450 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146254 s, 0.0 kB/s 2024-04-26T23:29:00.503 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.503 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.611 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.611 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.611 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154692 s, 0.0 kB/s 2024-04-26T23:29:00.612 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.612 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147862 s, 0.0 kB/s 2024-04-26T23:29:00.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.770 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145178 s, 0.0 kB/s 2024-04-26T23:29:00.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.877 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:00.931 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:00.931 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:00.931 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144838 s, 0.0 kB/s 2024-04-26T23:29:00.932 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:00.932 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:00.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:00.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.038 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148118 s, 0.0 kB/s 2024-04-26T23:29:01.039 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.039 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.089 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139931 s, 0.0 kB/s 2024-04-26T23:29:01.147 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.147 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.254 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014033 s, 0.0 kB/s 2024-04-26T23:29:01.256 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.256 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.305 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147686 s, 0.0 kB/s 2024-04-26T23:29:01.359 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.359 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.409 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.462 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.462 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.462 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015136 s, 0.0 kB/s 2024-04-26T23:29:01.463 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.464 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.517 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.570 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138379 s, 0.0 kB/s 2024-04-26T23:29:01.571 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.571 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.674 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.674 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.674 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135803 s, 0.0 kB/s 2024-04-26T23:29:01.676 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.676 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.729 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148596 s, 0.0 kB/s 2024-04-26T23:29:01.784 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.784 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.837 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.890 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.890 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.890 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143621 s, 0.0 kB/s 2024-04-26T23:29:01.892 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.892 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:01.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:01.941 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:01.995 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:01.995 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:01.995 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139627 s, 0.0 kB/s 2024-04-26T23:29:01.997 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:01.997 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142897 s, 0.0 kB/s 2024-04-26T23:29:02.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140483 s, 0.0 kB/s 2024-04-26T23:29:02.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015145 s, 0.0 kB/s 2024-04-26T23:29:02.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147616 s, 0.0 kB/s 2024-04-26T23:29:02.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.518 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014408 s, 0.0 kB/s 2024-04-26T23:29:02.519 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.520 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.569 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.623 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.623 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145001 s, 0.0 kB/s 2024-04-26T23:29:02.624 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.624 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145811 s, 0.0 kB/s 2024-04-26T23:29:02.735 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.735 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.843 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000165574 s, 0.0 kB/s 2024-04-26T23:29:02.844 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.844 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:02.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:02.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:02.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:02.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:02.950 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147671 s, 0.0 kB/s 2024-04-26T23:29:02.951 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:02.952 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.059 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.059 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000160748 s, 0.0 kB/s 2024-04-26T23:29:03.060 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.060 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.114 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014138 s, 0.0 kB/s 2024-04-26T23:29:03.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131044 s, 0.0 kB/s 2024-04-26T23:29:03.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139466 s, 0.0 kB/s 2024-04-26T23:29:03.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143407 s, 0.0 kB/s 2024-04-26T23:29:03.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138117 s, 0.0 kB/s 2024-04-26T23:29:03.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014213 s, 0.0 kB/s 2024-04-26T23:29:03.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.747 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.802 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148893 s, 0.0 kB/s 2024-04-26T23:29:03.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146632 s, 0.0 kB/s 2024-04-26T23:29:03.911 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:03.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:03.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:03.961 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145791 s, 0.0 kB/s 2024-04-26T23:29:04.015 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.015 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.065 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013841 s, 0.0 kB/s 2024-04-26T23:29:04.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.226 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147608 s, 0.0 kB/s 2024-04-26T23:29:04.227 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.227 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.278 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.330 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144406 s, 0.0 kB/s 2024-04-26T23:29:04.331 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.331 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.382 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.434 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144499 s, 0.0 kB/s 2024-04-26T23:29:04.435 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.435 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.486 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.538 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.538 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.538 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148142 s, 0.0 kB/s 2024-04-26T23:29:04.539 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.539 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.590 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146848 s, 0.0 kB/s 2024-04-26T23:29:04.643 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.643 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.693 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.746 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137788 s, 0.0 kB/s 2024-04-26T23:29:04.747 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.747 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.797 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149594 s, 0.0 kB/s 2024-04-26T23:29:04.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:04.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:04.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:04.967 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:04.967 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:04.967 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148331 s, 0.0 kB/s 2024-04-26T23:29:04.967 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:04.967 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.017 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145619 s, 0.0 kB/s 2024-04-26T23:29:05.071 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.121 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149505 s, 0.0 kB/s 2024-04-26T23:29:05.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140799 s, 0.0 kB/s 2024-04-26T23:29:05.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144489 s, 0.0 kB/s 2024-04-26T23:29:05.386 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.490 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146745 s, 0.0 kB/s 2024-04-26T23:29:05.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.492 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148305 s, 0.0 kB/s 2024-04-26T23:29:05.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.650 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144873 s, 0.0 kB/s 2024-04-26T23:29:05.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.758 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151486 s, 0.0 kB/s 2024-04-26T23:29:05.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.863 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143372 s, 0.0 kB/s 2024-04-26T23:29:05.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:05.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:05.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:05.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148751 s, 0.0 kB/s 2024-04-26T23:29:06.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.070 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014752 s, 0.0 kB/s 2024-04-26T23:29:06.124 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.124 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.173 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.227 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.227 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152954 s, 0.0 kB/s 2024-04-26T23:29:06.228 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.228 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.282 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139206 s, 0.0 kB/s 2024-04-26T23:29:06.335 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.335 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136743 s, 0.0 kB/s 2024-04-26T23:29:06.439 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135018 s, 0.0 kB/s 2024-04-26T23:29:06.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.593 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133592 s, 0.0 kB/s 2024-04-26T23:29:06.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.646 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129884 s, 0.0 kB/s 2024-04-26T23:29:06.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136004 s, 0.0 kB/s 2024-04-26T23:29:06.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:06.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:06.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:06.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:06.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:06.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013245 s, 0.0 kB/s 2024-04-26T23:29:06.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:06.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138923 s, 0.0 kB/s 2024-04-26T23:29:07.064 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.064 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.114 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144751 s, 0.0 kB/s 2024-04-26T23:29:07.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.222 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.275 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152547 s, 0.0 kB/s 2024-04-26T23:29:07.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145448 s, 0.0 kB/s 2024-04-26T23:29:07.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147097 s, 0.0 kB/s 2024-04-26T23:29:07.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143606 s, 0.0 kB/s 2024-04-26T23:29:07.591 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145431 s, 0.0 kB/s 2024-04-26T23:29:07.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150036 s, 0.0 kB/s 2024-04-26T23:29:07.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.800 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.849 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:07.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:07.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:07.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149138 s, 0.0 kB/s 2024-04-26T23:29:07.904 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:07.904 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:07.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:07.953 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141157 s, 0.0 kB/s 2024-04-26T23:29:08.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146158 s, 0.0 kB/s 2024-04-26T23:29:08.118 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.118 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151003 s, 0.0 kB/s 2024-04-26T23:29:08.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146512 s, 0.0 kB/s 2024-04-26T23:29:08.332 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.332 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000230446 s, 0.0 kB/s 2024-04-26T23:29:08.439 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147702 s, 0.0 kB/s 2024-04-26T23:29:08.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.593 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149 s, 0.0 kB/s 2024-04-26T23:29:08.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:29:08.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:29:08.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143177 s, 0.0 kB/s 2024-04-26T23:29:08.751 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.857 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142301 s, 0.0 kB/s 2024-04-26T23:29:08.858 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.859 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:08.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:08.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:08.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:08.963 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:08.963 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144224 s, 0.0 kB/s 2024-04-26T23:29:08.964 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:08.964 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.017 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141034 s, 0.0 kB/s 2024-04-26T23:29:09.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.125 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.179 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.179 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.179 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137286 s, 0.0 kB/s 2024-04-26T23:29:09.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014014 s, 0.0 kB/s 2024-04-26T23:29:09.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014102 s, 0.0 kB/s 2024-04-26T23:29:09.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131724 s, 0.0 kB/s 2024-04-26T23:29:09.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.540 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130478 s, 0.0 kB/s 2024-04-26T23:29:09.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133202 s, 0.0 kB/s 2024-04-26T23:29:09.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139101 s, 0.0 kB/s 2024-04-26T23:29:09.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:09.918 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:09.918 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:09.918 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144816 s, 0.0 kB/s 2024-04-26T23:29:09.919 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:09.919 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:09.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:09.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146465 s, 0.0 kB/s 2024-04-26T23:29:10.027 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.077 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145645 s, 0.0 kB/s 2024-04-26T23:29:10.131 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.131 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.182 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145166 s, 0.0 kB/s 2024-04-26T23:29:10.235 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145457 s, 0.0 kB/s 2024-04-26T23:29:10.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.443 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.443 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.443 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014517 s, 0.0 kB/s 2024-04-26T23:29:10.445 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.445 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.498 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.550 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144118 s, 0.0 kB/s 2024-04-26T23:29:10.551 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.551 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.654 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141705 s, 0.0 kB/s 2024-04-26T23:29:10.655 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.655 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.705 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.758 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.758 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140172 s, 0.0 kB/s 2024-04-26T23:29:10.759 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.759 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:10.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:10.870 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147332 s, 0.0 kB/s 2024-04-26T23:29:10.871 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:10.871 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:10.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:10.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.060 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136967 s, 0.0 kB/s 2024-04-26T23:29:11.060 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.060 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.070 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133618 s, 0.0 kB/s 2024-04-26T23:29:11.122 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.122 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.233 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.233 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128279 s, 0.0 kB/s 2024-04-26T23:29:11.235 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.289 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124655 s, 0.0 kB/s 2024-04-26T23:29:11.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.393 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.446 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.446 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.446 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129328 s, 0.0 kB/s 2024-04-26T23:29:11.449 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.449 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.553 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137393 s, 0.0 kB/s 2024-04-26T23:29:11.554 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.554 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.604 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.657 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131978 s, 0.0 kB/s 2024-04-26T23:29:11.658 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.658 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134492 s, 0.0 kB/s 2024-04-26T23:29:11.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130304 s, 0.0 kB/s 2024-04-26T23:29:11.867 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.867 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:11.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:11.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125242 s, 0.0 kB/s 2024-04-26T23:29:11.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:11.974 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.082 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128996 s, 0.0 kB/s 2024-04-26T23:29:12.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.133 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122885 s, 0.0 kB/s 2024-04-26T23:29:12.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125368 s, 0.0 kB/s 2024-04-26T23:29:12.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132781 s, 0.0 kB/s 2024-04-26T23:29:12.399 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.501 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134884 s, 0.0 kB/s 2024-04-26T23:29:12.502 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.502 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133316 s, 0.0 kB/s 2024-04-26T23:29:12.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136836 s, 0.0 kB/s 2024-04-26T23:29:12.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.827 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.827 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150507 s, 0.0 kB/s 2024-04-26T23:29:12.828 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.828 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.882 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:12.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014527 s, 0.0 kB/s 2024-04-26T23:29:12.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:12.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:12.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139346 s, 0.0 kB/s 2024-04-26T23:29:13.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.039 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.094 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001464 s, 0.0 kB/s 2024-04-26T23:29:13.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.206 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142293 s, 0.0 kB/s 2024-04-26T23:29:13.259 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.259 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.312 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.365 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143502 s, 0.0 kB/s 2024-04-26T23:29:13.366 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.366 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.417 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.470 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139734 s, 0.0 kB/s 2024-04-26T23:29:13.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.521 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143406 s, 0.0 kB/s 2024-04-26T23:29:13.575 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.575 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.625 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.678 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.678 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.678 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145115 s, 0.0 kB/s 2024-04-26T23:29:13.679 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.679 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.786 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015272 s, 0.0 kB/s 2024-04-26T23:29:13.787 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.787 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.837 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141284 s, 0.0 kB/s 2024-04-26T23:29:13.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:13.895 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:13.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:13.945 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.002 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.002 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.002 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142392 s, 0.0 kB/s 2024-04-26T23:29:14.003 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.003 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144409 s, 0.0 kB/s 2024-04-26T23:29:14.114 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.170 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.221 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131614 s, 0.0 kB/s 2024-04-26T23:29:14.222 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.222 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.277 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.329 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134217 s, 0.0 kB/s 2024-04-26T23:29:14.330 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.330 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.439 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.439 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134181 s, 0.0 kB/s 2024-04-26T23:29:14.440 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.440 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133401 s, 0.0 kB/s 2024-04-26T23:29:14.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.592 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138454 s, 0.0 kB/s 2024-04-26T23:29:14.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127983 s, 0.0 kB/s 2024-04-26T23:29:14.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.805 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.857 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129253 s, 0.0 kB/s 2024-04-26T23:29:14.858 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.858 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:14.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:14.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:14.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:14.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:14.967 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136626 s, 0.0 kB/s 2024-04-26T23:29:14.967 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:14.967 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.017 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142836 s, 0.0 kB/s 2024-04-26T23:29:15.071 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.121 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145267 s, 0.0 kB/s 2024-04-26T23:29:15.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.282 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014958 s, 0.0 kB/s 2024-04-26T23:29:15.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142707 s, 0.0 kB/s 2024-04-26T23:29:15.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.441 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.495 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152537 s, 0.0 kB/s 2024-04-26T23:29:15.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.496 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.606 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.606 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140289 s, 0.0 kB/s 2024-04-26T23:29:15.607 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.607 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142603 s, 0.0 kB/s 2024-04-26T23:29:15.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140443 s, 0.0 kB/s 2024-04-26T23:29:15.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:15.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:15.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:15.925 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135437 s, 0.0 kB/s 2024-04-26T23:29:15.926 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:15.926 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:15.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:15.981 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.038 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145652 s, 0.0 kB/s 2024-04-26T23:29:16.040 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.040 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.095 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145 s, 0.0 kB/s 2024-04-26T23:29:16.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.209 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.267 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.267 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.267 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143379 s, 0.0 kB/s 2024-04-26T23:29:16.268 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.268 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143527 s, 0.0 kB/s 2024-04-26T23:29:16.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140599 s, 0.0 kB/s 2024-04-26T23:29:16.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135844 s, 0.0 kB/s 2024-04-26T23:29:16.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.673 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138793 s, 0.0 kB/s 2024-04-26T23:29:16.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.788 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149933 s, 0.0 kB/s 2024-04-26T23:29:16.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.846 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:16.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:16.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:16.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:16.963 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:16.963 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014694 s, 0.0 kB/s 2024-04-26T23:29:16.964 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:16.964 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.019 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148744 s, 0.0 kB/s 2024-04-26T23:29:17.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.074 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147572 s, 0.0 kB/s 2024-04-26T23:29:17.184 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.184 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.238 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141829 s, 0.0 kB/s 2024-04-26T23:29:17.292 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.292 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.347 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149616 s, 0.0 kB/s 2024-04-26T23:29:17.399 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.502 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.502 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014509 s, 0.0 kB/s 2024-04-26T23:29:17.503 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.503 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.610 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.610 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.610 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145106 s, 0.0 kB/s 2024-04-26T23:29:17.611 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.611 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.662 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154294 s, 0.0 kB/s 2024-04-26T23:29:17.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.765 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146514 s, 0.0 kB/s 2024-04-26T23:29:17.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:17.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:17.926 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:17.926 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140326 s, 0.0 kB/s 2024-04-26T23:29:17.927 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:17.927 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:17.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:17.978 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.030 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140151 s, 0.0 kB/s 2024-04-26T23:29:18.031 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.081 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139222 s, 0.0 kB/s 2024-04-26T23:29:18.135 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.186 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134103 s, 0.0 kB/s 2024-04-26T23:29:18.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.239 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.293 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134843 s, 0.0 kB/s 2024-04-26T23:29:18.350 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.350 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137529 s, 0.0 kB/s 2024-04-26T23:29:18.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013116 s, 0.0 kB/s 2024-04-26T23:29:18.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013363 s, 0.0 kB/s 2024-04-26T23:29:18.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143192 s, 0.0 kB/s 2024-04-26T23:29:18.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.772 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144539 s, 0.0 kB/s 2024-04-26T23:29:18.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:18.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:18.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:18.990 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:18.990 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:18.990 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140587 s, 0.0 kB/s 2024-04-26T23:29:18.991 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:18.991 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.045 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137904 s, 0.0 kB/s 2024-04-26T23:29:19.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143515 s, 0.0 kB/s 2024-04-26T23:29:19.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.314 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145448 s, 0.0 kB/s 2024-04-26T23:29:19.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.315 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.418 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141015 s, 0.0 kB/s 2024-04-26T23:29:19.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147422 s, 0.0 kB/s 2024-04-26T23:29:19.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142602 s, 0.0 kB/s 2024-04-26T23:29:19.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001523 s, 0.0 kB/s 2024-04-26T23:29:19.735 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.735 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.786 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145526 s, 0.0 kB/s 2024-04-26T23:29:19.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.889 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:19.942 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:19.942 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:19.942 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145827 s, 0.0 kB/s 2024-04-26T23:29:19.943 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:19.944 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:19.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:19.994 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.047 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.047 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.047 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144847 s, 0.0 kB/s 2024-04-26T23:29:20.048 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.048 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.106 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138002 s, 0.0 kB/s 2024-04-26T23:29:20.163 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.163 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141082 s, 0.0 kB/s 2024-04-26T23:29:20.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140403 s, 0.0 kB/s 2024-04-26T23:29:20.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145724 s, 0.0 kB/s 2024-04-26T23:29:20.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.591 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.591 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.591 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145518 s, 0.0 kB/s 2024-04-26T23:29:20.592 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.592 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.698 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141449 s, 0.0 kB/s 2024-04-26T23:29:20.699 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.699 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.802 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141698 s, 0.0 kB/s 2024-04-26T23:29:20.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.857 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:20.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:20.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:20.910 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145982 s, 0.0 kB/s 2024-04-26T23:29:20.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:20.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:20.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:20.961 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141044 s, 0.0 kB/s 2024-04-26T23:29:21.016 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.016 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.069 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014715 s, 0.0 kB/s 2024-04-26T23:29:21.123 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.123 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.174 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.226 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150104 s, 0.0 kB/s 2024-04-26T23:29:21.227 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.227 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.281 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147804 s, 0.0 kB/s 2024-04-26T23:29:21.335 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.335 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146274 s, 0.0 kB/s 2024-04-26T23:29:21.444 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.444 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142448 s, 0.0 kB/s 2024-04-26T23:29:21.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.598 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.654 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.654 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.654 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138808 s, 0.0 kB/s 2024-04-26T23:29:21.655 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.655 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.704 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.758 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.758 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.758 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139507 s, 0.0 kB/s 2024-04-26T23:29:21.759 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.759 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.814 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.866 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140683 s, 0.0 kB/s 2024-04-26T23:29:21.867 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.867 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:21.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:21.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:21.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:21.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:21.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137183 s, 0.0 kB/s 2024-04-26T23:29:21.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:21.974 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.026 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.078 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.078 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.078 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141843 s, 0.0 kB/s 2024-04-26T23:29:22.079 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.079 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.129 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136792 s, 0.0 kB/s 2024-04-26T23:29:22.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.183 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.234 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.286 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.286 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.286 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131668 s, 0.0 kB/s 2024-04-26T23:29:22.288 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.288 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.390 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139208 s, 0.0 kB/s 2024-04-26T23:29:22.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.441 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141403 s, 0.0 kB/s 2024-04-26T23:29:22.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140439 s, 0.0 kB/s 2024-04-26T23:29:22.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138243 s, 0.0 kB/s 2024-04-26T23:29:22.706 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.706 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.757 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146473 s, 0.0 kB/s 2024-04-26T23:29:22.815 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.815 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.870 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:22.922 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:22.923 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:22.923 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139166 s, 0.0 kB/s 2024-04-26T23:29:22.924 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:22.924 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:22.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:22.974 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.030 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146675 s, 0.0 kB/s 2024-04-26T23:29:23.031 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.082 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142831 s, 0.0 kB/s 2024-04-26T23:29:23.136 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.136 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.190 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.242 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146038 s, 0.0 kB/s 2024-04-26T23:29:23.243 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.243 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148139 s, 0.0 kB/s 2024-04-26T23:29:23.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014658 s, 0.0 kB/s 2024-04-26T23:29:23.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.514 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148572 s, 0.0 kB/s 2024-04-26T23:29:23.567 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.567 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.671 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.671 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.671 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138782 s, 0.0 kB/s 2024-04-26T23:29:23.672 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.672 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.730 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.782 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000167958 s, 0.0 kB/s 2024-04-26T23:29:23.783 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.783 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.833 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.886 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.886 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.886 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138149 s, 0.0 kB/s 2024-04-26T23:29:23.887 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.887 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:23.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:23.937 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:23.990 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:23.990 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:23.990 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152472 s, 0.0 kB/s 2024-04-26T23:29:23.991 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:23.991 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142596 s, 0.0 kB/s 2024-04-26T23:29:24.096 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.096 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.149 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014647 s, 0.0 kB/s 2024-04-26T23:29:24.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.253 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014821 s, 0.0 kB/s 2024-04-26T23:29:24.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.362 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147216 s, 0.0 kB/s 2024-04-26T23:29:24.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.418 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.470 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147958 s, 0.0 kB/s 2024-04-26T23:29:24.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014111 s, 0.0 kB/s 2024-04-26T23:29:24.631 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.631 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.683 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.735 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.736 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.736 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145909 s, 0.0 kB/s 2024-04-26T23:29:24.737 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.737 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149947 s, 0.0 kB/s 2024-04-26T23:29:24.848 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.848 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:24.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:24.902 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:24.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:24.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:24.954 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149043 s, 0.0 kB/s 2024-04-26T23:29:24.955 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:24.955 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.005 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154677 s, 0.0 kB/s 2024-04-26T23:29:25.064 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.064 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142681 s, 0.0 kB/s 2024-04-26T23:29:25.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148543 s, 0.0 kB/s 2024-04-26T23:29:25.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144964 s, 0.0 kB/s 2024-04-26T23:29:25.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.430 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153916 s, 0.0 kB/s 2024-04-26T23:29:25.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145997 s, 0.0 kB/s 2024-04-26T23:29:25.591 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000216201 s, 0.0 kB/s 2024-04-26T23:29:25.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147006 s, 0.0 kB/s 2024-04-26T23:29:25.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.850 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:25.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:25.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:25.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146258 s, 0.0 kB/s 2024-04-26T23:29:25.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:25.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:25.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:25.953 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.006 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143589 s, 0.0 kB/s 2024-04-26T23:29:26.007 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.007 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.110 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.110 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.110 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151299 s, 0.0 kB/s 2024-04-26T23:29:26.111 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.111 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014572 s, 0.0 kB/s 2024-04-26T23:29:26.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.318 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143818 s, 0.0 kB/s 2024-04-26T23:29:26.319 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141912 s, 0.0 kB/s 2024-04-26T23:29:26.427 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.427 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.481 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143949 s, 0.0 kB/s 2024-04-26T23:29:26.535 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.535 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.589 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145716 s, 0.0 kB/s 2024-04-26T23:29:26.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146675 s, 0.0 kB/s 2024-04-26T23:29:26.751 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141752 s, 0.0 kB/s 2024-04-26T23:29:26.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:26.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:26.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:26.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:26.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:26.958 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145619 s, 0.0 kB/s 2024-04-26T23:29:26.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:26.959 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133841 s, 0.0 kB/s 2024-04-26T23:29:27.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137459 s, 0.0 kB/s 2024-04-26T23:29:27.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140817 s, 0.0 kB/s 2024-04-26T23:29:27.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013915 s, 0.0 kB/s 2024-04-26T23:29:27.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144528 s, 0.0 kB/s 2024-04-26T23:29:27.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014577 s, 0.0 kB/s 2024-04-26T23:29:27.591 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145703 s, 0.0 kB/s 2024-04-26T23:29:27.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147787 s, 0.0 kB/s 2024-04-26T23:29:27.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.849 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:27.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:27.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:27.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144512 s, 0.0 kB/s 2024-04-26T23:29:27.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:27.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:27.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:27.953 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.006 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014685 s, 0.0 kB/s 2024-04-26T23:29:28.008 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.008 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.110 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.110 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.110 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147636 s, 0.0 kB/s 2024-04-26T23:29:28.111 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.112 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.162 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148462 s, 0.0 kB/s 2024-04-26T23:29:28.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.265 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.318 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146851 s, 0.0 kB/s 2024-04-26T23:29:28.319 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143158 s, 0.0 kB/s 2024-04-26T23:29:28.423 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.423 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.473 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.526 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.526 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149518 s, 0.0 kB/s 2024-04-26T23:29:28.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.527 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.630 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.630 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013859 s, 0.0 kB/s 2024-04-26T23:29:28.630 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.631 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150884 s, 0.0 kB/s 2024-04-26T23:29:28.735 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.735 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144577 s, 0.0 kB/s 2024-04-26T23:29:28.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.889 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:28.942 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:28.942 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:28.942 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147606 s, 0.0 kB/s 2024-04-26T23:29:28.943 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:28.943 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:28.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:28.993 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.050 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144394 s, 0.0 kB/s 2024-04-26T23:29:29.051 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.051 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.105 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145941 s, 0.0 kB/s 2024-04-26T23:29:29.159 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.209 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144104 s, 0.0 kB/s 2024-04-26T23:29:29.263 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.366 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.366 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.366 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143826 s, 0.0 kB/s 2024-04-26T23:29:29.367 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.367 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.417 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.470 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144837 s, 0.0 kB/s 2024-04-26T23:29:29.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.521 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.574 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149052 s, 0.0 kB/s 2024-04-26T23:29:29.575 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.575 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.630 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145372 s, 0.0 kB/s 2024-04-26T23:29:29.687 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.687 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.741 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152622 s, 0.0 kB/s 2024-04-26T23:29:29.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.849 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146924 s, 0.0 kB/s 2024-04-26T23:29:29.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:29.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:29.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:29.953 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146665 s, 0.0 kB/s 2024-04-26T23:29:30.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.066 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.119 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.119 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.119 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148218 s, 0.0 kB/s 2024-04-26T23:29:30.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150824 s, 0.0 kB/s 2024-04-26T23:29:30.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.277 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143606 s, 0.0 kB/s 2024-04-26T23:29:30.331 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.331 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.386 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.442 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142789 s, 0.0 kB/s 2024-04-26T23:29:30.443 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.443 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.494 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147945 s, 0.0 kB/s 2024-04-26T23:29:30.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148284 s, 0.0 kB/s 2024-04-26T23:29:30.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143787 s, 0.0 kB/s 2024-04-26T23:29:30.768 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.768 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146319 s, 0.0 kB/s 2024-04-26T23:29:30.875 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.875 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:30.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:30.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:30.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144204 s, 0.0 kB/s 2024-04-26T23:29:30.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:30.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.030 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146305 s, 0.0 kB/s 2024-04-26T23:29:31.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142268 s, 0.0 kB/s 2024-04-26T23:29:31.195 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.195 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.249 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139312 s, 0.0 kB/s 2024-04-26T23:29:31.303 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.303 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.406 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.406 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.406 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148108 s, 0.0 kB/s 2024-04-26T23:29:31.407 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.407 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.510 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138627 s, 0.0 kB/s 2024-04-26T23:29:31.511 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.511 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.561 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.614 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.614 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133451 s, 0.0 kB/s 2024-04-26T23:29:31.615 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132421 s, 0.0 kB/s 2024-04-26T23:29:31.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137419 s, 0.0 kB/s 2024-04-26T23:29:31.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.822 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134019 s, 0.0 kB/s 2024-04-26T23:29:31.926 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:31.927 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:31.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:31.982 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134929 s, 0.0 kB/s 2024-04-26T23:29:32.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.038 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.145 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.146 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132445 s, 0.0 kB/s 2024-04-26T23:29:32.147 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.147 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.201 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.254 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135757 s, 0.0 kB/s 2024-04-26T23:29:32.254 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.255 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.305 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.362 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.362 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.362 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155017 s, 0.0 kB/s 2024-04-26T23:29:32.363 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.363 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141799 s, 0.0 kB/s 2024-04-26T23:29:32.467 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.467 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.517 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136766 s, 0.0 kB/s 2024-04-26T23:29:32.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.571 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.625 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149323 s, 0.0 kB/s 2024-04-26T23:29:32.679 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.679 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.734 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144504 s, 0.0 kB/s 2024-04-26T23:29:32.791 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.791 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.842 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.894 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148891 s, 0.0 kB/s 2024-04-26T23:29:32.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.895 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:32.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144291 s, 0.0 kB/s 2024-04-26T23:29:32.999 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:32.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001398 s, 0.0 kB/s 2024-04-26T23:29:33.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149623 s, 0.0 kB/s 2024-04-26T23:29:33.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014545 s, 0.0 kB/s 2024-04-26T23:29:33.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.362 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.418 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142705 s, 0.0 kB/s 2024-04-26T23:29:33.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.474 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.530 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.530 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.531 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150112 s, 0.0 kB/s 2024-04-26T23:29:33.532 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.532 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.586 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143483 s, 0.0 kB/s 2024-04-26T23:29:33.639 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.639 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142511 s, 0.0 kB/s 2024-04-26T23:29:33.747 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.747 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.797 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143413 s, 0.0 kB/s 2024-04-26T23:29:33.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:33.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:33.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144417 s, 0.0 kB/s 2024-04-26T23:29:33.967 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:33.967 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147267 s, 0.0 kB/s 2024-04-26T23:29:34.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.076 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.126 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147334 s, 0.0 kB/s 2024-04-26T23:29:34.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.230 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149846 s, 0.0 kB/s 2024-04-26T23:29:34.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141099 s, 0.0 kB/s 2024-04-26T23:29:34.395 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.395 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.445 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139887 s, 0.0 kB/s 2024-04-26T23:29:34.504 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.504 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.561 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.614 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.614 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142578 s, 0.0 kB/s 2024-04-26T23:29:34.615 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135546 s, 0.0 kB/s 2024-04-26T23:29:34.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.720 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000165837 s, 0.0 kB/s 2024-04-26T23:29:34.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131548 s, 0.0 kB/s 2024-04-26T23:29:34.927 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:34.927 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:34.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:34.978 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138597 s, 0.0 kB/s 2024-04-26T23:29:35.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136498 s, 0.0 kB/s 2024-04-26T23:29:35.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.249 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142081 s, 0.0 kB/s 2024-04-26T23:29:35.251 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.251 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.301 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014218 s, 0.0 kB/s 2024-04-26T23:29:35.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145362 s, 0.0 kB/s 2024-04-26T23:29:35.463 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.463 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.514 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144715 s, 0.0 kB/s 2024-04-26T23:29:35.568 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.568 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.670 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147354 s, 0.0 kB/s 2024-04-26T23:29:35.671 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.671 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.726 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.783 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152465 s, 0.0 kB/s 2024-04-26T23:29:35.783 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.784 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.834 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.887 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.887 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.887 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141901 s, 0.0 kB/s 2024-04-26T23:29:35.889 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.889 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:35.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:35.942 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:35.994 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:35.994 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:35.994 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143837 s, 0.0 kB/s 2024-04-26T23:29:35.996 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:35.996 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141991 s, 0.0 kB/s 2024-04-26T23:29:36.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014355 s, 0.0 kB/s 2024-04-26T23:29:36.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.314 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.314 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143543 s, 0.0 kB/s 2024-04-26T23:29:36.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.315 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.419 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.419 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.419 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148883 s, 0.0 kB/s 2024-04-26T23:29:36.420 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.420 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.531 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.531 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.531 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145077 s, 0.0 kB/s 2024-04-26T23:29:36.532 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.532 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.634 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.634 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.634 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143686 s, 0.0 kB/s 2024-04-26T23:29:36.636 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.636 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.686 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.738 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.738 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136947 s, 0.0 kB/s 2024-04-26T23:29:36.739 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.739 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137507 s, 0.0 kB/s 2024-04-26T23:29:36.847 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.847 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:36.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:36.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:36.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:36.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:36.950 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132236 s, 0.0 kB/s 2024-04-26T23:29:36.951 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:36.951 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.054 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134133 s, 0.0 kB/s 2024-04-26T23:29:37.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.055 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.106 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136696 s, 0.0 kB/s 2024-04-26T23:29:37.161 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.161 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013657 s, 0.0 kB/s 2024-04-26T23:29:37.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.317 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013548 s, 0.0 kB/s 2024-04-26T23:29:37.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.422 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141735 s, 0.0 kB/s 2024-04-26T23:29:37.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.527 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145501 s, 0.0 kB/s 2024-04-26T23:29:37.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014848 s, 0.0 kB/s 2024-04-26T23:29:37.683 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154525 s, 0.0 kB/s 2024-04-26T23:29:37.788 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.789 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.842 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.895 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141428 s, 0.0 kB/s 2024-04-26T23:29:37.896 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.896 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:37.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:37.946 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:37.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:37.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:37.998 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141751 s, 0.0 kB/s 2024-04-26T23:29:37.999 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:37.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.103 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.104 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.104 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152828 s, 0.0 kB/s 2024-04-26T23:29:38.104 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.104 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.154 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147346 s, 0.0 kB/s 2024-04-26T23:29:38.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149128 s, 0.0 kB/s 2024-04-26T23:29:38.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144955 s, 0.0 kB/s 2024-04-26T23:29:38.416 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.416 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141339 s, 0.0 kB/s 2024-04-26T23:29:38.519 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.519 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.570 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.622 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144576 s, 0.0 kB/s 2024-04-26T23:29:38.624 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.624 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.675 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.726 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155446 s, 0.0 kB/s 2024-04-26T23:29:38.727 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.727 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:29:38.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:29:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143329 s, 0.0 kB/s 2024-04-26T23:29:38.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.882 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:38.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:38.939 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:38.939 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140984 s, 0.0 kB/s 2024-04-26T23:29:38.940 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:38.940 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:38.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:38.993 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.046 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.046 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.046 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135999 s, 0.0 kB/s 2024-04-26T23:29:39.047 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.047 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.097 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134433 s, 0.0 kB/s 2024-04-26T23:29:39.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.204 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133099 s, 0.0 kB/s 2024-04-26T23:29:39.254 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.255 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.305 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.357 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135924 s, 0.0 kB/s 2024-04-26T23:29:39.358 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.358 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.410 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135497 s, 0.0 kB/s 2024-04-26T23:29:39.463 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.463 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.513 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137916 s, 0.0 kB/s 2024-04-26T23:29:39.567 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.567 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.618 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014201 s, 0.0 kB/s 2024-04-26T23:29:39.671 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.671 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.722 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.774 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146483 s, 0.0 kB/s 2024-04-26T23:29:39.776 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.776 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.830 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.882 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138611 s, 0.0 kB/s 2024-04-26T23:29:39.883 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.883 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:39.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:39.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143006 s, 0.0 kB/s 2024-04-26T23:29:39.987 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:39.987 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.037 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.090 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.091 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.091 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146908 s, 0.0 kB/s 2024-04-26T23:29:40.092 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.092 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142638 s, 0.0 kB/s 2024-04-26T23:29:40.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.258 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140289 s, 0.0 kB/s 2024-04-26T23:29:40.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.415 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.415 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.415 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142178 s, 0.0 kB/s 2024-04-26T23:29:40.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.518 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142432 s, 0.0 kB/s 2024-04-26T23:29:40.519 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.519 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.569 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136012 s, 0.0 kB/s 2024-04-26T23:29:40.623 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.623 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143948 s, 0.0 kB/s 2024-04-26T23:29:40.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.782 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143371 s, 0.0 kB/s 2024-04-26T23:29:40.837 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.837 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.886 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:40.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:40.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:40.938 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147342 s, 0.0 kB/s 2024-04-26T23:29:40.939 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:40.939 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:40.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:40.989 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148231 s, 0.0 kB/s 2024-04-26T23:29:41.047 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.048 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.097 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014517 s, 0.0 kB/s 2024-04-26T23:29:41.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.201 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145426 s, 0.0 kB/s 2024-04-26T23:29:41.259 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.259 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131105 s, 0.0 kB/s 2024-04-26T23:29:41.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.362 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126139 s, 0.0 kB/s 2024-04-26T23:29:41.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.517 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126454 s, 0.0 kB/s 2024-04-26T23:29:41.571 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.571 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.624 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.677 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.677 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.677 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130252 s, 0.0 kB/s 2024-04-26T23:29:41.678 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.678 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.728 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.782 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.782 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000190107 s, 0.0 kB/s 2024-04-26T23:29:41.783 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.783 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.833 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.890 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.890 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.890 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130479 s, 0.0 kB/s 2024-04-26T23:29:41.891 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.891 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:41.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:41.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:41.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:41.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:41.993 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001205 s, 0.0 kB/s 2024-04-26T23:29:41.994 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:41.995 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127401 s, 0.0 kB/s 2024-04-26T23:29:42.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.156 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126589 s, 0.0 kB/s 2024-04-26T23:29:42.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127926 s, 0.0 kB/s 2024-04-26T23:29:42.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125107 s, 0.0 kB/s 2024-04-26T23:29:42.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.475 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126553 s, 0.0 kB/s 2024-04-26T23:29:42.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012102 s, 0.0 kB/s 2024-04-26T23:29:42.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.634 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.684 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123787 s, 0.0 kB/s 2024-04-26T23:29:42.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136309 s, 0.0 kB/s 2024-04-26T23:29:42.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.846 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:42.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:42.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:42.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126559 s, 0.0 kB/s 2024-04-26T23:29:42.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:42.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.005 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127339 s, 0.0 kB/s 2024-04-26T23:29:43.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123076 s, 0.0 kB/s 2024-04-26T23:29:43.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123121 s, 0.0 kB/s 2024-04-26T23:29:43.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122236 s, 0.0 kB/s 2024-04-26T23:29:43.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123433 s, 0.0 kB/s 2024-04-26T23:29:43.478 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.528 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.586 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.586 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122758 s, 0.0 kB/s 2024-04-26T23:29:43.587 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.587 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122946 s, 0.0 kB/s 2024-04-26T23:29:43.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134166 s, 0.0 kB/s 2024-04-26T23:29:43.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126084 s, 0.0 kB/s 2024-04-26T23:29:43.906 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:43.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:43.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:43.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126031 s, 0.0 kB/s 2024-04-26T23:29:44.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.065 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012935 s, 0.0 kB/s 2024-04-26T23:29:44.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.121 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130546 s, 0.0 kB/s 2024-04-26T23:29:44.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013055 s, 0.0 kB/s 2024-04-26T23:29:44.327 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.327 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.434 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130602 s, 0.0 kB/s 2024-04-26T23:29:44.435 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.435 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130226 s, 0.0 kB/s 2024-04-26T23:29:44.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131516 s, 0.0 kB/s 2024-04-26T23:29:44.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013354 s, 0.0 kB/s 2024-04-26T23:29:44.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.871 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.871 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145838 s, 0.0 kB/s 2024-04-26T23:29:44.872 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.872 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:44.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:44.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:44.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:44.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:44.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139456 s, 0.0 kB/s 2024-04-26T23:29:44.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:44.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.090 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.090 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.090 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146857 s, 0.0 kB/s 2024-04-26T23:29:45.091 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.091 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.141 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.198 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147733 s, 0.0 kB/s 2024-04-26T23:29:45.199 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.199 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.249 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.303 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.303 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.303 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145714 s, 0.0 kB/s 2024-04-26T23:29:45.304 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.304 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.410 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.410 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.411 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144013 s, 0.0 kB/s 2024-04-26T23:29:45.411 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.412 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.461 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135423 s, 0.0 kB/s 2024-04-26T23:29:45.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.519 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000170455 s, 0.0 kB/s 2024-04-26T23:29:45.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146485 s, 0.0 kB/s 2024-04-26T23:29:45.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.842 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150019 s, 0.0 kB/s 2024-04-26T23:29:45.843 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.844 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:45.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:45.894 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135563 s, 0.0 kB/s 2024-04-26T23:29:45.952 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:45.952 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.058 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142268 s, 0.0 kB/s 2024-04-26T23:29:46.059 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.162 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135988 s, 0.0 kB/s 2024-04-26T23:29:46.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130268 s, 0.0 kB/s 2024-04-26T23:29:46.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127957 s, 0.0 kB/s 2024-04-26T23:29:46.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.425 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.478 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.478 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129835 s, 0.0 kB/s 2024-04-26T23:29:46.479 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.479 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.529 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136954 s, 0.0 kB/s 2024-04-26T23:29:46.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133243 s, 0.0 kB/s 2024-04-26T23:29:46.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001286 s, 0.0 kB/s 2024-04-26T23:29:46.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124006 s, 0.0 kB/s 2024-04-26T23:29:46.906 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:46.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:46.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:46.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127271 s, 0.0 kB/s 2024-04-26T23:29:47.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133062 s, 0.0 kB/s 2024-04-26T23:29:47.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130535 s, 0.0 kB/s 2024-04-26T23:29:47.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.274 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.327 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.327 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.327 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137664 s, 0.0 kB/s 2024-04-26T23:29:47.328 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.328 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140944 s, 0.0 kB/s 2024-04-26T23:29:47.439 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.490 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.543 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.543 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.543 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135588 s, 0.0 kB/s 2024-04-26T23:29:47.545 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.545 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.598 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.650 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133861 s, 0.0 kB/s 2024-04-26T23:29:47.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.702 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013299 s, 0.0 kB/s 2024-04-26T23:29:47.755 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.755 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.807 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.858 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133868 s, 0.0 kB/s 2024-04-26T23:29:47.859 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.859 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:47.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:47.908 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134455 s, 0.0 kB/s 2024-04-26T23:29:47.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:47.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.013 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.066 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.066 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.066 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138691 s, 0.0 kB/s 2024-04-26T23:29:48.067 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.067 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.118 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143753 s, 0.0 kB/s 2024-04-26T23:29:48.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145227 s, 0.0 kB/s 2024-04-26T23:29:48.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140307 s, 0.0 kB/s 2024-04-26T23:29:48.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.483 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.483 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146637 s, 0.0 kB/s 2024-04-26T23:29:48.484 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.484 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144908 s, 0.0 kB/s 2024-04-26T23:29:48.592 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.592 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.646 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.698 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.699 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.699 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014958 s, 0.0 kB/s 2024-04-26T23:29:48.700 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.700 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.803 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.803 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.803 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145694 s, 0.0 kB/s 2024-04-26T23:29:48.804 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.804 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:48.906 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:48.907 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:48.907 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139965 s, 0.0 kB/s 2024-04-26T23:29:48.908 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:48.908 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:48.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:48.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143114 s, 0.0 kB/s 2024-04-26T23:29:49.012 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.012 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.066 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.122 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.122 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.122 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150198 s, 0.0 kB/s 2024-04-26T23:29:49.123 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.123 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149633 s, 0.0 kB/s 2024-04-26T23:29:49.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.281 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.336 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.336 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.336 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149973 s, 0.0 kB/s 2024-04-26T23:29:49.336 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.336 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143408 s, 0.0 kB/s 2024-04-26T23:29:49.439 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.542 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141073 s, 0.0 kB/s 2024-04-26T23:29:49.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.593 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147703 s, 0.0 kB/s 2024-04-26T23:29:49.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.648 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144577 s, 0.0 kB/s 2024-04-26T23:29:49.751 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149561 s, 0.0 kB/s 2024-04-26T23:29:49.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:49.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:49.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:49.958 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014215 s, 0.0 kB/s 2024-04-26T23:29:49.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:49.959 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.010 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.063 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137346 s, 0.0 kB/s 2024-04-26T23:29:50.064 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.064 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126236 s, 0.0 kB/s 2024-04-26T23:29:50.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.220 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129746 s, 0.0 kB/s 2024-04-26T23:29:50.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126204 s, 0.0 kB/s 2024-04-26T23:29:50.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.428 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128216 s, 0.0 kB/s 2024-04-26T23:29:50.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125649 s, 0.0 kB/s 2024-04-26T23:29:50.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.640 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122892 s, 0.0 kB/s 2024-04-26T23:29:50.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.750 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.805 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121978 s, 0.0 kB/s 2024-04-26T23:29:50.806 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.806 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:50.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:50.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:50.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130302 s, 0.0 kB/s 2024-04-26T23:29:50.918 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:50.918 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:50.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:50.972 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.030 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000185417 s, 0.0 kB/s 2024-04-26T23:29:51.031 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.087 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130607 s, 0.0 kB/s 2024-04-26T23:29:51.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.249 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013481 s, 0.0 kB/s 2024-04-26T23:29:51.250 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.250 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.301 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128374 s, 0.0 kB/s 2024-04-26T23:29:51.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.457 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125677 s, 0.0 kB/s 2024-04-26T23:29:51.458 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.458 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.508 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.561 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125739 s, 0.0 kB/s 2024-04-26T23:29:51.562 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.562 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.612 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123137 s, 0.0 kB/s 2024-04-26T23:29:51.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134181 s, 0.0 kB/s 2024-04-26T23:29:51.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122316 s, 0.0 kB/s 2024-04-26T23:29:51.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:51.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:51.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:51.976 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:51.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:51.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121909 s, 0.0 kB/s 2024-04-26T23:29:51.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:51.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128362 s, 0.0 kB/s 2024-04-26T23:29:52.082 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.133 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.184 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125712 s, 0.0 kB/s 2024-04-26T23:29:52.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.288 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130636 s, 0.0 kB/s 2024-04-26T23:29:52.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.392 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127708 s, 0.0 kB/s 2024-04-26T23:29:52.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.444 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128159 s, 0.0 kB/s 2024-04-26T23:29:52.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.498 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128051 s, 0.0 kB/s 2024-04-26T23:29:52.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128258 s, 0.0 kB/s 2024-04-26T23:29:52.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.761 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122933 s, 0.0 kB/s 2024-04-26T23:29:52.814 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.815 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:52.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:52.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:52.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129878 s, 0.0 kB/s 2024-04-26T23:29:52.918 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:52.918 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:52.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:52.969 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.021 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123461 s, 0.0 kB/s 2024-04-26T23:29:53.022 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.022 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.073 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.127 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.127 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.127 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132546 s, 0.0 kB/s 2024-04-26T23:29:53.127 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147435 s, 0.0 kB/s 2024-04-26T23:29:53.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.281 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124803 s, 0.0 kB/s 2024-04-26T23:29:53.334 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.384 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123448 s, 0.0 kB/s 2024-04-26T23:29:53.438 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.438 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121672 s, 0.0 kB/s 2024-04-26T23:29:53.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.593 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012692 s, 0.0 kB/s 2024-04-26T23:29:53.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.646 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143772 s, 0.0 kB/s 2024-04-26T23:29:53.751 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131099 s, 0.0 kB/s 2024-04-26T23:29:53.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:53.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:53.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136474 s, 0.0 kB/s 2024-04-26T23:29:53.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:53.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013492 s, 0.0 kB/s 2024-04-26T23:29:54.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138998 s, 0.0 kB/s 2024-04-26T23:29:54.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151998 s, 0.0 kB/s 2024-04-26T23:29:54.279 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.279 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135514 s, 0.0 kB/s 2024-04-26T23:29:54.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.441 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.493 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134857 s, 0.0 kB/s 2024-04-26T23:29:54.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.494 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139665 s, 0.0 kB/s 2024-04-26T23:29:54.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143571 s, 0.0 kB/s 2024-04-26T23:29:54.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.761 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.818 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149341 s, 0.0 kB/s 2024-04-26T23:29:54.819 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.819 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.869 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:54.922 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:54.922 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:54.922 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142259 s, 0.0 kB/s 2024-04-26T23:29:54.924 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:54.924 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:54.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:54.973 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144677 s, 0.0 kB/s 2024-04-26T23:29:55.027 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.078 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.130 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146158 s, 0.0 kB/s 2024-04-26T23:29:55.131 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.131 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.181 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144935 s, 0.0 kB/s 2024-04-26T23:29:55.235 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.338 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.338 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.338 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145974 s, 0.0 kB/s 2024-04-26T23:29:55.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.442 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144684 s, 0.0 kB/s 2024-04-26T23:29:55.443 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.443 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143419 s, 0.0 kB/s 2024-04-26T23:29:55.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.650 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139738 s, 0.0 kB/s 2024-04-26T23:29:55.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.701 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135425 s, 0.0 kB/s 2024-04-26T23:29:55.755 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.755 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.805 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.857 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137321 s, 0.0 kB/s 2024-04-26T23:29:55.858 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.858 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:55.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139438 s, 0.0 kB/s 2024-04-26T23:29:55.963 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:55.963 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.013 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130928 s, 0.0 kB/s 2024-04-26T23:29:56.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.122 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141451 s, 0.0 kB/s 2024-04-26T23:29:56.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.233 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139182 s, 0.0 kB/s 2024-04-26T23:29:56.287 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.287 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.391 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.391 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.391 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138781 s, 0.0 kB/s 2024-04-26T23:29:56.392 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.392 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140347 s, 0.0 kB/s 2024-04-26T23:29:56.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014243 s, 0.0 kB/s 2024-04-26T23:29:56.604 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.605 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.661 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138202 s, 0.0 kB/s 2024-04-26T23:29:56.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133524 s, 0.0 kB/s 2024-04-26T23:29:56.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:56.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:56.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:56.934 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137769 s, 0.0 kB/s 2024-04-26T23:29:56.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:56.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:56.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:56.986 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.038 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139116 s, 0.0 kB/s 2024-04-26T23:29:57.039 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.039 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.089 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.142 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.142 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140026 s, 0.0 kB/s 2024-04-26T23:29:57.143 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.143 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.246 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014332 s, 0.0 kB/s 2024-04-26T23:29:57.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.247 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.350 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139608 s, 0.0 kB/s 2024-04-26T23:29:57.351 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.351 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139937 s, 0.0 kB/s 2024-04-26T23:29:57.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.558 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.558 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.558 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151954 s, 0.0 kB/s 2024-04-26T23:29:57.560 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.560 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.618 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.634 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.634 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141369 s, 0.0 kB/s 2024-04-26T23:29:57.635 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.635 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141367 s, 0.0 kB/s 2024-04-26T23:29:57.756 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.756 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.814 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.871 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.871 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.871 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146866 s, 0.0 kB/s 2024-04-26T23:29:57.872 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.872 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:57.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:57.928 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:57.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:57.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:57.986 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141422 s, 0.0 kB/s 2024-04-26T23:29:57.987 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:57.988 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.042 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.097 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142743 s, 0.0 kB/s 2024-04-26T23:29:58.098 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.098 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.154 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148709 s, 0.0 kB/s 2024-04-26T23:29:58.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.314 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.314 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.314 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149838 s, 0.0 kB/s 2024-04-26T23:29:58.315 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.315 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.418 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144126 s, 0.0 kB/s 2024-04-26T23:29:58.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.470 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146028 s, 0.0 kB/s 2024-04-26T23:29:58.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147914 s, 0.0 kB/s 2024-04-26T23:29:58.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149608 s, 0.0 kB/s 2024-04-26T23:29:58.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148218 s, 0.0 kB/s 2024-04-26T23:29:58.835 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.885 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:58.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:58.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:58.937 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146112 s, 0.0 kB/s 2024-04-26T23:29:58.938 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:58.938 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:58.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:58.989 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148285 s, 0.0 kB/s 2024-04-26T23:29:59.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.147 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.147 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.147 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145987 s, 0.0 kB/s 2024-04-26T23:29:59.148 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.148 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.201 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.258 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.258 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014425 s, 0.0 kB/s 2024-04-26T23:29:59.260 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.260 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146068 s, 0.0 kB/s 2024-04-26T23:29:59.363 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.363 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.473 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000163941 s, 0.0 kB/s 2024-04-26T23:29:59.473 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.474 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014393 s, 0.0 kB/s 2024-04-26T23:29:59.583 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.583 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.633 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.690 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000199135 s, 0.0 kB/s 2024-04-26T23:29:59.691 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.691 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.741 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.795 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.795 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.795 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155055 s, 0.0 kB/s 2024-04-26T23:29:59.796 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.796 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.850 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:29:59.906 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:29:59.906 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:29:59.907 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000177993 s, 0.0 kB/s 2024-04-26T23:29:59.908 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:29:59.908 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:29:59.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:29:59.961 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147873 s, 0.0 kB/s 2024-04-26T23:30:00.015 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.015 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.070 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.123 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.123 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.124 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147658 s, 0.0 kB/s 2024-04-26T23:30:00.124 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.124 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.173 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148772 s, 0.0 kB/s 2024-04-26T23:30:00.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.283 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.335 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.335 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144571 s, 0.0 kB/s 2024-04-26T23:30:00.337 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.337 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.442 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145325 s, 0.0 kB/s 2024-04-26T23:30:00.444 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.444 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.497 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.550 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.551 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.551 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149614 s, 0.0 kB/s 2024-04-26T23:30:00.552 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.552 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149235 s, 0.0 kB/s 2024-04-26T23:30:00.660 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.660 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.773 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142688 s, 0.0 kB/s 2024-04-26T23:30:00.775 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.775 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.830 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.882 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146627 s, 0.0 kB/s 2024-04-26T23:30:00.883 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.883 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:00.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:00.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:00.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:00.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:00.986 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147951 s, 0.0 kB/s 2024-04-26T23:30:00.987 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:00.987 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150046 s, 0.0 kB/s 2024-04-26T23:30:01.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014125 s, 0.0 kB/s 2024-04-26T23:30:01.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.254 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.306 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.306 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.306 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146682 s, 0.0 kB/s 2024-04-26T23:30:01.307 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.307 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143401 s, 0.0 kB/s 2024-04-26T23:30:01.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.526 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.526 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.526 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141011 s, 0.0 kB/s 2024-04-26T23:30:01.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.527 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.578 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.634 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.634 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138507 s, 0.0 kB/s 2024-04-26T23:30:01.635 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.635 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.690 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141543 s, 0.0 kB/s 2024-04-26T23:30:01.743 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.851 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151359 s, 0.0 kB/s 2024-04-26T23:30:01.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.852 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:01.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:01.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:01.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:01.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:01.954 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142444 s, 0.0 kB/s 2024-04-26T23:30:01.956 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:01.956 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.063 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149538 s, 0.0 kB/s 2024-04-26T23:30:02.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.064 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.114 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146909 s, 0.0 kB/s 2024-04-26T23:30:02.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.274 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014717 s, 0.0 kB/s 2024-04-26T23:30:02.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141602 s, 0.0 kB/s 2024-04-26T23:30:02.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.430 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014641 s, 0.0 kB/s 2024-04-26T23:30:02.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.537 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145134 s, 0.0 kB/s 2024-04-26T23:30:02.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.702 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149978 s, 0.0 kB/s 2024-04-26T23:30:02.703 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.703 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146053 s, 0.0 kB/s 2024-04-26T23:30:02.807 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.807 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.858 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:02.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:02.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:02.914 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014743 s, 0.0 kB/s 2024-04-26T23:30:02.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:02.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:02.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:02.970 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014087 s, 0.0 kB/s 2024-04-26T23:30:03.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.078 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.130 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149496 s, 0.0 kB/s 2024-04-26T23:30:03.131 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.131 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.186 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145704 s, 0.0 kB/s 2024-04-26T23:30:03.244 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.244 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.293 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.351 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.351 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.351 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142355 s, 0.0 kB/s 2024-04-26T23:30:03.352 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.352 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139922 s, 0.0 kB/s 2024-04-26T23:30:03.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.563 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142199 s, 0.0 kB/s 2024-04-26T23:30:03.563 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.564 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141838 s, 0.0 kB/s 2024-04-26T23:30:03.667 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.667 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.718 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149017 s, 0.0 kB/s 2024-04-26T23:30:03.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.825 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.882 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142938 s, 0.0 kB/s 2024-04-26T23:30:03.883 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.883 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:03.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:03.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:03.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:03.990 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:03.990 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146482 s, 0.0 kB/s 2024-04-26T23:30:03.991 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:03.991 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149336 s, 0.0 kB/s 2024-04-26T23:30:04.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143365 s, 0.0 kB/s 2024-04-26T23:30:04.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.311 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.311 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.311 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147089 s, 0.0 kB/s 2024-04-26T23:30:04.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.418 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.418 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151465 s, 0.0 kB/s 2024-04-26T23:30:04.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147814 s, 0.0 kB/s 2024-04-26T23:30:04.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.630 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.630 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.630 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142909 s, 0.0 kB/s 2024-04-26T23:30:04.631 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.631 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.734 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.734 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144276 s, 0.0 kB/s 2024-04-26T23:30:04.735 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.735 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.846 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150725 s, 0.0 kB/s 2024-04-26T23:30:04.847 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.847 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:04.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:04.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147234 s, 0.0 kB/s 2024-04-26T23:30:04.952 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:04.952 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145561 s, 0.0 kB/s 2024-04-26T23:30:05.061 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.061 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.114 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149955 s, 0.0 kB/s 2024-04-26T23:30:05.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145991 s, 0.0 kB/s 2024-04-26T23:30:05.279 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.279 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.387 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148231 s, 0.0 kB/s 2024-04-26T23:30:05.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142897 s, 0.0 kB/s 2024-04-26T23:30:05.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144523 s, 0.0 kB/s 2024-04-26T23:30:05.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.603 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001463 s, 0.0 kB/s 2024-04-26T23:30:05.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.765 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.818 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015451 s, 0.0 kB/s 2024-04-26T23:30:05.820 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.820 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.869 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:05.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:05.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:05.922 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142678 s, 0.0 kB/s 2024-04-26T23:30:05.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:05.923 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:05.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:05.973 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145163 s, 0.0 kB/s 2024-04-26T23:30:06.027 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.077 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139865 s, 0.0 kB/s 2024-04-26T23:30:06.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.134 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.238 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134732 s, 0.0 kB/s 2024-04-26T23:30:06.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.239 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.289 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136605 s, 0.0 kB/s 2024-04-26T23:30:06.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.343 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.397 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.449 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139536 s, 0.0 kB/s 2024-04-26T23:30:06.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.554 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.554 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.554 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014576 s, 0.0 kB/s 2024-04-26T23:30:06.555 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.555 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131652 s, 0.0 kB/s 2024-04-26T23:30:06.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012943 s, 0.0 kB/s 2024-04-26T23:30:06.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131258 s, 0.0 kB/s 2024-04-26T23:30:06.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:06.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:06.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:06.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:06.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:06.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135013 s, 0.0 kB/s 2024-04-26T23:30:06.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:06.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.082 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012783 s, 0.0 kB/s 2024-04-26T23:30:07.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.133 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013083 s, 0.0 kB/s 2024-04-26T23:30:07.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127863 s, 0.0 kB/s 2024-04-26T23:30:07.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122995 s, 0.0 kB/s 2024-04-26T23:30:07.398 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.398 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.448 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.502 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000118999 s, 0.0 kB/s 2024-04-26T23:30:07.502 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.502 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121486 s, 0.0 kB/s 2024-04-26T23:30:07.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.660 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.716 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.717 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127529 s, 0.0 kB/s 2024-04-26T23:30:07.717 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.718 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014231 s, 0.0 kB/s 2024-04-26T23:30:07.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.822 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:07.928 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:07.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:07.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126935 s, 0.0 kB/s 2024-04-26T23:30:07.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:07.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:07.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:07.981 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122838 s, 0.0 kB/s 2024-04-26T23:30:08.034 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.034 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.087 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.140 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.140 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.140 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124619 s, 0.0 kB/s 2024-04-26T23:30:08.141 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.141 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.200 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128714 s, 0.0 kB/s 2024-04-26T23:30:08.256 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.256 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121349 s, 0.0 kB/s 2024-04-26T23:30:08.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.362 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.414 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122379 s, 0.0 kB/s 2024-04-26T23:30:08.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.526 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.586 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124189 s, 0.0 kB/s 2024-04-26T23:30:08.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.638 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.690 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126155 s, 0.0 kB/s 2024-04-26T23:30:08.691 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.691 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128835 s, 0.0 kB/s 2024-04-26T23:30:08.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.794 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:08.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:08.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:08.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129759 s, 0.0 kB/s 2024-04-26T23:30:08.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:08.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:08.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:30:08.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:30:08.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:08.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134353 s, 0.0 kB/s 2024-04-26T23:30:09.045 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.046 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.097 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124354 s, 0.0 kB/s 2024-04-26T23:30:09.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.150 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.204 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132785 s, 0.0 kB/s 2024-04-26T23:30:09.260 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.260 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140452 s, 0.0 kB/s 2024-04-26T23:30:09.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.362 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.412 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.470 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137883 s, 0.0 kB/s 2024-04-26T23:30:09.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.521 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137349 s, 0.0 kB/s 2024-04-26T23:30:09.574 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139914 s, 0.0 kB/s 2024-04-26T23:30:09.687 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.687 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.737 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014938 s, 0.0 kB/s 2024-04-26T23:30:09.791 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.791 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.895 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.895 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.895 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141436 s, 0.0 kB/s 2024-04-26T23:30:09.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.895 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:09.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:09.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144986 s, 0.0 kB/s 2024-04-26T23:30:09.999 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:09.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.050 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.103 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.103 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152237 s, 0.0 kB/s 2024-04-26T23:30:10.105 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.106 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.157 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.210 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.210 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.210 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147964 s, 0.0 kB/s 2024-04-26T23:30:10.211 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.211 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141059 s, 0.0 kB/s 2024-04-26T23:30:10.315 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.315 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.422 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141201 s, 0.0 kB/s 2024-04-26T23:30:10.423 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.423 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.473 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.526 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.527 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.527 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144222 s, 0.0 kB/s 2024-04-26T23:30:10.528 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.528 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.638 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145997 s, 0.0 kB/s 2024-04-26T23:30:10.639 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.639 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143038 s, 0.0 kB/s 2024-04-26T23:30:10.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.797 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143989 s, 0.0 kB/s 2024-04-26T23:30:10.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:10.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:10.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:10.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:10.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:10.954 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149471 s, 0.0 kB/s 2024-04-26T23:30:10.955 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:10.955 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149406 s, 0.0 kB/s 2024-04-26T23:30:11.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144231 s, 0.0 kB/s 2024-04-26T23:30:11.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141343 s, 0.0 kB/s 2024-04-26T23:30:11.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135185 s, 0.0 kB/s 2024-04-26T23:30:11.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.482 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014182 s, 0.0 kB/s 2024-04-26T23:30:11.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.534 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154032 s, 0.0 kB/s 2024-04-26T23:30:11.591 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146129 s, 0.0 kB/s 2024-04-26T23:30:11.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.802 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144257 s, 0.0 kB/s 2024-04-26T23:30:11.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130868 s, 0.0 kB/s 2024-04-26T23:30:11.907 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:11.907 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:11.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:11.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130552 s, 0.0 kB/s 2024-04-26T23:30:12.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134411 s, 0.0 kB/s 2024-04-26T23:30:12.115 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130724 s, 0.0 kB/s 2024-04-26T23:30:12.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133961 s, 0.0 kB/s 2024-04-26T23:30:12.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.327 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.377 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.430 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139209 s, 0.0 kB/s 2024-04-26T23:30:12.431 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.431 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.481 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141931 s, 0.0 kB/s 2024-04-26T23:30:12.535 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.535 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.585 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014151 s, 0.0 kB/s 2024-04-26T23:30:12.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.639 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145651 s, 0.0 kB/s 2024-04-26T23:30:12.743 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.846 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.846 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001482 s, 0.0 kB/s 2024-04-26T23:30:12.847 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.847 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:12.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:12.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:12.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:12.958 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144006 s, 0.0 kB/s 2024-04-26T23:30:12.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:12.959 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.013 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.066 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.066 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141579 s, 0.0 kB/s 2024-04-26T23:30:13.067 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.067 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013924 s, 0.0 kB/s 2024-04-26T23:30:13.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013939 s, 0.0 kB/s 2024-04-26T23:30:13.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.389 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.389 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.390 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137238 s, 0.0 kB/s 2024-04-26T23:30:13.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.443 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133531 s, 0.0 kB/s 2024-04-26T23:30:13.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.494 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133248 s, 0.0 kB/s 2024-04-26T23:30:13.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.653 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141849 s, 0.0 kB/s 2024-04-26T23:30:13.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.761 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138885 s, 0.0 kB/s 2024-04-26T23:30:13.815 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.815 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001262 s, 0.0 kB/s 2024-04-26T23:30:13.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:13.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:13.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:13.973 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127701 s, 0.0 kB/s 2024-04-26T23:30:14.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130204 s, 0.0 kB/s 2024-04-26T23:30:14.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127396 s, 0.0 kB/s 2024-04-26T23:30:14.242 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.242 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.296 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012795 s, 0.0 kB/s 2024-04-26T23:30:14.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.409 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.461 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128759 s, 0.0 kB/s 2024-04-26T23:30:14.462 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.462 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.569 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126257 s, 0.0 kB/s 2024-04-26T23:30:14.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.570 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124923 s, 0.0 kB/s 2024-04-26T23:30:14.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.674 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.728 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.780 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.781 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.781 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127702 s, 0.0 kB/s 2024-04-26T23:30:14.782 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.782 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.837 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131669 s, 0.0 kB/s 2024-04-26T23:30:14.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:14.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:14.940 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:14.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:14.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:14.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131119 s, 0.0 kB/s 2024-04-26T23:30:14.998 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:14.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.052 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128901 s, 0.0 kB/s 2024-04-26T23:30:15.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134199 s, 0.0 kB/s 2024-04-26T23:30:15.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.214 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.265 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.318 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133325 s, 0.0 kB/s 2024-04-26T23:30:15.319 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.422 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130173 s, 0.0 kB/s 2024-04-26T23:30:15.423 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.423 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127385 s, 0.0 kB/s 2024-04-26T23:30:15.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124349 s, 0.0 kB/s 2024-04-26T23:30:15.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127198 s, 0.0 kB/s 2024-04-26T23:30:15.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130279 s, 0.0 kB/s 2024-04-26T23:30:15.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.847 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:15.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:15.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122998 s, 0.0 kB/s 2024-04-26T23:30:15.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:15.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.000 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126507 s, 0.0 kB/s 2024-04-26T23:30:16.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.108 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.162 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120153 s, 0.0 kB/s 2024-04-26T23:30:16.163 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.163 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121759 s, 0.0 kB/s 2024-04-26T23:30:16.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.372 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121099 s, 0.0 kB/s 2024-04-26T23:30:16.373 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.373 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123291 s, 0.0 kB/s 2024-04-26T23:30:16.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127112 s, 0.0 kB/s 2024-04-26T23:30:16.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.640 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123796 s, 0.0 kB/s 2024-04-26T23:30:16.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.805 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124962 s, 0.0 kB/s 2024-04-26T23:30:16.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.806 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.860 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:16.916 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:16.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:16.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120635 s, 0.0 kB/s 2024-04-26T23:30:16.918 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:16.918 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:16.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:16.972 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000117882 s, 0.0 kB/s 2024-04-26T23:30:17.029 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.081 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126325 s, 0.0 kB/s 2024-04-26T23:30:17.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.134 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119776 s, 0.0 kB/s 2024-04-26T23:30:17.238 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.239 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.288 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134185 s, 0.0 kB/s 2024-04-26T23:30:17.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.445 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128298 s, 0.0 kB/s 2024-04-26T23:30:17.446 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.446 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134256 s, 0.0 kB/s 2024-04-26T23:30:17.554 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.554 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.605 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135563 s, 0.0 kB/s 2024-04-26T23:30:17.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143478 s, 0.0 kB/s 2024-04-26T23:30:17.762 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.762 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.818 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.870 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138227 s, 0.0 kB/s 2024-04-26T23:30:17.871 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.871 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:17.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:17.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:17.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:17.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:17.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149959 s, 0.0 kB/s 2024-04-26T23:30:17.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:17.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141952 s, 0.0 kB/s 2024-04-26T23:30:18.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.141 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.196 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149949 s, 0.0 kB/s 2024-04-26T23:30:18.197 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.197 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.254 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.306 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.306 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.306 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146299 s, 0.0 kB/s 2024-04-26T23:30:18.307 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.307 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147435 s, 0.0 kB/s 2024-04-26T23:30:18.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.466 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146778 s, 0.0 kB/s 2024-04-26T23:30:18.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.627 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.627 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.627 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000194446 s, 0.0 kB/s 2024-04-26T23:30:18.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.738 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.738 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.738 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150226 s, 0.0 kB/s 2024-04-26T23:30:18.739 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.739 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141795 s, 0.0 kB/s 2024-04-26T23:30:18.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:18.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:18.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147403 s, 0.0 kB/s 2024-04-26T23:30:18.955 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:18.955 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.005 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146286 s, 0.0 kB/s 2024-04-26T23:30:19.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138984 s, 0.0 kB/s 2024-04-26T23:30:19.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146533 s, 0.0 kB/s 2024-04-26T23:30:19.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.386 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144283 s, 0.0 kB/s 2024-04-26T23:30:19.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141501 s, 0.0 kB/s 2024-04-26T23:30:19.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.598 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.598 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142912 s, 0.0 kB/s 2024-04-26T23:30:19.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.702 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145676 s, 0.0 kB/s 2024-04-26T23:30:19.703 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.703 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.757 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000178341 s, 0.0 kB/s 2024-04-26T23:30:19.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139877 s, 0.0 kB/s 2024-04-26T23:30:19.914 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:19.914 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:19.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:19.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014108 s, 0.0 kB/s 2024-04-26T23:30:20.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.069 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.126 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014133 s, 0.0 kB/s 2024-04-26T23:30:20.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.181 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138139 s, 0.0 kB/s 2024-04-26T23:30:20.235 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145069 s, 0.0 kB/s 2024-04-26T23:30:20.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141999 s, 0.0 kB/s 2024-04-26T23:30:20.447 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.447 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.497 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140219 s, 0.0 kB/s 2024-04-26T23:30:20.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.654 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143979 s, 0.0 kB/s 2024-04-26T23:30:20.654 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.655 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.705 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142051 s, 0.0 kB/s 2024-04-26T23:30:20.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.814 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142586 s, 0.0 kB/s 2024-04-26T23:30:20.871 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.871 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:20.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:20.923 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:20.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:20.974 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:20.974 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013555 s, 0.0 kB/s 2024-04-26T23:30:20.975 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:20.975 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.025 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140453 s, 0.0 kB/s 2024-04-26T23:30:21.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.189 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014145 s, 0.0 kB/s 2024-04-26T23:30:21.190 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.190 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.245 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.301 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138646 s, 0.0 kB/s 2024-04-26T23:30:21.302 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.302 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.406 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.406 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.406 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141448 s, 0.0 kB/s 2024-04-26T23:30:21.407 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.407 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141767 s, 0.0 kB/s 2024-04-26T23:30:21.511 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.511 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.565 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.618 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.618 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140198 s, 0.0 kB/s 2024-04-26T23:30:21.619 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.619 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.669 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.722 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146963 s, 0.0 kB/s 2024-04-26T23:30:21.723 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.723 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.778 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149288 s, 0.0 kB/s 2024-04-26T23:30:21.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142133 s, 0.0 kB/s 2024-04-26T23:30:21.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:21.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:21.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:21.986 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141373 s, 0.0 kB/s 2024-04-26T23:30:22.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.145 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.146 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141714 s, 0.0 kB/s 2024-04-26T23:30:22.147 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.147 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.250 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.250 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.251 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142387 s, 0.0 kB/s 2024-04-26T23:30:22.251 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.251 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.301 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144994 s, 0.0 kB/s 2024-04-26T23:30:22.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147938 s, 0.0 kB/s 2024-04-26T23:30:22.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.513 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145533 s, 0.0 kB/s 2024-04-26T23:30:22.567 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.567 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.670 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.670 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144355 s, 0.0 kB/s 2024-04-26T23:30:22.671 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.671 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.721 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.773 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.774 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143063 s, 0.0 kB/s 2024-04-26T23:30:22.775 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.775 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.825 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150039 s, 0.0 kB/s 2024-04-26T23:30:22.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:22.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:22.929 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:22.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:22.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:22.982 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145248 s, 0.0 kB/s 2024-04-26T23:30:22.983 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:22.983 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.034 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143998 s, 0.0 kB/s 2024-04-26T23:30:23.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.138 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152923 s, 0.0 kB/s 2024-04-26T23:30:23.197 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.197 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.249 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.305 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136018 s, 0.0 kB/s 2024-04-26T23:30:23.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135016 s, 0.0 kB/s 2024-04-26T23:30:23.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146823 s, 0.0 kB/s 2024-04-26T23:30:23.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142494 s, 0.0 kB/s 2024-04-26T23:30:23.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145751 s, 0.0 kB/s 2024-04-26T23:30:23.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.797 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.856 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.856 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.856 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147367 s, 0.0 kB/s 2024-04-26T23:30:23.857 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.857 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:23.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:23.910 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:23.963 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:23.963 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:23.963 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014352 s, 0.0 kB/s 2024-04-26T23:30:23.964 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:23.964 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.018 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138165 s, 0.0 kB/s 2024-04-26T23:30:24.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.125 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137122 s, 0.0 kB/s 2024-04-26T23:30:24.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.285 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139994 s, 0.0 kB/s 2024-04-26T23:30:24.286 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.286 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.395 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.395 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.396 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139041 s, 0.0 kB/s 2024-04-26T23:30:24.396 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.396 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.445 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.498 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153619 s, 0.0 kB/s 2024-04-26T23:30:24.499 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.611 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.611 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.611 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141746 s, 0.0 kB/s 2024-04-26T23:30:24.612 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.612 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.669 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014349 s, 0.0 kB/s 2024-04-26T23:30:24.728 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.728 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146084 s, 0.0 kB/s 2024-04-26T23:30:24.835 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.889 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:24.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:24.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:24.946 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014153 s, 0.0 kB/s 2024-04-26T23:30:24.947 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:24.947 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:24.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:24.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.050 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142615 s, 0.0 kB/s 2024-04-26T23:30:25.051 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.051 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.101 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.158 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.158 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146617 s, 0.0 kB/s 2024-04-26T23:30:25.159 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143226 s, 0.0 kB/s 2024-04-26T23:30:25.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.326 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014437 s, 0.0 kB/s 2024-04-26T23:30:25.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140849 s, 0.0 kB/s 2024-04-26T23:30:25.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.494 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.606 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144539 s, 0.0 kB/s 2024-04-26T23:30:25.607 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.607 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.661 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144079 s, 0.0 kB/s 2024-04-26T23:30:25.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148837 s, 0.0 kB/s 2024-04-26T23:30:25.828 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.828 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:25.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:25.938 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138292 s, 0.0 kB/s 2024-04-26T23:30:25.938 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:25.939 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:25.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:25.989 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014383 s, 0.0 kB/s 2024-04-26T23:30:26.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.146 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145597 s, 0.0 kB/s 2024-04-26T23:30:26.147 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.147 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.251 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.251 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.251 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146267 s, 0.0 kB/s 2024-04-26T23:30:26.252 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.252 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.362 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.362 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144814 s, 0.0 kB/s 2024-04-26T23:30:26.363 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.363 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.414 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.466 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139958 s, 0.0 kB/s 2024-04-26T23:30:26.467 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.467 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.521 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146246 s, 0.0 kB/s 2024-04-26T23:30:26.578 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136806 s, 0.0 kB/s 2024-04-26T23:30:26.683 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.737 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146795 s, 0.0 kB/s 2024-04-26T23:30:26.795 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.845 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136164 s, 0.0 kB/s 2024-04-26T23:30:26.900 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:26.900 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:26.949 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00017119 s, 0.0 kB/s 2024-04-26T23:30:27.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.063 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.117 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154026 s, 0.0 kB/s 2024-04-26T23:30:27.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157072 s, 0.0 kB/s 2024-04-26T23:30:27.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.274 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.329 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148817 s, 0.0 kB/s 2024-04-26T23:30:27.330 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.330 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147651 s, 0.0 kB/s 2024-04-26T23:30:27.440 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.440 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143671 s, 0.0 kB/s 2024-04-26T23:30:27.551 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.551 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154726 s, 0.0 kB/s 2024-04-26T23:30:27.655 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.655 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.761 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146495 s, 0.0 kB/s 2024-04-26T23:30:27.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139194 s, 0.0 kB/s 2024-04-26T23:30:27.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:27.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:27.921 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:27.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:27.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:27.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141627 s, 0.0 kB/s 2024-04-26T23:30:27.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:27.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.091 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.091 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.091 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148312 s, 0.0 kB/s 2024-04-26T23:30:28.092 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.092 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.146 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146822 s, 0.0 kB/s 2024-04-26T23:30:28.200 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.200 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138757 s, 0.0 kB/s 2024-04-26T23:30:28.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141264 s, 0.0 kB/s 2024-04-26T23:30:28.426 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.427 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.477 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.530 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000253077 s, 0.0 kB/s 2024-04-26T23:30:28.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.531 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131192 s, 0.0 kB/s 2024-04-26T23:30:28.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.635 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.685 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139604 s, 0.0 kB/s 2024-04-26T23:30:28.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.842 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144965 s, 0.0 kB/s 2024-04-26T23:30:28.843 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.843 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:28.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:28.893 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:28.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:28.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:28.946 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146207 s, 0.0 kB/s 2024-04-26T23:30:28.947 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:28.947 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.002 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.054 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.055 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.055 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146814 s, 0.0 kB/s 2024-04-26T23:30:29.056 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.057 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139717 s, 0.0 kB/s 2024-04-26T23:30:29.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144419 s, 0.0 kB/s 2024-04-26T23:30:29.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.321 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145158 s, 0.0 kB/s 2024-04-26T23:30:29.375 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.375 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.425 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.478 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.478 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.478 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143056 s, 0.0 kB/s 2024-04-26T23:30:29.479 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.479 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.529 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.582 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148512 s, 0.0 kB/s 2024-04-26T23:30:29.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.583 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.634 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.690 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140982 s, 0.0 kB/s 2024-04-26T23:30:29.691 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.691 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.742 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151101 s, 0.0 kB/s 2024-04-26T23:30:29.796 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.796 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.851 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147433 s, 0.0 kB/s 2024-04-26T23:30:29.904 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:29.904 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:29.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:29.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154081 s, 0.0 kB/s 2024-04-26T23:30:30.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.115 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.115 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143523 s, 0.0 kB/s 2024-04-26T23:30:30.116 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.116 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.170 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154346 s, 0.0 kB/s 2024-04-26T23:30:30.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.224 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.330 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145582 s, 0.0 kB/s 2024-04-26T23:30:30.331 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.331 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.434 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144709 s, 0.0 kB/s 2024-04-26T23:30:30.435 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.435 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.542 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143645 s, 0.0 kB/s 2024-04-26T23:30:30.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147318 s, 0.0 kB/s 2024-04-26T23:30:30.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.705 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.763 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.763 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.764 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151728 s, 0.0 kB/s 2024-04-26T23:30:30.764 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.765 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144553 s, 0.0 kB/s 2024-04-26T23:30:30.875 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.875 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:30.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:30.929 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:30.982 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145694 s, 0.0 kB/s 2024-04-26T23:30:30.983 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:30.983 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.034 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014476 s, 0.0 kB/s 2024-04-26T23:30:31.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.138 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143596 s, 0.0 kB/s 2024-04-26T23:30:31.195 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.195 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.246 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145279 s, 0.0 kB/s 2024-04-26T23:30:31.303 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.303 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.406 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147074 s, 0.0 kB/s 2024-04-26T23:30:31.406 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.407 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.514 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143266 s, 0.0 kB/s 2024-04-26T23:30:31.515 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.515 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.569 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015686 s, 0.0 kB/s 2024-04-26T23:30:31.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145626 s, 0.0 kB/s 2024-04-26T23:30:31.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142627 s, 0.0 kB/s 2024-04-26T23:30:31.835 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.885 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143627 s, 0.0 kB/s 2024-04-26T23:30:31.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:31.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:31.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:31.993 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158541 s, 0.0 kB/s 2024-04-26T23:30:32.052 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.052 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.105 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.158 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.158 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140887 s, 0.0 kB/s 2024-04-26T23:30:32.159 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.209 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141459 s, 0.0 kB/s 2024-04-26T23:30:32.263 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132667 s, 0.0 kB/s 2024-04-26T23:30:32.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.422 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137381 s, 0.0 kB/s 2024-04-26T23:30:32.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.529 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138298 s, 0.0 kB/s 2024-04-26T23:30:32.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.633 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.686 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.686 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135785 s, 0.0 kB/s 2024-04-26T23:30:32.687 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.687 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141146 s, 0.0 kB/s 2024-04-26T23:30:32.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.791 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.894 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141817 s, 0.0 kB/s 2024-04-26T23:30:32.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.895 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:32.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:32.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:32.998 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015578 s, 0.0 kB/s 2024-04-26T23:30:32.999 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:32.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144305 s, 0.0 kB/s 2024-04-26T23:30:33.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.207 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.207 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152625 s, 0.0 kB/s 2024-04-26T23:30:33.208 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.208 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.265 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131504 s, 0.0 kB/s 2024-04-26T23:30:33.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013388 s, 0.0 kB/s 2024-04-26T23:30:33.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.473 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013703 s, 0.0 kB/s 2024-04-26T23:30:33.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.527 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143728 s, 0.0 kB/s 2024-04-26T23:30:33.630 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.630 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142918 s, 0.0 kB/s 2024-04-26T23:30:33.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.842 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147904 s, 0.0 kB/s 2024-04-26T23:30:33.843 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.843 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:33.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:33.893 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:33.948 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:33.948 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:33.948 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147913 s, 0.0 kB/s 2024-04-26T23:30:33.949 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:33.949 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.007 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147073 s, 0.0 kB/s 2024-04-26T23:30:34.076 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.076 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.131 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.183 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.183 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.183 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147466 s, 0.0 kB/s 2024-04-26T23:30:34.185 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.185 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.251 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.307 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.308 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013997 s, 0.0 kB/s 2024-04-26T23:30:34.309 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.309 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142184 s, 0.0 kB/s 2024-04-26T23:30:34.423 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.423 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000163246 s, 0.0 kB/s 2024-04-26T23:30:34.536 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.536 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.594 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142909 s, 0.0 kB/s 2024-04-26T23:30:34.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.702 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.758 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.758 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141169 s, 0.0 kB/s 2024-04-26T23:30:34.759 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.759 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.865 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147738 s, 0.0 kB/s 2024-04-26T23:30:34.866 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.867 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:34.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:34.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:34.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:34.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:34.970 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139942 s, 0.0 kB/s 2024-04-26T23:30:34.971 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:34.971 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.022 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142181 s, 0.0 kB/s 2024-04-26T23:30:35.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.125 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143871 s, 0.0 kB/s 2024-04-26T23:30:35.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.183 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.233 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.286 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.286 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.286 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142239 s, 0.0 kB/s 2024-04-26T23:30:35.287 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.287 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139266 s, 0.0 kB/s 2024-04-26T23:30:35.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151211 s, 0.0 kB/s 2024-04-26T23:30:35.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.598 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140678 s, 0.0 kB/s 2024-04-26T23:30:35.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149112 s, 0.0 kB/s 2024-04-26T23:30:35.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.757 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157664 s, 0.0 kB/s 2024-04-26T23:30:35.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:35.918 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:35.918 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:35.918 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146824 s, 0.0 kB/s 2024-04-26T23:30:35.919 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:35.919 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:35.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:35.969 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.022 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.023 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.023 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147709 s, 0.0 kB/s 2024-04-26T23:30:36.023 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.023 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.073 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.126 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145441 s, 0.0 kB/s 2024-04-26T23:30:36.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145115 s, 0.0 kB/s 2024-04-26T23:30:36.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.282 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014706 s, 0.0 kB/s 2024-04-26T23:30:36.335 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.335 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150705 s, 0.0 kB/s 2024-04-26T23:30:36.439 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.542 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147174 s, 0.0 kB/s 2024-04-26T23:30:36.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.593 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.646 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149208 s, 0.0 kB/s 2024-04-26T23:30:36.647 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000183221 s, 0.0 kB/s 2024-04-26T23:30:36.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145697 s, 0.0 kB/s 2024-04-26T23:30:36.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:36.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:36.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:36.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:36.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:36.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144495 s, 0.0 kB/s 2024-04-26T23:30:36.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:36.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151281 s, 0.0 kB/s 2024-04-26T23:30:37.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.115 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141553 s, 0.0 kB/s 2024-04-26T23:30:37.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.270 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013887 s, 0.0 kB/s 2024-04-26T23:30:37.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.321 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.374 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146549 s, 0.0 kB/s 2024-04-26T23:30:37.376 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.376 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.482 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148042 s, 0.0 kB/s 2024-04-26T23:30:37.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.533 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.587 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.587 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.587 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153415 s, 0.0 kB/s 2024-04-26T23:30:37.588 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.588 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.640 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148307 s, 0.0 kB/s 2024-04-26T23:30:37.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155881 s, 0.0 kB/s 2024-04-26T23:30:37.804 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.804 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.857 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:37.910 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:37.910 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:37.911 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157793 s, 0.0 kB/s 2024-04-26T23:30:37.912 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:37.912 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:37.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:37.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150976 s, 0.0 kB/s 2024-04-26T23:30:38.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.069 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142332 s, 0.0 kB/s 2024-04-26T23:30:38.122 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.122 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139778 s, 0.0 kB/s 2024-04-26T23:30:38.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133079 s, 0.0 kB/s 2024-04-26T23:30:38.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.338 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.441 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139584 s, 0.0 kB/s 2024-04-26T23:30:38.442 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.443 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.494 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149998 s, 0.0 kB/s 2024-04-26T23:30:38.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.650 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143547 s, 0.0 kB/s 2024-04-26T23:30:38.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.701 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000172478 s, 0.0 kB/s 2024-04-26T23:30:38.755 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.755 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.805 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.862 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.862 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.862 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153389 s, 0.0 kB/s 2024-04-26T23:30:38.863 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.863 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:38.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:38.913 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146225 s, 0.0 kB/s 2024-04-26T23:30:38.967 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:38.967 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.016 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:30:39.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:30:39.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144627 s, 0.0 kB/s 2024-04-26T23:30:39.071 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.158 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145464 s, 0.0 kB/s 2024-04-26T23:30:39.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152604 s, 0.0 kB/s 2024-04-26T23:30:39.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.365 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143618 s, 0.0 kB/s 2024-04-26T23:30:39.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.522 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.522 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149915 s, 0.0 kB/s 2024-04-26T23:30:39.523 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147517 s, 0.0 kB/s 2024-04-26T23:30:39.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.677 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141509 s, 0.0 kB/s 2024-04-26T23:30:39.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151388 s, 0.0 kB/s 2024-04-26T23:30:39.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:39.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:39.889 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:39.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:39.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:39.945 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139172 s, 0.0 kB/s 2024-04-26T23:30:39.946 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:39.946 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.058 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140619 s, 0.0 kB/s 2024-04-26T23:30:40.059 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.166 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149988 s, 0.0 kB/s 2024-04-26T23:30:40.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.274 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155369 s, 0.0 kB/s 2024-04-26T23:30:40.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.275 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140858 s, 0.0 kB/s 2024-04-26T23:30:40.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014539 s, 0.0 kB/s 2024-04-26T23:30:40.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.598 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.598 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014091 s, 0.0 kB/s 2024-04-26T23:30:40.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.702 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146129 s, 0.0 kB/s 2024-04-26T23:30:40.703 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.703 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.806 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150383 s, 0.0 kB/s 2024-04-26T23:30:40.807 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.808 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:40.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:40.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:40.913 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148804 s, 0.0 kB/s 2024-04-26T23:30:40.914 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:40.914 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:40.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:40.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148649 s, 0.0 kB/s 2024-04-26T23:30:41.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.073 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.127 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.127 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.127 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150639 s, 0.0 kB/s 2024-04-26T23:30:41.127 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.181 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149918 s, 0.0 kB/s 2024-04-26T23:30:41.235 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146121 s, 0.0 kB/s 2024-04-26T23:30:41.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.338 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149781 s, 0.0 kB/s 2024-04-26T23:30:41.443 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.443 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144699 s, 0.0 kB/s 2024-04-26T23:30:41.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.655 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.655 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.655 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145816 s, 0.0 kB/s 2024-04-26T23:30:41.657 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.657 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154157 s, 0.0 kB/s 2024-04-26T23:30:41.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.819 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.870 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135544 s, 0.0 kB/s 2024-04-26T23:30:41.871 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.871 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:41.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:41.920 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:41.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:41.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:41.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133414 s, 0.0 kB/s 2024-04-26T23:30:41.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:41.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.031 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.083 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.083 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.083 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135001 s, 0.0 kB/s 2024-04-26T23:30:42.084 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.084 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.140 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148407 s, 0.0 kB/s 2024-04-26T23:30:42.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132256 s, 0.0 kB/s 2024-04-26T23:30:42.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.338 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.444 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140433 s, 0.0 kB/s 2024-04-26T23:30:42.445 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.445 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.554 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.554 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.554 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138414 s, 0.0 kB/s 2024-04-26T23:30:42.555 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.555 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.605 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139549 s, 0.0 kB/s 2024-04-26T23:30:42.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.762 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147148 s, 0.0 kB/s 2024-04-26T23:30:42.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014957 s, 0.0 kB/s 2024-04-26T23:30:42.872 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.872 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:42.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:42.926 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:42.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:42.979 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:42.979 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141593 s, 0.0 kB/s 2024-04-26T23:30:42.980 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:42.980 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000160733 s, 0.0 kB/s 2024-04-26T23:30:43.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154093 s, 0.0 kB/s 2024-04-26T23:30:43.196 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.196 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.245 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132753 s, 0.0 kB/s 2024-04-26T23:30:43.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.406 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.406 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140376 s, 0.0 kB/s 2024-04-26T23:30:43.407 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.407 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.459 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.514 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.514 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134276 s, 0.0 kB/s 2024-04-26T23:30:43.515 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.515 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.565 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.618 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.618 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139046 s, 0.0 kB/s 2024-04-26T23:30:43.619 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.619 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.671 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145934 s, 0.0 kB/s 2024-04-26T23:30:43.723 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.723 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143336 s, 0.0 kB/s 2024-04-26T23:30:43.827 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.827 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.877 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144928 s, 0.0 kB/s 2024-04-26T23:30:43.931 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:43.932 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:43.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:43.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.038 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.038 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146258 s, 0.0 kB/s 2024-04-26T23:30:44.039 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.040 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150009 s, 0.0 kB/s 2024-04-26T23:30:44.332 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.332 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.386 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.440 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148028 s, 0.0 kB/s 2024-04-26T23:30:44.442 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.442 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.494 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000165271 s, 0.0 kB/s 2024-04-26T23:30:44.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.602 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142619 s, 0.0 kB/s 2024-04-26T23:30:44.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.662 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.715 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143346 s, 0.0 kB/s 2024-04-26T23:30:44.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.818 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.875 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.875 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.875 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145628 s, 0.0 kB/s 2024-04-26T23:30:44.876 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.876 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:44.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:44.929 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:44.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:44.986 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:44.986 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142383 s, 0.0 kB/s 2024-04-26T23:30:44.987 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:44.987 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.094 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.094 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146248 s, 0.0 kB/s 2024-04-26T23:30:45.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.149 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140291 s, 0.0 kB/s 2024-04-26T23:30:45.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.253 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140271 s, 0.0 kB/s 2024-04-26T23:30:45.307 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.307 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.360 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000194319 s, 0.0 kB/s 2024-04-26T23:30:45.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134949 s, 0.0 kB/s 2024-04-26T23:30:45.522 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.522 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013498 s, 0.0 kB/s 2024-04-26T23:30:45.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.626 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133157 s, 0.0 kB/s 2024-04-26T23:30:45.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.730 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140679 s, 0.0 kB/s 2024-04-26T23:30:45.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.888 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134475 s, 0.0 kB/s 2024-04-26T23:30:45.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:45.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:45.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:45.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136083 s, 0.0 kB/s 2024-04-26T23:30:46.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134678 s, 0.0 kB/s 2024-04-26T23:30:46.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129712 s, 0.0 kB/s 2024-04-26T23:30:46.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140879 s, 0.0 kB/s 2024-04-26T23:30:46.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144779 s, 0.0 kB/s 2024-04-26T23:30:46.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144719 s, 0.0 kB/s 2024-04-26T23:30:46.591 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140701 s, 0.0 kB/s 2024-04-26T23:30:46.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013745 s, 0.0 kB/s 2024-04-26T23:30:46.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:46.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136575 s, 0.0 kB/s 2024-04-26T23:30:46.907 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:46.907 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:46.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:46.957 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.013 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140352 s, 0.0 kB/s 2024-04-26T23:30:47.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.014 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.070 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.122 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137669 s, 0.0 kB/s 2024-04-26T23:30:47.123 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.123 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.173 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.224 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.225 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.225 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134548 s, 0.0 kB/s 2024-04-26T23:30:47.226 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.226 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.280 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127421 s, 0.0 kB/s 2024-04-26T23:30:47.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.338 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.446 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131481 s, 0.0 kB/s 2024-04-26T23:30:47.446 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.446 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143677 s, 0.0 kB/s 2024-04-26T23:30:47.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.657 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133098 s, 0.0 kB/s 2024-04-26T23:30:47.658 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.658 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.765 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138409 s, 0.0 kB/s 2024-04-26T23:30:47.766 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014901 s, 0.0 kB/s 2024-04-26T23:30:47.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:47.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:47.929 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:47.981 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:47.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:47.982 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146427 s, 0.0 kB/s 2024-04-26T23:30:47.983 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:47.983 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000169026 s, 0.0 kB/s 2024-04-26T23:30:48.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147118 s, 0.0 kB/s 2024-04-26T23:30:48.195 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.195 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.245 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142589 s, 0.0 kB/s 2024-04-26T23:30:48.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.402 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155096 s, 0.0 kB/s 2024-04-26T23:30:48.403 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.403 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.453 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146168 s, 0.0 kB/s 2024-04-26T23:30:48.507 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.507 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.557 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.614 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.614 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.614 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149771 s, 0.0 kB/s 2024-04-26T23:30:48.615 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.717 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146062 s, 0.0 kB/s 2024-04-26T23:30:48.718 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146846 s, 0.0 kB/s 2024-04-26T23:30:48.827 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.827 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.877 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:48.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:48.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:48.930 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014818 s, 0.0 kB/s 2024-04-26T23:30:48.931 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:48.931 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:48.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:48.981 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146974 s, 0.0 kB/s 2024-04-26T23:30:49.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141012 s, 0.0 kB/s 2024-04-26T23:30:49.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.241 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138812 s, 0.0 kB/s 2024-04-26T23:30:49.242 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.242 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.292 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013858 s, 0.0 kB/s 2024-04-26T23:30:49.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014651 s, 0.0 kB/s 2024-04-26T23:30:49.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.504 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.558 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142943 s, 0.0 kB/s 2024-04-26T23:30:49.559 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.559 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151229 s, 0.0 kB/s 2024-04-26T23:30:49.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.712 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.765 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150545 s, 0.0 kB/s 2024-04-26T23:30:49.766 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143543 s, 0.0 kB/s 2024-04-26T23:30:49.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:49.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:49.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:49.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:49.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:49.985 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138032 s, 0.0 kB/s 2024-04-26T23:30:49.988 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:49.988 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.094 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130101 s, 0.0 kB/s 2024-04-26T23:30:50.095 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.096 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.201 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.201 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.201 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127097 s, 0.0 kB/s 2024-04-26T23:30:50.202 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.252 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.305 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012452 s, 0.0 kB/s 2024-04-26T23:30:50.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.356 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.408 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125175 s, 0.0 kB/s 2024-04-26T23:30:50.410 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.410 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.460 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127575 s, 0.0 kB/s 2024-04-26T23:30:50.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.568 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124484 s, 0.0 kB/s 2024-04-26T23:30:50.621 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.673 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.728 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.728 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.728 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124117 s, 0.0 kB/s 2024-04-26T23:30:50.729 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.729 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.832 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.832 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.832 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121543 s, 0.0 kB/s 2024-04-26T23:30:50.833 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.833 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:50.936 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:50.936 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:50.937 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001263 s, 0.0 kB/s 2024-04-26T23:30:50.938 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:50.938 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:50.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:50.988 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.040 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.041 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012476 s, 0.0 kB/s 2024-04-26T23:30:51.042 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.042 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122708 s, 0.0 kB/s 2024-04-26T23:30:51.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.150 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.200 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.252 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.253 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126721 s, 0.0 kB/s 2024-04-26T23:30:51.253 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.254 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.304 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123273 s, 0.0 kB/s 2024-04-26T23:30:51.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.357 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.412 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.467 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.467 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.467 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001212 s, 0.0 kB/s 2024-04-26T23:30:51.468 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.468 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124568 s, 0.0 kB/s 2024-04-26T23:30:51.573 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.684 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126179 s, 0.0 kB/s 2024-04-26T23:30:51.685 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.685 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130141 s, 0.0 kB/s 2024-04-26T23:30:51.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:51.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:51.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:51.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126392 s, 0.0 kB/s 2024-04-26T23:30:51.906 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:51.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:51.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:51.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.008 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122142 s, 0.0 kB/s 2024-04-26T23:30:52.009 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.009 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.117 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.117 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.117 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124334 s, 0.0 kB/s 2024-04-26T23:30:52.118 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.118 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.172 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129874 s, 0.0 kB/s 2024-04-26T23:30:52.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.283 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122755 s, 0.0 kB/s 2024-04-26T23:30:52.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.384 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.437 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123454 s, 0.0 kB/s 2024-04-26T23:30:52.438 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.438 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121389 s, 0.0 kB/s 2024-04-26T23:30:52.546 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.546 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.596 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.648 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.648 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.648 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126025 s, 0.0 kB/s 2024-04-26T23:30:52.649 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.649 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.704 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.760 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.761 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131386 s, 0.0 kB/s 2024-04-26T23:30:52.762 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.762 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.816 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119849 s, 0.0 kB/s 2024-04-26T23:30:52.873 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.873 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:52.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:52.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:52.976 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:52.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:52.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124463 s, 0.0 kB/s 2024-04-26T23:30:52.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:52.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.080 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130364 s, 0.0 kB/s 2024-04-26T23:30:53.082 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.190 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.190 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137154 s, 0.0 kB/s 2024-04-26T23:30:53.191 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.191 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.295 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.295 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.295 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012918 s, 0.0 kB/s 2024-04-26T23:30:53.295 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.295 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.400 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127899 s, 0.0 kB/s 2024-04-26T23:30:53.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.402 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.452 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.507 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.507 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.507 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125571 s, 0.0 kB/s 2024-04-26T23:30:53.508 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.509 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.564 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.620 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.620 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127588 s, 0.0 kB/s 2024-04-26T23:30:53.621 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.621 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.672 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.724 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.725 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138054 s, 0.0 kB/s 2024-04-26T23:30:53.726 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.726 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.829 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144847 s, 0.0 kB/s 2024-04-26T23:30:53.830 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.830 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:53.936 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128918 s, 0.0 kB/s 2024-04-26T23:30:53.938 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:53.938 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:53.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:53.992 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138449 s, 0.0 kB/s 2024-04-26T23:30:54.046 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.046 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.100 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133477 s, 0.0 kB/s 2024-04-26T23:30:54.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.264 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131607 s, 0.0 kB/s 2024-04-26T23:30:54.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134707 s, 0.0 kB/s 2024-04-26T23:30:54.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134573 s, 0.0 kB/s 2024-04-26T23:30:54.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134591 s, 0.0 kB/s 2024-04-26T23:30:54.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.646 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.703 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.704 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.704 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140435 s, 0.0 kB/s 2024-04-26T23:30:54.705 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.706 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.767 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140993 s, 0.0 kB/s 2024-04-26T23:30:54.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:54.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:54.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:54.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:54.946 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:54.946 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152265 s, 0.0 kB/s 2024-04-26T23:30:54.947 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:54.947 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.007 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.060 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148763 s, 0.0 kB/s 2024-04-26T23:30:55.061 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.061 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.115 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.171 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.171 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.171 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141693 s, 0.0 kB/s 2024-04-26T23:30:55.172 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.173 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149372 s, 0.0 kB/s 2024-04-26T23:30:55.280 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.280 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014213 s, 0.0 kB/s 2024-04-26T23:30:55.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.490 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143752 s, 0.0 kB/s 2024-04-26T23:30:55.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.542 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014412 s, 0.0 kB/s 2024-04-26T23:30:55.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.698 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144695 s, 0.0 kB/s 2024-04-26T23:30:55.699 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.699 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000176509 s, 0.0 kB/s 2024-04-26T23:30:55.807 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.807 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:55.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:55.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:55.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143928 s, 0.0 kB/s 2024-04-26T23:30:55.918 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:55.918 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:55.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:55.970 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153342 s, 0.0 kB/s 2024-04-26T23:30:56.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.081 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.134 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149277 s, 0.0 kB/s 2024-04-26T23:30:56.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149271 s, 0.0 kB/s 2024-04-26T23:30:56.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.240 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144798 s, 0.0 kB/s 2024-04-26T23:30:56.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.457 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147109 s, 0.0 kB/s 2024-04-26T23:30:56.458 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.458 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.562 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.562 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154241 s, 0.0 kB/s 2024-04-26T23:30:56.563 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.563 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143405 s, 0.0 kB/s 2024-04-26T23:30:56.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146399 s, 0.0 kB/s 2024-04-26T23:30:56.772 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.772 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.825 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.881 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.881 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.881 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139644 s, 0.0 kB/s 2024-04-26T23:30:56.882 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.882 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:56.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:56.937 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:56.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:56.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:56.990 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140959 s, 0.0 kB/s 2024-04-26T23:30:56.991 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:56.991 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.044 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132723 s, 0.0 kB/s 2024-04-26T23:30:57.099 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.099 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.148 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138975 s, 0.0 kB/s 2024-04-26T23:30:57.206 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.206 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137696 s, 0.0 kB/s 2024-04-26T23:30:57.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149334 s, 0.0 kB/s 2024-04-26T23:30:57.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144793 s, 0.0 kB/s 2024-04-26T23:30:57.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.569 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143191 s, 0.0 kB/s 2024-04-26T23:30:57.627 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.627 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.730 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.730 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144272 s, 0.0 kB/s 2024-04-26T23:30:57.731 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.731 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.782 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.834 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.834 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152358 s, 0.0 kB/s 2024-04-26T23:30:57.835 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.885 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:57.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:57.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:57.938 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150644 s, 0.0 kB/s 2024-04-26T23:30:57.939 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:57.939 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:57.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:57.988 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151519 s, 0.0 kB/s 2024-04-26T23:30:58.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143675 s, 0.0 kB/s 2024-04-26T23:30:58.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.206 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.261 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145122 s, 0.0 kB/s 2024-04-26T23:30:58.262 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.262 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.370 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.370 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014632 s, 0.0 kB/s 2024-04-26T23:30:58.371 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.371 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.425 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146436 s, 0.0 kB/s 2024-04-26T23:30:58.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142621 s, 0.0 kB/s 2024-04-26T23:30:58.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.698 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.698 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.698 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145338 s, 0.0 kB/s 2024-04-26T23:30:58.699 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.699 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.802 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147025 s, 0.0 kB/s 2024-04-26T23:30:58.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.857 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:58.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:58.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:58.915 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149878 s, 0.0 kB/s 2024-04-26T23:30:58.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:58.916 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:58.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:58.973 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.030 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144522 s, 0.0 kB/s 2024-04-26T23:30:59.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151715 s, 0.0 kB/s 2024-04-26T23:30:59.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.140 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.242 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.242 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014461 s, 0.0 kB/s 2024-04-26T23:30:59.243 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.243 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.293 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149633 s, 0.0 kB/s 2024-04-26T23:30:59.347 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.347 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.397 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.450 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.450 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.450 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144304 s, 0.0 kB/s 2024-04-26T23:30:59.451 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.451 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146985 s, 0.0 kB/s 2024-04-26T23:30:59.555 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.555 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.605 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150044 s, 0.0 kB/s 2024-04-26T23:30:59.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.709 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.762 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.762 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146514 s, 0.0 kB/s 2024-04-26T23:30:59.763 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.814 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.866 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147582 s, 0.0 kB/s 2024-04-26T23:30:59.867 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.867 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:30:59.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:30:59.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:30:59.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:30:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:30:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140699 s, 0.0 kB/s 2024-04-26T23:30:59.971 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:30:59.971 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147389 s, 0.0 kB/s 2024-04-26T23:31:00.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.125 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142485 s, 0.0 kB/s 2024-04-26T23:31:00.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.282 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.282 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147288 s, 0.0 kB/s 2024-04-26T23:31:00.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.337 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.394 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.394 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143831 s, 0.0 kB/s 2024-04-26T23:31:00.395 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.395 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.446 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.498 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146847 s, 0.0 kB/s 2024-04-26T23:31:00.499 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.602 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143489 s, 0.0 kB/s 2024-04-26T23:31:00.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.604 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.653 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.710 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.710 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.710 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152356 s, 0.0 kB/s 2024-04-26T23:31:00.711 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.711 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.761 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145892 s, 0.0 kB/s 2024-04-26T23:31:00.815 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.815 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.866 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:00.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:00.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:00.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148104 s, 0.0 kB/s 2024-04-26T23:31:00.919 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:00.920 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:00.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:00.968 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.021 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150899 s, 0.0 kB/s 2024-04-26T23:31:01.022 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.022 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.074 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145408 s, 0.0 kB/s 2024-04-26T23:31:01.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.177 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.230 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.230 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149925 s, 0.0 kB/s 2024-04-26T23:31:01.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.281 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014462 s, 0.0 kB/s 2024-04-26T23:31:01.334 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.437 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144791 s, 0.0 kB/s 2024-04-26T23:31:01.438 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.439 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143186 s, 0.0 kB/s 2024-04-26T23:31:01.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.650 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.650 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146211 s, 0.0 kB/s 2024-04-26T23:31:01.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.701 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.754 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.754 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000161257 s, 0.0 kB/s 2024-04-26T23:31:01.755 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.755 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.810 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.862 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.862 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152949 s, 0.0 kB/s 2024-04-26T23:31:01.863 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.864 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:01.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:01.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153175 s, 0.0 kB/s 2024-04-26T23:31:01.972 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:01.972 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.082 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145448 s, 0.0 kB/s 2024-04-26T23:31:02.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.133 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147215 s, 0.0 kB/s 2024-04-26T23:31:02.190 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.191 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.241 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.293 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139568 s, 0.0 kB/s 2024-04-26T23:31:02.294 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.294 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.345 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148079 s, 0.0 kB/s 2024-04-26T23:31:02.399 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.503 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.503 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.503 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144668 s, 0.0 kB/s 2024-04-26T23:31:02.504 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.504 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.556 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143795 s, 0.0 kB/s 2024-04-26T23:31:02.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.661 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145224 s, 0.0 kB/s 2024-04-26T23:31:02.714 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.765 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.818 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147441 s, 0.0 kB/s 2024-04-26T23:31:02.819 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.819 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.869 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:02.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:02.922 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:02.922 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014409 s, 0.0 kB/s 2024-04-26T23:31:02.923 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:02.923 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:02.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:02.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.026 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141708 s, 0.0 kB/s 2024-04-26T23:31:03.027 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.027 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.081 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138841 s, 0.0 kB/s 2024-04-26T23:31:03.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137889 s, 0.0 kB/s 2024-04-26T23:31:03.244 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.244 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.354 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.354 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132272 s, 0.0 kB/s 2024-04-26T23:31:03.355 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.355 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.404 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140606 s, 0.0 kB/s 2024-04-26T23:31:03.463 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.463 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.513 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.570 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149993 s, 0.0 kB/s 2024-04-26T23:31:03.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.571 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.677 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.677 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.678 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148081 s, 0.0 kB/s 2024-04-26T23:31:03.678 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.679 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.729 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.786 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153024 s, 0.0 kB/s 2024-04-26T23:31:03.787 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.787 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:03.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152893 s, 0.0 kB/s 2024-04-26T23:31:03.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:03.896 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:03.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:03.949 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145057 s, 0.0 kB/s 2024-04-26T23:31:04.007 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.007 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.062 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145783 s, 0.0 kB/s 2024-04-26T23:31:04.115 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.165 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.222 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145584 s, 0.0 kB/s 2024-04-26T23:31:04.223 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.277 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.334 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.334 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150873 s, 0.0 kB/s 2024-04-26T23:31:04.335 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.335 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.390 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146901 s, 0.0 kB/s 2024-04-26T23:31:04.447 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.447 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.497 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.550 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.550 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150904 s, 0.0 kB/s 2024-04-26T23:31:04.551 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.551 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.605 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148609 s, 0.0 kB/s 2024-04-26T23:31:04.663 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.716 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142116 s, 0.0 kB/s 2024-04-26T23:31:04.770 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.825 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014318 s, 0.0 kB/s 2024-04-26T23:31:04.878 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:04.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:04.929 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:04.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:04.982 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:04.982 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145858 s, 0.0 kB/s 2024-04-26T23:31:04.983 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:04.983 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.037 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.090 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.090 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.090 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143585 s, 0.0 kB/s 2024-04-26T23:31:05.091 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.091 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.141 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.198 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141047 s, 0.0 kB/s 2024-04-26T23:31:05.199 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.199 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.253 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.305 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137432 s, 0.0 kB/s 2024-04-26T23:31:05.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014679 s, 0.0 kB/s 2024-04-26T23:31:05.411 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.411 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.461 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.513 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144175 s, 0.0 kB/s 2024-04-26T23:31:05.514 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.514 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.617 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149739 s, 0.0 kB/s 2024-04-26T23:31:05.618 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.618 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.671 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.721 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147843 s, 0.0 kB/s 2024-04-26T23:31:05.722 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.722 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.774 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144056 s, 0.0 kB/s 2024-04-26T23:31:05.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.880 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140155 s, 0.0 kB/s 2024-04-26T23:31:05.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:05.934 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:05.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:05.989 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140065 s, 0.0 kB/s 2024-04-26T23:31:06.042 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.097 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142948 s, 0.0 kB/s 2024-04-26T23:31:06.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.204 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145957 s, 0.0 kB/s 2024-04-26T23:31:06.258 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.258 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144335 s, 0.0 kB/s 2024-04-26T23:31:06.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.362 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152099 s, 0.0 kB/s 2024-04-26T23:31:06.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.521 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147034 s, 0.0 kB/s 2024-04-26T23:31:06.578 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.686 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.686 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146497 s, 0.0 kB/s 2024-04-26T23:31:06.687 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.687 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.737 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150677 s, 0.0 kB/s 2024-04-26T23:31:06.795 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.845 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:06.898 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:06.898 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:06.898 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148298 s, 0.0 kB/s 2024-04-26T23:31:06.899 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:06.899 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:06.949 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.007 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.007 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.007 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144525 s, 0.0 kB/s 2024-04-26T23:31:07.008 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.008 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.061 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150349 s, 0.0 kB/s 2024-04-26T23:31:07.114 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.165 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.218 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.218 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.218 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139721 s, 0.0 kB/s 2024-04-26T23:31:07.219 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.219 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138906 s, 0.0 kB/s 2024-04-26T23:31:07.322 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.322 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013972 s, 0.0 kB/s 2024-04-26T23:31:07.427 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.427 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.477 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145448 s, 0.0 kB/s 2024-04-26T23:31:07.531 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.531 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.585 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147471 s, 0.0 kB/s 2024-04-26T23:31:07.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.643 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.750 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145655 s, 0.0 kB/s 2024-04-26T23:31:07.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.858 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153097 s, 0.0 kB/s 2024-04-26T23:31:07.859 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.859 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:07.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:07.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:07.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:07.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:07.962 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139491 s, 0.0 kB/s 2024-04-26T23:31:07.963 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:07.963 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.013 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153615 s, 0.0 kB/s 2024-04-26T23:31:08.071 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.121 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000212969 s, 0.0 kB/s 2024-04-26T23:31:08.175 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.175 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150426 s, 0.0 kB/s 2024-04-26T23:31:08.279 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.279 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146526 s, 0.0 kB/s 2024-04-26T23:31:08.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.384 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152471 s, 0.0 kB/s 2024-04-26T23:31:08.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144222 s, 0.0 kB/s 2024-04-26T23:31:08.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.702 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.702 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154619 s, 0.0 kB/s 2024-04-26T23:31:08.703 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.703 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.754 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.806 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147204 s, 0.0 kB/s 2024-04-26T23:31:08.806 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.807 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.857 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:08.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:08.910 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:08.910 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147679 s, 0.0 kB/s 2024-04-26T23:31:08.911 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:08.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:08.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:08.960 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.014 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.014 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146628 s, 0.0 kB/s 2024-04-26T23:31:09.015 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.015 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.066 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:31:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152187 s, 0.0 kB/s 2024-04-26T23:31:09.119 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.119 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:31:09.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.172 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140747 s, 0.0 kB/s 2024-04-26T23:31:09.227 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.227 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.276 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141528 s, 0.0 kB/s 2024-04-26T23:31:09.331 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.331 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144747 s, 0.0 kB/s 2024-04-26T23:31:09.435 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.435 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.546 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.546 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143961 s, 0.0 kB/s 2024-04-26T23:31:09.547 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.547 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.658 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149443 s, 0.0 kB/s 2024-04-26T23:31:09.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.659 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145315 s, 0.0 kB/s 2024-04-26T23:31:09.772 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.772 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.826 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148969 s, 0.0 kB/s 2024-04-26T23:31:09.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:09.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:09.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147918 s, 0.0 kB/s 2024-04-26T23:31:09.990 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:09.990 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147067 s, 0.0 kB/s 2024-04-26T23:31:10.108 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.108 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150909 s, 0.0 kB/s 2024-04-26T23:31:10.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.318 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147352 s, 0.0 kB/s 2024-04-26T23:31:10.319 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.373 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.430 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.431 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014872 s, 0.0 kB/s 2024-04-26T23:31:10.432 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.432 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.490 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146856 s, 0.0 kB/s 2024-04-26T23:31:10.546 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.546 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.601 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.658 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.659 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.659 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149869 s, 0.0 kB/s 2024-04-26T23:31:10.660 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.660 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144599 s, 0.0 kB/s 2024-04-26T23:31:10.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.818 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141921 s, 0.0 kB/s 2024-04-26T23:31:10.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:10.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:10.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137325 s, 0.0 kB/s 2024-04-26T23:31:10.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:10.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134378 s, 0.0 kB/s 2024-04-26T23:31:11.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.186 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140378 s, 0.0 kB/s 2024-04-26T23:31:11.187 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.187 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133126 s, 0.0 kB/s 2024-04-26T23:31:11.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143943 s, 0.0 kB/s 2024-04-26T23:31:11.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.445 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.498 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.498 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145712 s, 0.0 kB/s 2024-04-26T23:31:11.499 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147071 s, 0.0 kB/s 2024-04-26T23:31:11.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.714 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.714 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144081 s, 0.0 kB/s 2024-04-26T23:31:11.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.768 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140118 s, 0.0 kB/s 2024-04-26T23:31:11.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:11.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:11.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:11.925 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135919 s, 0.0 kB/s 2024-04-26T23:31:11.926 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:11.926 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:11.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:11.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.028 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.028 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.028 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128501 s, 0.0 kB/s 2024-04-26T23:31:12.029 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.029 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132149 s, 0.0 kB/s 2024-04-26T23:31:12.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132206 s, 0.0 kB/s 2024-04-26T23:31:12.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.302 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124309 s, 0.0 kB/s 2024-04-26T23:31:12.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.357 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.460 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.460 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.460 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127572 s, 0.0 kB/s 2024-04-26T23:31:12.461 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.461 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.512 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.568 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.569 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122007 s, 0.0 kB/s 2024-04-26T23:31:12.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.570 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.620 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126799 s, 0.0 kB/s 2024-04-26T23:31:12.677 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.677 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.732 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127821 s, 0.0 kB/s 2024-04-26T23:31:12.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123896 s, 0.0 kB/s 2024-04-26T23:31:12.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:12.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:12.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:12.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:12.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:12.996 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121727 s, 0.0 kB/s 2024-04-26T23:31:12.997 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:12.997 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120633 s, 0.0 kB/s 2024-04-26T23:31:13.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.152 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126378 s, 0.0 kB/s 2024-04-26T23:31:13.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.308 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012329 s, 0.0 kB/s 2024-04-26T23:31:13.309 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.309 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.359 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.412 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.412 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.412 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126361 s, 0.0 kB/s 2024-04-26T23:31:13.413 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.413 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123487 s, 0.0 kB/s 2024-04-26T23:31:13.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.624 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.624 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.624 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121601 s, 0.0 kB/s 2024-04-26T23:31:13.625 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.625 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.680 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.732 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.732 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.732 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127951 s, 0.0 kB/s 2024-04-26T23:31:13.733 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.733 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.784 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131287 s, 0.0 kB/s 2024-04-26T23:31:13.838 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.838 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.888 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:13.944 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:13.944 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:13.944 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123519 s, 0.0 kB/s 2024-04-26T23:31:13.945 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:13.945 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:13.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:13.996 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122046 s, 0.0 kB/s 2024-04-26T23:31:14.053 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.053 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.104 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.160 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.160 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126825 s, 0.0 kB/s 2024-04-26T23:31:14.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.268 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120937 s, 0.0 kB/s 2024-04-26T23:31:14.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.269 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121473 s, 0.0 kB/s 2024-04-26T23:31:14.373 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.476 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.476 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123833 s, 0.0 kB/s 2024-04-26T23:31:14.477 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.528 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123376 s, 0.0 kB/s 2024-04-26T23:31:14.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122563 s, 0.0 kB/s 2024-04-26T23:31:14.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122851 s, 0.0 kB/s 2024-04-26T23:31:14.801 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.801 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:14.904 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:14.904 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:14.904 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000120548 s, 0.0 kB/s 2024-04-26T23:31:14.905 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:14.905 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:14.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:14.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.010 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.010 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123232 s, 0.0 kB/s 2024-04-26T23:31:15.011 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.011 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.059 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123561 s, 0.0 kB/s 2024-04-26T23:31:15.113 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.113 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.220 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.220 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.220 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127095 s, 0.0 kB/s 2024-04-26T23:31:15.221 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.221 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.276 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.328 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.328 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.329 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128669 s, 0.0 kB/s 2024-04-26T23:31:15.329 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.330 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.380 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.432 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.432 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.432 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123536 s, 0.0 kB/s 2024-04-26T23:31:15.433 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.433 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.536 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.536 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.537 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122858 s, 0.0 kB/s 2024-04-26T23:31:15.537 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.538 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.640 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123305 s, 0.0 kB/s 2024-04-26T23:31:15.641 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.641 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127402 s, 0.0 kB/s 2024-04-26T23:31:15.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.797 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132626 s, 0.0 kB/s 2024-04-26T23:31:15.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:15.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:15.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:15.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:15.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:15.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013045 s, 0.0 kB/s 2024-04-26T23:31:15.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:15.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.006 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.056 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132969 s, 0.0 kB/s 2024-04-26T23:31:16.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129278 s, 0.0 kB/s 2024-04-26T23:31:16.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013166 s, 0.0 kB/s 2024-04-26T23:31:16.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133495 s, 0.0 kB/s 2024-04-26T23:31:16.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.420 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145456 s, 0.0 kB/s 2024-04-26T23:31:16.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141343 s, 0.0 kB/s 2024-04-26T23:31:16.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145899 s, 0.0 kB/s 2024-04-26T23:31:16.682 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.786 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.786 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014076 s, 0.0 kB/s 2024-04-26T23:31:16.788 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.788 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146246 s, 0.0 kB/s 2024-04-26T23:31:16.896 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:16.896 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:16.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:16.949 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.006 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.006 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147886 s, 0.0 kB/s 2024-04-26T23:31:17.007 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.007 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148036 s, 0.0 kB/s 2024-04-26T23:31:17.111 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.111 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146559 s, 0.0 kB/s 2024-04-26T23:31:17.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.214 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.265 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013984 s, 0.0 kB/s 2024-04-26T23:31:17.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134967 s, 0.0 kB/s 2024-04-26T23:31:17.426 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.426 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132556 s, 0.0 kB/s 2024-04-26T23:31:17.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135348 s, 0.0 kB/s 2024-04-26T23:31:17.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143392 s, 0.0 kB/s 2024-04-26T23:31:17.743 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155087 s, 0.0 kB/s 2024-04-26T23:31:17.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:17.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:17.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000168237 s, 0.0 kB/s 2024-04-26T23:31:17.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:17.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145774 s, 0.0 kB/s 2024-04-26T23:31:18.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146549 s, 0.0 kB/s 2024-04-26T23:31:18.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143402 s, 0.0 kB/s 2024-04-26T23:31:18.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143049 s, 0.0 kB/s 2024-04-26T23:31:18.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153271 s, 0.0 kB/s 2024-04-26T23:31:18.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.533 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145695 s, 0.0 kB/s 2024-04-26T23:31:18.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.691 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.691 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.691 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144889 s, 0.0 kB/s 2024-04-26T23:31:18.691 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.691 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015416 s, 0.0 kB/s 2024-04-26T23:31:18.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:18.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:18.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:18.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148478 s, 0.0 kB/s 2024-04-26T23:31:18.911 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:18.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:18.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:18.960 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.013 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143394 s, 0.0 kB/s 2024-04-26T23:31:19.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.014 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.065 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140888 s, 0.0 kB/s 2024-04-26T23:31:19.122 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.122 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.172 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145929 s, 0.0 kB/s 2024-04-26T23:31:19.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.284 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145753 s, 0.0 kB/s 2024-04-26T23:31:19.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.397 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001476 s, 0.0 kB/s 2024-04-26T23:31:19.454 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.454 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.562 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144316 s, 0.0 kB/s 2024-04-26T23:31:19.563 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.563 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.612 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150028 s, 0.0 kB/s 2024-04-26T23:31:19.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.769 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145449 s, 0.0 kB/s 2024-04-26T23:31:19.770 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.770 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.825 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143631 s, 0.0 kB/s 2024-04-26T23:31:19.878 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:19.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:19.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:19.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:19.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:19.985 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153146 s, 0.0 kB/s 2024-04-26T23:31:19.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:19.987 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.036 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.094 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148739 s, 0.0 kB/s 2024-04-26T23:31:20.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.148 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.201 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141957 s, 0.0 kB/s 2024-04-26T23:31:20.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144168 s, 0.0 kB/s 2024-04-26T23:31:20.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145995 s, 0.0 kB/s 2024-04-26T23:31:20.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.518 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.519 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.519 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148918 s, 0.0 kB/s 2024-04-26T23:31:20.520 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.520 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.636 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015162 s, 0.0 kB/s 2024-04-26T23:31:20.637 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.637 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.690 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.747 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.747 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151278 s, 0.0 kB/s 2024-04-26T23:31:20.748 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.748 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.802 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147146 s, 0.0 kB/s 2024-04-26T23:31:20.857 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.857 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:20.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:20.911 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145223 s, 0.0 kB/s 2024-04-26T23:31:20.968 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:20.968 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.022 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148429 s, 0.0 kB/s 2024-04-26T23:31:21.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143898 s, 0.0 kB/s 2024-04-26T23:31:21.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.182 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.233 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144641 s, 0.0 kB/s 2024-04-26T23:31:21.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.291 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145434 s, 0.0 kB/s 2024-04-26T23:31:21.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143289 s, 0.0 kB/s 2024-04-26T23:31:21.502 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.502 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.555 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147516 s, 0.0 kB/s 2024-04-26T23:31:21.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.656 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142699 s, 0.0 kB/s 2024-04-26T23:31:21.711 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.711 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.761 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143368 s, 0.0 kB/s 2024-04-26T23:31:21.819 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.819 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:21.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:21.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:21.930 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148269 s, 0.0 kB/s 2024-04-26T23:31:21.931 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:21.931 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:21.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:21.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140449 s, 0.0 kB/s 2024-04-26T23:31:22.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150271 s, 0.0 kB/s 2024-04-26T23:31:22.152 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.152 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.205 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.257 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135515 s, 0.0 kB/s 2024-04-26T23:31:22.258 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.258 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.312 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.370 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.370 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.371 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143057 s, 0.0 kB/s 2024-04-26T23:31:22.371 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.371 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.420 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.473 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132162 s, 0.0 kB/s 2024-04-26T23:31:22.474 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.474 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.577 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013536 s, 0.0 kB/s 2024-04-26T23:31:22.578 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.578 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138449 s, 0.0 kB/s 2024-04-26T23:31:22.682 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.682 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.785 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143241 s, 0.0 kB/s 2024-04-26T23:31:22.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.837 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141546 s, 0.0 kB/s 2024-04-26T23:31:22.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:22.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:22.941 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:22.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:22.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:22.993 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147103 s, 0.0 kB/s 2024-04-26T23:31:22.994 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:22.994 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.045 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151355 s, 0.0 kB/s 2024-04-26T23:31:23.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.157 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146298 s, 0.0 kB/s 2024-04-26T23:31:23.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138175 s, 0.0 kB/s 2024-04-26T23:31:23.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139922 s, 0.0 kB/s 2024-04-26T23:31:23.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.423 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144265 s, 0.0 kB/s 2024-04-26T23:31:23.528 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.528 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144421 s, 0.0 kB/s 2024-04-26T23:31:23.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.634 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014361 s, 0.0 kB/s 2024-04-26T23:31:23.743 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.851 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151218 s, 0.0 kB/s 2024-04-26T23:31:23.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:23.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:23.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:23.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:23.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147524 s, 0.0 kB/s 2024-04-26T23:31:23.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:23.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.015 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.066 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.066 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157973 s, 0.0 kB/s 2024-04-26T23:31:24.067 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.067 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146368 s, 0.0 kB/s 2024-04-26T23:31:24.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.278 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146934 s, 0.0 kB/s 2024-04-26T23:31:24.279 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.279 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145512 s, 0.0 kB/s 2024-04-26T23:31:24.387 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.387 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.437 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.490 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144852 s, 0.0 kB/s 2024-04-26T23:31:24.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144738 s, 0.0 kB/s 2024-04-26T23:31:24.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145902 s, 0.0 kB/s 2024-04-26T23:31:24.703 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.703 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.753 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148127 s, 0.0 kB/s 2024-04-26T23:31:24.806 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.806 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:24.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:24.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:24.913 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146993 s, 0.0 kB/s 2024-04-26T23:31:24.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:24.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:24.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:24.969 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148074 s, 0.0 kB/s 2024-04-26T23:31:25.029 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.081 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149231 s, 0.0 kB/s 2024-04-26T23:31:25.135 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.244 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146732 s, 0.0 kB/s 2024-04-26T23:31:25.244 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.244 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.350 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.350 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136996 s, 0.0 kB/s 2024-04-26T23:31:25.351 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.351 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149876 s, 0.0 kB/s 2024-04-26T23:31:25.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014434 s, 0.0 kB/s 2024-04-26T23:31:25.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.616 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136714 s, 0.0 kB/s 2024-04-26T23:31:25.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.674 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.724 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.778 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.778 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.778 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140225 s, 0.0 kB/s 2024-04-26T23:31:25.779 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.779 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.833 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.890 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143035 s, 0.0 kB/s 2024-04-26T23:31:25.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.891 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:25.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:25.941 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:25.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:25.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:25.993 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143282 s, 0.0 kB/s 2024-04-26T23:31:25.994 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:25.994 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.044 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000161142 s, 0.0 kB/s 2024-04-26T23:31:26.099 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.099 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.156 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145797 s, 0.0 kB/s 2024-04-26T23:31:26.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.314 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149044 s, 0.0 kB/s 2024-04-26T23:31:26.316 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.316 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144072 s, 0.0 kB/s 2024-04-26T23:31:26.427 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.427 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152391 s, 0.0 kB/s 2024-04-26T23:31:26.535 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.535 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144092 s, 0.0 kB/s 2024-04-26T23:31:26.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150275 s, 0.0 kB/s 2024-04-26T23:31:26.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.750 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.800 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148333 s, 0.0 kB/s 2024-04-26T23:31:26.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:26.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:26.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:26.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:26.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:26.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152467 s, 0.0 kB/s 2024-04-26T23:31:26.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:26.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147389 s, 0.0 kB/s 2024-04-26T23:31:27.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.120 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145665 s, 0.0 kB/s 2024-04-26T23:31:27.175 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.175 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142297 s, 0.0 kB/s 2024-04-26T23:31:27.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137352 s, 0.0 kB/s 2024-04-26T23:31:27.386 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.386 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.491 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.491 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.492 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143339 s, 0.0 kB/s 2024-04-26T23:31:27.492 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.493 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145982 s, 0.0 kB/s 2024-04-26T23:31:27.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.653 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152106 s, 0.0 kB/s 2024-04-26T23:31:27.712 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.712 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.765 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148616 s, 0.0 kB/s 2024-04-26T23:31:27.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:27.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:27.930 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146135 s, 0.0 kB/s 2024-04-26T23:31:27.931 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:27.931 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:27.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:27.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151451 s, 0.0 kB/s 2024-04-26T23:31:28.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.039 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.095 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153476 s, 0.0 kB/s 2024-04-26T23:31:28.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.205 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.257 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014935 s, 0.0 kB/s 2024-04-26T23:31:28.258 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.258 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.365 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145641 s, 0.0 kB/s 2024-04-26T23:31:28.366 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.366 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.416 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148842 s, 0.0 kB/s 2024-04-26T23:31:28.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145981 s, 0.0 kB/s 2024-04-26T23:31:28.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.629 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.685 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143407 s, 0.0 kB/s 2024-04-26T23:31:28.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.686 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147516 s, 0.0 kB/s 2024-04-26T23:31:28.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.845 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:28.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:28.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:28.897 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149128 s, 0.0 kB/s 2024-04-26T23:31:28.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:28.898 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:28.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:28.948 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135371 s, 0.0 kB/s 2024-04-26T23:31:29.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.056 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015247 s, 0.0 kB/s 2024-04-26T23:31:29.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.160 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.213 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145475 s, 0.0 kB/s 2024-04-26T23:31:29.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.214 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144969 s, 0.0 kB/s 2024-04-26T23:31:29.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151211 s, 0.0 kB/s 2024-04-26T23:31:29.426 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.426 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.477 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148627 s, 0.0 kB/s 2024-04-26T23:31:29.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148919 s, 0.0 kB/s 2024-04-26T23:31:29.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.635 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.684 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.742 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.742 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151079 s, 0.0 kB/s 2024-04-26T23:31:29.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152179 s, 0.0 kB/s 2024-04-26T23:31:29.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:29.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:29.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:29.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:29.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:29.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148999 s, 0.0 kB/s 2024-04-26T23:31:29.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:29.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147043 s, 0.0 kB/s 2024-04-26T23:31:30.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014668 s, 0.0 kB/s 2024-04-26T23:31:30.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.163 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014406 s, 0.0 kB/s 2024-04-26T23:31:30.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.321 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144 s, 0.0 kB/s 2024-04-26T23:31:30.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.478 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.478 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145812 s, 0.0 kB/s 2024-04-26T23:31:30.479 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.479 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.529 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150704 s, 0.0 kB/s 2024-04-26T23:31:30.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.633 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.690 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144947 s, 0.0 kB/s 2024-04-26T23:31:30.692 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.692 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.750 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.807 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.807 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.807 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145389 s, 0.0 kB/s 2024-04-26T23:31:30.809 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.809 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.870 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:30.930 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:30.931 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:30.931 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149229 s, 0.0 kB/s 2024-04-26T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:30.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:30.991 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.044 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145598 s, 0.0 kB/s 2024-04-26T23:31:31.045 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.045 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.164 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145437 s, 0.0 kB/s 2024-04-26T23:31:31.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.220 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150245 s, 0.0 kB/s 2024-04-26T23:31:31.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151999 s, 0.0 kB/s 2024-04-26T23:31:31.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.389 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.442 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.495 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.495 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148935 s, 0.0 kB/s 2024-04-26T23:31:31.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.496 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148157 s, 0.0 kB/s 2024-04-26T23:31:31.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143688 s, 0.0 kB/s 2024-04-26T23:31:31.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.764 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.821 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141638 s, 0.0 kB/s 2024-04-26T23:31:31.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.822 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135955 s, 0.0 kB/s 2024-04-26T23:31:31.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:31.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:31.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:31.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149818 s, 0.0 kB/s 2024-04-26T23:31:32.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.140 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.140 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.140 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015229 s, 0.0 kB/s 2024-04-26T23:31:32.141 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.141 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149889 s, 0.0 kB/s 2024-04-26T23:31:32.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.350 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145953 s, 0.0 kB/s 2024-04-26T23:31:32.350 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.351 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.404 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148849 s, 0.0 kB/s 2024-04-26T23:31:32.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.561 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143957 s, 0.0 kB/s 2024-04-26T23:31:32.562 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.562 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.666 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148936 s, 0.0 kB/s 2024-04-26T23:31:32.667 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.667 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.720 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144669 s, 0.0 kB/s 2024-04-26T23:31:32.775 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.775 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.828 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.882 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.883 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145528 s, 0.0 kB/s 2024-04-26T23:31:32.883 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.884 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:32.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:32.937 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:32.995 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:32.995 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:32.995 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145455 s, 0.0 kB/s 2024-04-26T23:31:32.995 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:32.995 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.044 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000165574 s, 0.0 kB/s 2024-04-26T23:31:33.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.152 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.212 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.212 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.212 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151299 s, 0.0 kB/s 2024-04-26T23:31:33.213 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.213 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157661 s, 0.0 kB/s 2024-04-26T23:31:33.322 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.322 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148506 s, 0.0 kB/s 2024-04-26T23:31:33.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.480 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151363 s, 0.0 kB/s 2024-04-26T23:31:33.535 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.535 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149377 s, 0.0 kB/s 2024-04-26T23:31:33.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147552 s, 0.0 kB/s 2024-04-26T23:31:33.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153478 s, 0.0 kB/s 2024-04-26T23:31:33.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:33.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:33.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146317 s, 0.0 kB/s 2024-04-26T23:31:33.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:33.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.012 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149128 s, 0.0 kB/s 2024-04-26T23:31:34.070 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.125 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.177 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148463 s, 0.0 kB/s 2024-04-26T23:31:34.178 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.178 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.231 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145948 s, 0.0 kB/s 2024-04-26T23:31:34.282 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.282 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148474 s, 0.0 kB/s 2024-04-26T23:31:34.386 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.386 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149666 s, 0.0 kB/s 2024-04-26T23:31:34.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.542 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143632 s, 0.0 kB/s 2024-04-26T23:31:34.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147081 s, 0.0 kB/s 2024-04-26T23:31:34.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.748 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.802 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142388 s, 0.0 kB/s 2024-04-26T23:31:34.803 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.803 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.853 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014569 s, 0.0 kB/s 2024-04-26T23:31:34.907 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:34.907 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:34.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:34.960 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143725 s, 0.0 kB/s 2024-04-26T23:31:35.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.014 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.065 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.121 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014351 s, 0.0 kB/s 2024-04-26T23:31:35.122 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.123 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.172 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144781 s, 0.0 kB/s 2024-04-26T23:31:35.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.338 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.338 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147017 s, 0.0 kB/s 2024-04-26T23:31:35.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.441 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145104 s, 0.0 kB/s 2024-04-26T23:31:35.442 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.442 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.492 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.545 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145543 s, 0.0 kB/s 2024-04-26T23:31:35.546 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.546 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.596 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.649 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145139 s, 0.0 kB/s 2024-04-26T23:31:35.650 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.650 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144719 s, 0.0 kB/s 2024-04-26T23:31:35.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.809 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148237 s, 0.0 kB/s 2024-04-26T23:31:35.867 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.867 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:35.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:35.920 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:35.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:35.978 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:35.978 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146454 s, 0.0 kB/s 2024-04-26T23:31:35.979 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:35.979 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.082 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.082 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143708 s, 0.0 kB/s 2024-04-26T23:31:36.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.134 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.187 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.188 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.188 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142618 s, 0.0 kB/s 2024-04-26T23:31:36.189 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.189 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.241 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141769 s, 0.0 kB/s 2024-04-26T23:31:36.294 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.295 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.345 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149029 s, 0.0 kB/s 2024-04-26T23:31:36.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.402 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.456 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.510 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146432 s, 0.0 kB/s 2024-04-26T23:31:36.511 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.511 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.561 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145647 s, 0.0 kB/s 2024-04-26T23:31:36.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.614 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.722 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150744 s, 0.0 kB/s 2024-04-26T23:31:36.723 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.723 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148629 s, 0.0 kB/s 2024-04-26T23:31:36.826 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.827 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.877 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:36.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:36.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:36.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150885 s, 0.0 kB/s 2024-04-26T23:31:36.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:36.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:36.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:36.981 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.035 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153093 s, 0.0 kB/s 2024-04-26T23:31:37.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.036 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.088 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150145 s, 0.0 kB/s 2024-04-26T23:31:37.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154018 s, 0.0 kB/s 2024-04-26T23:31:37.263 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.313 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137963 s, 0.0 kB/s 2024-04-26T23:31:37.366 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.366 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.416 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147893 s, 0.0 kB/s 2024-04-26T23:31:37.470 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.470 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.574 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146476 s, 0.0 kB/s 2024-04-26T23:31:37.575 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.575 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.682 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145768 s, 0.0 kB/s 2024-04-26T23:31:37.682 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154504 s, 0.0 kB/s 2024-04-26T23:31:37.787 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.787 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141272 s, 0.0 kB/s 2024-04-26T23:31:37.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.895 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:37.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:37.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:37.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:37.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:37.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139327 s, 0.0 kB/s 2024-04-26T23:31:37.998 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:37.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.102 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.102 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147877 s, 0.0 kB/s 2024-04-26T23:31:38.103 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.103 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138543 s, 0.0 kB/s 2024-04-26T23:31:38.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142849 s, 0.0 kB/s 2024-04-26T23:31:38.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014648 s, 0.0 kB/s 2024-04-26T23:31:38.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.534 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.534 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149406 s, 0.0 kB/s 2024-04-26T23:31:38.535 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.535 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146748 s, 0.0 kB/s 2024-04-26T23:31:38.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.647 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147468 s, 0.0 kB/s 2024-04-26T23:31:38.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.809 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015058 s, 0.0 kB/s 2024-04-26T23:31:38.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:38.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:38.913 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142203 s, 0.0 kB/s 2024-04-26T23:31:38.966 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:38.966 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.017 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.074 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.074 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149039 s, 0.0 kB/s 2024-04-26T23:31:39.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.075 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.129 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:31:39.182 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.182 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.182 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150519 s, 0.0 kB/s 2024-04-26T23:31:39.183 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.183 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:31:39.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.290 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.290 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150897 s, 0.0 kB/s 2024-04-26T23:31:39.291 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.291 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.342 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146791 s, 0.0 kB/s 2024-04-26T23:31:39.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.395 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.505 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141943 s, 0.0 kB/s 2024-04-26T23:31:39.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.506 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.560 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148934 s, 0.0 kB/s 2024-04-26T23:31:39.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.614 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.664 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146201 s, 0.0 kB/s 2024-04-26T23:31:39.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151797 s, 0.0 kB/s 2024-04-26T23:31:39.826 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.827 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:39.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:39.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:39.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145361 s, 0.0 kB/s 2024-04-26T23:31:39.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:39.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:39.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:39.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152258 s, 0.0 kB/s 2024-04-26T23:31:40.034 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.089 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148482 s, 0.0 kB/s 2024-04-26T23:31:40.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.143 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.250 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.250 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148866 s, 0.0 kB/s 2024-04-26T23:31:40.251 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.251 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.357 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146637 s, 0.0 kB/s 2024-04-26T23:31:40.358 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.358 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.470 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.470 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151125 s, 0.0 kB/s 2024-04-26T23:31:40.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.471 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.528 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142164 s, 0.0 kB/s 2024-04-26T23:31:40.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.685 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000162536 s, 0.0 kB/s 2024-04-26T23:31:40.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.686 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144833 s, 0.0 kB/s 2024-04-26T23:31:40.795 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.845 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:40.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:40.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:40.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014987 s, 0.0 kB/s 2024-04-26T23:31:40.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:40.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:40.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:40.952 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146085 s, 0.0 kB/s 2024-04-26T23:31:41.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.060 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.113 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148407 s, 0.0 kB/s 2024-04-26T23:31:41.115 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.218 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.218 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147008 s, 0.0 kB/s 2024-04-26T23:31:41.219 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.219 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.326 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.326 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146414 s, 0.0 kB/s 2024-04-26T23:31:41.327 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.327 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.430 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142346 s, 0.0 kB/s 2024-04-26T23:31:41.432 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.432 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.537 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.537 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.537 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143986 s, 0.0 kB/s 2024-04-26T23:31:41.538 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.538 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144021 s, 0.0 kB/s 2024-04-26T23:31:41.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147712 s, 0.0 kB/s 2024-04-26T23:31:41.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149329 s, 0.0 kB/s 2024-04-26T23:31:41.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:41.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:41.905 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:41.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:41.958 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:41.958 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014923 s, 0.0 kB/s 2024-04-26T23:31:41.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:41.959 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.062 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156639 s, 0.0 kB/s 2024-04-26T23:31:42.063 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148597 s, 0.0 kB/s 2024-04-26T23:31:42.167 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146236 s, 0.0 kB/s 2024-04-26T23:31:42.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.378 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.378 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147788 s, 0.0 kB/s 2024-04-26T23:31:42.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.435 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141844 s, 0.0 kB/s 2024-04-26T23:31:42.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148999 s, 0.0 kB/s 2024-04-26T23:31:42.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.591 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145002 s, 0.0 kB/s 2024-04-26T23:31:42.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.748 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146092 s, 0.0 kB/s 2024-04-26T23:31:42.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146964 s, 0.0 kB/s 2024-04-26T23:31:42.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:42.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:42.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:42.961 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.013 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142422 s, 0.0 kB/s 2024-04-26T23:31:43.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.014 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.068 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.125 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147754 s, 0.0 kB/s 2024-04-26T23:31:43.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.126 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.176 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149127 s, 0.0 kB/s 2024-04-26T23:31:43.234 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.288 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142176 s, 0.0 kB/s 2024-04-26T23:31:43.343 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.343 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.397 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.452 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153901 s, 0.0 kB/s 2024-04-26T23:31:43.452 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.452 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.505 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142899 s, 0.0 kB/s 2024-04-26T23:31:43.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.608 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.661 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151149 s, 0.0 kB/s 2024-04-26T23:31:43.662 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.662 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.713 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150276 s, 0.0 kB/s 2024-04-26T23:31:43.767 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.767 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014807 s, 0.0 kB/s 2024-04-26T23:31:43.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:43.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:43.921 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:43.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:43.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:43.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142684 s, 0.0 kB/s 2024-04-26T23:31:43.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:43.974 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.024 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145644 s, 0.0 kB/s 2024-04-26T23:31:44.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147843 s, 0.0 kB/s 2024-04-26T23:31:44.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.182 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.285 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015006 s, 0.0 kB/s 2024-04-26T23:31:44.286 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.286 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.336 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.390 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.390 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148089 s, 0.0 kB/s 2024-04-26T23:31:44.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015492 s, 0.0 kB/s 2024-04-26T23:31:44.495 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145495 s, 0.0 kB/s 2024-04-26T23:31:44.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.648 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.701 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145092 s, 0.0 kB/s 2024-04-26T23:31:44.702 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.702 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.752 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.805 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.805 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147151 s, 0.0 kB/s 2024-04-26T23:31:44.806 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.806 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:44.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:44.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:44.914 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014903 s, 0.0 kB/s 2024-04-26T23:31:44.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:44.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:44.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:44.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.022 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145293 s, 0.0 kB/s 2024-04-26T23:31:45.022 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.023 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.080 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.134 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158881 s, 0.0 kB/s 2024-04-26T23:31:45.135 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.188 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150402 s, 0.0 kB/s 2024-04-26T23:31:45.242 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.242 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.296 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.349 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014819 s, 0.0 kB/s 2024-04-26T23:31:45.350 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.350 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.405 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.458 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.458 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148867 s, 0.0 kB/s 2024-04-26T23:31:45.459 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.459 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.513 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014673 s, 0.0 kB/s 2024-04-26T23:31:45.567 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.567 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014761 s, 0.0 kB/s 2024-04-26T23:31:45.675 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.675 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.729 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.785 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146101 s, 0.0 kB/s 2024-04-26T23:31:45.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.837 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146483 s, 0.0 kB/s 2024-04-26T23:31:45.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:45.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:45.940 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:45.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:45.994 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:45.994 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144055 s, 0.0 kB/s 2024-04-26T23:31:45.995 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:45.995 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147505 s, 0.0 kB/s 2024-04-26T23:31:46.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.152 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154233 s, 0.0 kB/s 2024-04-26T23:31:46.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145988 s, 0.0 kB/s 2024-04-26T23:31:46.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.493 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149093 s, 0.0 kB/s 2024-04-26T23:31:46.516 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.516 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.594 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.653 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142453 s, 0.0 kB/s 2024-04-26T23:31:46.654 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.654 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.766 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.766 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152262 s, 0.0 kB/s 2024-04-26T23:31:46.768 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.768 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.827 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000163479 s, 0.0 kB/s 2024-04-26T23:31:46.885 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.885 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:46.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:46.938 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:46.991 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:46.991 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:46.991 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151095 s, 0.0 kB/s 2024-04-26T23:31:46.992 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:46.992 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.045 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.098 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148699 s, 0.0 kB/s 2024-04-26T23:31:47.099 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.099 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152094 s, 0.0 kB/s 2024-04-26T23:31:47.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149993 s, 0.0 kB/s 2024-04-26T23:31:47.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147466 s, 0.0 kB/s 2024-04-26T23:31:47.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.418 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.468 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145048 s, 0.0 kB/s 2024-04-26T23:31:47.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.576 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.629 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146852 s, 0.0 kB/s 2024-04-26T23:31:47.630 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.630 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.684 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151787 s, 0.0 kB/s 2024-04-26T23:31:47.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145377 s, 0.0 kB/s 2024-04-26T23:31:47.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:47.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:47.901 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150378 s, 0.0 kB/s 2024-04-26T23:31:47.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:47.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014582 s, 0.0 kB/s 2024-04-26T23:31:48.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153578 s, 0.0 kB/s 2024-04-26T23:31:48.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.221 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140423 s, 0.0 kB/s 2024-04-26T23:31:48.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.325 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150187 s, 0.0 kB/s 2024-04-26T23:31:48.379 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.379 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.428 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.482 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158164 s, 0.0 kB/s 2024-04-26T23:31:48.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145057 s, 0.0 kB/s 2024-04-26T23:31:48.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.638 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.690 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014601 s, 0.0 kB/s 2024-04-26T23:31:48.692 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.692 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146918 s, 0.0 kB/s 2024-04-26T23:31:48.800 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.800 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:48.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:48.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:48.906 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146278 s, 0.0 kB/s 2024-04-26T23:31:48.907 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:48.907 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:48.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:48.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144937 s, 0.0 kB/s 2024-04-26T23:31:49.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.073 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.130 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.131 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145167 s, 0.0 kB/s 2024-04-26T23:31:49.132 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.133 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151162 s, 0.0 kB/s 2024-04-26T23:31:49.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.239 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.292 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143223 s, 0.0 kB/s 2024-04-26T23:31:49.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.398 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154556 s, 0.0 kB/s 2024-04-26T23:31:49.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.557 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143988 s, 0.0 kB/s 2024-04-26T23:31:49.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.609 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015033 s, 0.0 kB/s 2024-04-26T23:31:49.663 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.717 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.773 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.774 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.774 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149253 s, 0.0 kB/s 2024-04-26T23:31:49.776 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.776 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.833 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.886 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150844 s, 0.0 kB/s 2024-04-26T23:31:49.887 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.887 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:49.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:49.940 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:49.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:49.993 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:49.993 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150104 s, 0.0 kB/s 2024-04-26T23:31:49.994 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:49.994 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.044 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.096 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.096 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.097 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136596 s, 0.0 kB/s 2024-04-26T23:31:50.098 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.098 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.148 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.200 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.200 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.201 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134894 s, 0.0 kB/s 2024-04-26T23:31:50.201 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.202 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.308 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127548 s, 0.0 kB/s 2024-04-26T23:31:50.309 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.309 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.360 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.416 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013137 s, 0.0 kB/s 2024-04-26T23:31:50.417 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.417 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.468 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.520 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.521 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132105 s, 0.0 kB/s 2024-04-26T23:31:50.522 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.522 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.572 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.624 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.625 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131315 s, 0.0 kB/s 2024-04-26T23:31:50.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.626 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137438 s, 0.0 kB/s 2024-04-26T23:31:50.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.730 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.784 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.837 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130759 s, 0.0 kB/s 2024-04-26T23:31:50.838 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.838 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:50.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:50.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:50.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137554 s, 0.0 kB/s 2024-04-26T23:31:50.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:50.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.006 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142006 s, 0.0 kB/s 2024-04-26T23:31:51.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.113 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134495 s, 0.0 kB/s 2024-04-26T23:31:51.165 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.165 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.268 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135447 s, 0.0 kB/s 2024-04-26T23:31:51.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.269 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131277 s, 0.0 kB/s 2024-04-26T23:31:51.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.476 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141464 s, 0.0 kB/s 2024-04-26T23:31:51.477 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.477 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.527 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136623 s, 0.0 kB/s 2024-04-26T23:31:51.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136774 s, 0.0 kB/s 2024-04-26T23:31:51.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.745 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142363 s, 0.0 kB/s 2024-04-26T23:31:51.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.859 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:51.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:51.914 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:51.914 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139629 s, 0.0 kB/s 2024-04-26T23:31:51.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:51.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:51.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:51.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.017 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144488 s, 0.0 kB/s 2024-04-26T23:31:52.018 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.018 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.072 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.129 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144568 s, 0.0 kB/s 2024-04-26T23:31:52.130 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.130 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.180 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.234 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.234 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140355 s, 0.0 kB/s 2024-04-26T23:31:52.234 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.235 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.284 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148425 s, 0.0 kB/s 2024-04-26T23:31:52.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.343 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145134 s, 0.0 kB/s 2024-04-26T23:31:52.446 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.446 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.497 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151038 s, 0.0 kB/s 2024-04-26T23:31:52.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.600 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156381 s, 0.0 kB/s 2024-04-26T23:31:52.658 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.658 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.765 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147472 s, 0.0 kB/s 2024-04-26T23:31:52.766 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.766 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.869 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146816 s, 0.0 kB/s 2024-04-26T23:31:52.870 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.870 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:52.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:52.925 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156319 s, 0.0 kB/s 2024-04-26T23:31:52.982 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:52.982 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.037 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.089 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148828 s, 0.0 kB/s 2024-04-26T23:31:53.090 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.090 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148279 s, 0.0 kB/s 2024-04-26T23:31:53.203 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.203 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.257 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134428 s, 0.0 kB/s 2024-04-26T23:31:53.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.360 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.413 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138779 s, 0.0 kB/s 2024-04-26T23:31:53.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.414 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.466 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148652 s, 0.0 kB/s 2024-04-26T23:31:53.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.519 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.568 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.622 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148199 s, 0.0 kB/s 2024-04-26T23:31:53.623 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.623 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.733 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144682 s, 0.0 kB/s 2024-04-26T23:31:53.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.841 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150496 s, 0.0 kB/s 2024-04-26T23:31:53.842 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.842 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:53.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:53.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151067 s, 0.0 kB/s 2024-04-26T23:31:53.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:53.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.058 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148588 s, 0.0 kB/s 2024-04-26T23:31:54.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.109 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.166 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147609 s, 0.0 kB/s 2024-04-26T23:31:54.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.167 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.220 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148785 s, 0.0 kB/s 2024-04-26T23:31:54.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.279 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.382 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153097 s, 0.0 kB/s 2024-04-26T23:31:54.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.487 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.487 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.488 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014562 s, 0.0 kB/s 2024-04-26T23:31:54.489 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.489 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014853 s, 0.0 kB/s 2024-04-26T23:31:54.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145053 s, 0.0 kB/s 2024-04-26T23:31:54.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.699 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141569 s, 0.0 kB/s 2024-04-26T23:31:54.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:54.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:54.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:54.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151493 s, 0.0 kB/s 2024-04-26T23:31:54.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:54.911 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:54.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:54.965 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149121 s, 0.0 kB/s 2024-04-26T23:31:55.023 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.023 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.072 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.126 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.126 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154213 s, 0.0 kB/s 2024-04-26T23:31:55.127 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.127 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.176 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142506 s, 0.0 kB/s 2024-04-26T23:31:55.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.284 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150169 s, 0.0 kB/s 2024-04-26T23:31:55.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.445 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145481 s, 0.0 kB/s 2024-04-26T23:31:55.446 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.447 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143092 s, 0.0 kB/s 2024-04-26T23:31:55.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.600 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.653 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143231 s, 0.0 kB/s 2024-04-26T23:31:55.654 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.654 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.757 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146406 s, 0.0 kB/s 2024-04-26T23:31:55.758 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.758 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.870 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.870 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151706 s, 0.0 kB/s 2024-04-26T23:31:55.871 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.871 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:55.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:55.928 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:55.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:55.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:55.985 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149202 s, 0.0 kB/s 2024-04-26T23:31:55.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:55.986 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.040 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155768 s, 0.0 kB/s 2024-04-26T23:31:56.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.144 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.198 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149675 s, 0.0 kB/s 2024-04-26T23:31:56.199 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.199 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.248 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.301 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155425 s, 0.0 kB/s 2024-04-26T23:31:56.302 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.302 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.405 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153136 s, 0.0 kB/s 2024-04-26T23:31:56.406 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.406 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.460 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144042 s, 0.0 kB/s 2024-04-26T23:31:56.514 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.514 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.564 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146261 s, 0.0 kB/s 2024-04-26T23:31:56.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.672 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.725 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146777 s, 0.0 kB/s 2024-04-26T23:31:56.726 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.726 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.829 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014735 s, 0.0 kB/s 2024-04-26T23:31:56.830 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.830 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:56.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:56.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:56.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:56.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:56.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143744 s, 0.0 kB/s 2024-04-26T23:31:56.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:56.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.009 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.068 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.068 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153271 s, 0.0 kB/s 2024-04-26T23:31:57.069 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.069 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.123 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.178 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.178 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145774 s, 0.0 kB/s 2024-04-26T23:31:57.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.238 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.294 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.294 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.294 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138989 s, 0.0 kB/s 2024-04-26T23:31:57.295 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.295 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.349 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.403 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136589 s, 0.0 kB/s 2024-04-26T23:31:57.405 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.405 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.461 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.514 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.515 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144248 s, 0.0 kB/s 2024-04-26T23:31:57.516 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.516 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.570 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001529 s, 0.0 kB/s 2024-04-26T23:31:57.623 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.623 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.672 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152603 s, 0.0 kB/s 2024-04-26T23:31:57.726 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.727 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155344 s, 0.0 kB/s 2024-04-26T23:31:57.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:57.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:57.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:57.937 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143656 s, 0.0 kB/s 2024-04-26T23:31:57.939 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:57.939 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:57.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:57.994 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150168 s, 0.0 kB/s 2024-04-26T23:31:58.046 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.046 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.096 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145657 s, 0.0 kB/s 2024-04-26T23:31:58.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.150 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.202 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.257 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142161 s, 0.0 kB/s 2024-04-26T23:31:58.258 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.258 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149753 s, 0.0 kB/s 2024-04-26T23:31:58.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.362 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.413 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149839 s, 0.0 kB/s 2024-04-26T23:31:58.470 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.470 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.524 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.581 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.581 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150234 s, 0.0 kB/s 2024-04-26T23:31:58.582 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.582 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153412 s, 0.0 kB/s 2024-04-26T23:31:58.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150504 s, 0.0 kB/s 2024-04-26T23:31:58.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148275 s, 0.0 kB/s 2024-04-26T23:31:58.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:58.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:58.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.013 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150948 s, 0.0 kB/s 2024-04-26T23:31:59.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.014 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.068 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015172 s, 0.0 kB/s 2024-04-26T23:31:59.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.126 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.176 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143501 s, 0.0 kB/s 2024-04-26T23:31:59.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.281 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.338 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149474 s, 0.0 kB/s 2024-04-26T23:31:59.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.395 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146024 s, 0.0 kB/s 2024-04-26T23:31:59.446 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.446 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149367 s, 0.0 kB/s 2024-04-26T23:31:59.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.600 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133691 s, 0.0 kB/s 2024-04-26T23:31:59.653 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.653 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.760 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.761 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140929 s, 0.0 kB/s 2024-04-26T23:31:59.761 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.762 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.812 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.865 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139721 s, 0.0 kB/s 2024-04-26T23:31:59.866 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.866 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:31:59.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:31:59.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:31:59.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:31:59.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:31:59.969 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141089 s, 0.0 kB/s 2024-04-26T23:31:59.970 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:31:59.970 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.020 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014238 s, 0.0 kB/s 2024-04-26T23:32:00.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135918 s, 0.0 kB/s 2024-04-26T23:32:00.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.288 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.288 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.288 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138593 s, 0.0 kB/s 2024-04-26T23:32:00.289 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.289 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.344 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142478 s, 0.0 kB/s 2024-04-26T23:32:00.398 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.399 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.449 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139938 s, 0.0 kB/s 2024-04-26T23:32:00.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.506 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.560 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.617 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.617 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014774 s, 0.0 kB/s 2024-04-26T23:32:00.618 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.618 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.668 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.726 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.726 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150796 s, 0.0 kB/s 2024-04-26T23:32:00.727 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.727 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144588 s, 0.0 kB/s 2024-04-26T23:32:00.831 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.831 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:00.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:00.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:00.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145391 s, 0.0 kB/s 2024-04-26T23:32:00.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:00.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:00.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:00.996 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.049 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.049 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.049 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00016665 s, 0.0 kB/s 2024-04-26T23:32:01.050 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.050 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.100 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151211 s, 0.0 kB/s 2024-04-26T23:32:01.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.158 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.213 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144553 s, 0.0 kB/s 2024-04-26T23:32:01.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.321 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146363 s, 0.0 kB/s 2024-04-26T23:32:01.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145116 s, 0.0 kB/s 2024-04-26T23:32:01.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149052 s, 0.0 kB/s 2024-04-26T23:32:01.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.694 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014232 s, 0.0 kB/s 2024-04-26T23:32:01.695 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.695 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015572 s, 0.0 kB/s 2024-04-26T23:32:01.799 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.799 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.849 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:01.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:01.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:01.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142632 s, 0.0 kB/s 2024-04-26T23:32:01.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:01.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:01.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:01.952 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014557 s, 0.0 kB/s 2024-04-26T23:32:02.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.110 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000164869 s, 0.0 kB/s 2024-04-26T23:32:02.111 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.111 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.160 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148427 s, 0.0 kB/s 2024-04-26T23:32:02.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.265 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150306 s, 0.0 kB/s 2024-04-26T23:32:02.320 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.320 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.374 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149856 s, 0.0 kB/s 2024-04-26T23:32:02.426 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.426 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155718 s, 0.0 kB/s 2024-04-26T23:32:02.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144096 s, 0.0 kB/s 2024-04-26T23:32:02.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.693 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146069 s, 0.0 kB/s 2024-04-26T23:32:02.747 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.747 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.796 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144814 s, 0.0 kB/s 2024-04-26T23:32:02.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:02.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:02.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:02.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:02.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:02.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150239 s, 0.0 kB/s 2024-04-26T23:32:02.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:02.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.012 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.067 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.067 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.067 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152568 s, 0.0 kB/s 2024-04-26T23:32:03.067 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.067 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.170 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146666 s, 0.0 kB/s 2024-04-26T23:32:03.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.280 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142231 s, 0.0 kB/s 2024-04-26T23:32:03.282 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.282 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.389 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.389 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.389 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151999 s, 0.0 kB/s 2024-04-26T23:32:03.390 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.390 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146446 s, 0.0 kB/s 2024-04-26T23:32:03.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.549 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.602 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143298 s, 0.0 kB/s 2024-04-26T23:32:03.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.603 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.656 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148763 s, 0.0 kB/s 2024-04-26T23:32:03.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.760 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.818 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.818 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151187 s, 0.0 kB/s 2024-04-26T23:32:03.819 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.819 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142086 s, 0.0 kB/s 2024-04-26T23:32:03.926 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:03.926 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:03.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:03.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152386 s, 0.0 kB/s 2024-04-26T23:32:04.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.080 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151004 s, 0.0 kB/s 2024-04-26T23:32:04.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.188 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.241 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152745 s, 0.0 kB/s 2024-04-26T23:32:04.242 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.242 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.294 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147638 s, 0.0 kB/s 2024-04-26T23:32:04.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.401 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.453 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145517 s, 0.0 kB/s 2024-04-26T23:32:04.454 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.454 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.506 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.561 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014689 s, 0.0 kB/s 2024-04-26T23:32:04.562 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.562 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.612 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148871 s, 0.0 kB/s 2024-04-26T23:32:04.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.716 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.770 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.770 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154136 s, 0.0 kB/s 2024-04-26T23:32:04.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.824 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.878 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.878 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014492 s, 0.0 kB/s 2024-04-26T23:32:04.879 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.879 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:04.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:04.932 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:04.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:04.985 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:04.985 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149478 s, 0.0 kB/s 2024-04-26T23:32:04.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:04.986 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.040 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147435 s, 0.0 kB/s 2024-04-26T23:32:05.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.095 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.198 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147596 s, 0.0 kB/s 2024-04-26T23:32:05.198 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.199 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.248 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.301 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.301 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147684 s, 0.0 kB/s 2024-04-26T23:32:05.302 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.303 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.352 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148433 s, 0.0 kB/s 2024-04-26T23:32:05.406 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.406 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.456 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015044 s, 0.0 kB/s 2024-04-26T23:32:05.510 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.510 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.560 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.614 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.614 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146893 s, 0.0 kB/s 2024-04-26T23:32:05.615 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.664 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144567 s, 0.0 kB/s 2024-04-26T23:32:05.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.823 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156373 s, 0.0 kB/s 2024-04-26T23:32:05.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.824 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148769 s, 0.0 kB/s 2024-04-26T23:32:05.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:05.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:05.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:05.988 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149641 s, 0.0 kB/s 2024-04-26T23:32:06.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.096 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156197 s, 0.0 kB/s 2024-04-26T23:32:06.151 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.151 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.201 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.254 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146724 s, 0.0 kB/s 2024-04-26T23:32:06.255 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.255 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.361 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146204 s, 0.0 kB/s 2024-04-26T23:32:06.362 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.363 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.417 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145451 s, 0.0 kB/s 2024-04-26T23:32:06.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148539 s, 0.0 kB/s 2024-04-26T23:32:06.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146777 s, 0.0 kB/s 2024-04-26T23:32:06.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.686 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.790 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.790 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153082 s, 0.0 kB/s 2024-04-26T23:32:06.791 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.791 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:06.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:06.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:06.898 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153968 s, 0.0 kB/s 2024-04-26T23:32:06.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:06.899 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:06.948 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138235 s, 0.0 kB/s 2024-04-26T23:32:07.003 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.003 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.056 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150277 s, 0.0 kB/s 2024-04-26T23:32:07.115 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.169 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.221 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141262 s, 0.0 kB/s 2024-04-26T23:32:07.222 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.223 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.329 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.329 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141623 s, 0.0 kB/s 2024-04-26T23:32:07.330 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.331 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.454 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.455 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.455 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141587 s, 0.0 kB/s 2024-04-26T23:32:07.456 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.456 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.515 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149968 s, 0.0 kB/s 2024-04-26T23:32:07.572 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.572 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.625 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.680 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.680 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.680 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151526 s, 0.0 kB/s 2024-04-26T23:32:07.681 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.681 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.800 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000228005 s, 0.0 kB/s 2024-04-26T23:32:07.801 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.862 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:07.919 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:07.919 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:07.919 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153612 s, 0.0 kB/s 2024-04-26T23:32:07.920 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:07.920 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:07.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:07.977 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148206 s, 0.0 kB/s 2024-04-26T23:32:08.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.091 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.147 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.147 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.147 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155671 s, 0.0 kB/s 2024-04-26T23:32:08.148 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.149 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.206 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.261 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143675 s, 0.0 kB/s 2024-04-26T23:32:08.262 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141111 s, 0.0 kB/s 2024-04-26T23:32:08.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.421 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.474 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143487 s, 0.0 kB/s 2024-04-26T23:32:08.475 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.475 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.524 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138439 s, 0.0 kB/s 2024-04-26T23:32:08.578 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137318 s, 0.0 kB/s 2024-04-26T23:32:08.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014888 s, 0.0 kB/s 2024-04-26T23:32:08.795 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.845 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:08.897 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147551 s, 0.0 kB/s 2024-04-26T23:32:08.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:08.898 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:08.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:08.949 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.006 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147707 s, 0.0 kB/s 2024-04-26T23:32:09.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.007 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.056 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015102 s, 0.0 kB/s 2024-04-26T23:32:09.115 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.115 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.221 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144057 s, 0.0 kB/s 2024-04-26T23:32:09.222 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.222 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:32:09.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:32:09.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.277 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.372 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142501 s, 0.0 kB/s 2024-04-26T23:32:09.373 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.373 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.428 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144236 s, 0.0 kB/s 2024-04-26T23:32:09.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.540 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154377 s, 0.0 kB/s 2024-04-26T23:32:09.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.701 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148683 s, 0.0 kB/s 2024-04-26T23:32:09.702 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.702 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.752 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151606 s, 0.0 kB/s 2024-04-26T23:32:09.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:09.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:09.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:09.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146091 s, 0.0 kB/s 2024-04-26T23:32:09.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:09.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:09.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:09.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148933 s, 0.0 kB/s 2024-04-26T23:32:10.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155748 s, 0.0 kB/s 2024-04-26T23:32:10.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.249 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.249 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148278 s, 0.0 kB/s 2024-04-26T23:32:10.250 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.250 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154719 s, 0.0 kB/s 2024-04-26T23:32:10.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.409 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144544 s, 0.0 kB/s 2024-04-26T23:32:10.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.578 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.578 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155492 s, 0.0 kB/s 2024-04-26T23:32:10.580 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.580 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.635 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.685 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150751 s, 0.0 kB/s 2024-04-26T23:32:10.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.686 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.737 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014662 s, 0.0 kB/s 2024-04-26T23:32:10.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.790 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145384 s, 0.0 kB/s 2024-04-26T23:32:10.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:10.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:10.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:10.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:10.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:10.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149365 s, 0.0 kB/s 2024-04-26T23:32:10.998 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:10.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149539 s, 0.0 kB/s 2024-04-26T23:32:11.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.206 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.206 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014479 s, 0.0 kB/s 2024-04-26T23:32:11.207 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.207 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.260 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.313 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157362 s, 0.0 kB/s 2024-04-26T23:32:11.314 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.314 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150568 s, 0.0 kB/s 2024-04-26T23:32:11.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.418 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.521 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.521 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151113 s, 0.0 kB/s 2024-04-26T23:32:11.522 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.523 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.572 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.625 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145043 s, 0.0 kB/s 2024-04-26T23:32:11.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.626 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.680 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.733 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145633 s, 0.0 kB/s 2024-04-26T23:32:11.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157824 s, 0.0 kB/s 2024-04-26T23:32:11.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:11.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:11.897 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:11.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:11.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:11.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147863 s, 0.0 kB/s 2024-04-26T23:32:11.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:11.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.001 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000171892 s, 0.0 kB/s 2024-04-26T23:32:12.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146213 s, 0.0 kB/s 2024-04-26T23:32:12.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.182 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014459 s, 0.0 kB/s 2024-04-26T23:32:12.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.339 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151051 s, 0.0 kB/s 2024-04-26T23:32:12.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.444 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142779 s, 0.0 kB/s 2024-04-26T23:32:12.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.498 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153693 s, 0.0 kB/s 2024-04-26T23:32:12.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.713 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146521 s, 0.0 kB/s 2024-04-26T23:32:12.715 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.715 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.775 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147459 s, 0.0 kB/s 2024-04-26T23:32:12.840 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.840 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:12.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:12.898 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145747 s, 0.0 kB/s 2024-04-26T23:32:12.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:12.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.020 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.076 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149861 s, 0.0 kB/s 2024-04-26T23:32:13.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.142 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.196 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.196 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.197 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146345 s, 0.0 kB/s 2024-04-26T23:32:13.198 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.198 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.319 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.319 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.319 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141253 s, 0.0 kB/s 2024-04-26T23:32:13.320 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.320 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.377 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.431 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.431 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.431 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140883 s, 0.0 kB/s 2024-04-26T23:32:13.432 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.433 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.484 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.537 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.537 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.537 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137762 s, 0.0 kB/s 2024-04-26T23:32:13.538 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.539 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.642 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014489 s, 0.0 kB/s 2024-04-26T23:32:13.643 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.643 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.749 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147031 s, 0.0 kB/s 2024-04-26T23:32:13.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.750 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.806 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.858 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153632 s, 0.0 kB/s 2024-04-26T23:32:13.859 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.859 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:13.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:13.912 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156929 s, 0.0 kB/s 2024-04-26T23:32:13.967 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:13.967 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.020 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014973 s, 0.0 kB/s 2024-04-26T23:32:14.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.074 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147064 s, 0.0 kB/s 2024-04-26T23:32:14.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.187 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150508 s, 0.0 kB/s 2024-04-26T23:32:14.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014883 s, 0.0 kB/s 2024-04-26T23:32:14.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.402 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.452 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.506 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148117 s, 0.0 kB/s 2024-04-26T23:32:14.507 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.507 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.557 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.613 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143629 s, 0.0 kB/s 2024-04-26T23:32:14.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.614 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.664 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145653 s, 0.0 kB/s 2024-04-26T23:32:14.719 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.719 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.768 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.822 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.822 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148646 s, 0.0 kB/s 2024-04-26T23:32:14.823 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:14.925 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:14.926 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:14.926 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146865 s, 0.0 kB/s 2024-04-26T23:32:14.927 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:14.927 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:14.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015117 s, 0.0 kB/s 2024-04-26T23:32:15.031 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.085 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153756 s, 0.0 kB/s 2024-04-26T23:32:15.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150757 s, 0.0 kB/s 2024-04-26T23:32:15.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015134 s, 0.0 kB/s 2024-04-26T23:32:15.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.404 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.457 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147509 s, 0.0 kB/s 2024-04-26T23:32:15.458 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.458 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.508 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152991 s, 0.0 kB/s 2024-04-26T23:32:15.569 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.569 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.624 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145366 s, 0.0 kB/s 2024-04-26T23:32:15.682 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.682 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152984 s, 0.0 kB/s 2024-04-26T23:32:15.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.794 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143495 s, 0.0 kB/s 2024-04-26T23:32:15.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:15.898 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:15.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:15.953 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144531 s, 0.0 kB/s 2024-04-26T23:32:16.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150712 s, 0.0 kB/s 2024-04-26T23:32:16.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.160 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149321 s, 0.0 kB/s 2024-04-26T23:32:16.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148529 s, 0.0 kB/s 2024-04-26T23:32:16.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.326 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144944 s, 0.0 kB/s 2024-04-26T23:32:16.434 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.434 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.484 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.542 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.542 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148267 s, 0.0 kB/s 2024-04-26T23:32:16.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.596 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.649 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147952 s, 0.0 kB/s 2024-04-26T23:32:16.650 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.650 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143351 s, 0.0 kB/s 2024-04-26T23:32:16.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.804 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.857 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148439 s, 0.0 kB/s 2024-04-26T23:32:16.858 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.858 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:16.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:16.908 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:16.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:16.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:16.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142711 s, 0.0 kB/s 2024-04-26T23:32:16.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:16.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.014 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014511 s, 0.0 kB/s 2024-04-26T23:32:17.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140578 s, 0.0 kB/s 2024-04-26T23:32:17.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141731 s, 0.0 kB/s 2024-04-26T23:32:17.277 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.277 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.380 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131933 s, 0.0 kB/s 2024-04-26T23:32:17.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.488 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131845 s, 0.0 kB/s 2024-04-26T23:32:17.489 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.489 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.540 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000164697 s, 0.0 kB/s 2024-04-26T23:32:17.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130288 s, 0.0 kB/s 2024-04-26T23:32:17.697 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.697 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.809 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.809 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.809 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136037 s, 0.0 kB/s 2024-04-26T23:32:17.810 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.810 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:17.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:17.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:17.920 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131802 s, 0.0 kB/s 2024-04-26T23:32:17.921 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:17.921 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:17.972 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.024 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136141 s, 0.0 kB/s 2024-04-26T23:32:18.025 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.025 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.118 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.132 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.132 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.132 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133902 s, 0.0 kB/s 2024-04-26T23:32:18.133 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.133 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.188 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133191 s, 0.0 kB/s 2024-04-26T23:32:18.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.295 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.348 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133662 s, 0.0 kB/s 2024-04-26T23:32:18.349 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.350 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129813 s, 0.0 kB/s 2024-04-26T23:32:18.457 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.457 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.508 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135464 s, 0.0 kB/s 2024-04-26T23:32:18.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.616 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143978 s, 0.0 kB/s 2024-04-26T23:32:18.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.675 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.727 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.784 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.785 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127936 s, 0.0 kB/s 2024-04-26T23:32:18.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.835 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.892 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124581 s, 0.0 kB/s 2024-04-26T23:32:18.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:18.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:18.943 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:18.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:18.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:18.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131377 s, 0.0 kB/s 2024-04-26T23:32:18.997 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:18.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131307 s, 0.0 kB/s 2024-04-26T23:32:19.106 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.106 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.156 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130218 s, 0.0 kB/s 2024-04-26T23:32:19.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.316 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.316 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134174 s, 0.0 kB/s 2024-04-26T23:32:19.317 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.424 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131276 s, 0.0 kB/s 2024-04-26T23:32:19.425 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.425 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139645 s, 0.0 kB/s 2024-04-26T23:32:19.537 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.538 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.587 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129642 s, 0.0 kB/s 2024-04-26T23:32:19.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.691 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132186 s, 0.0 kB/s 2024-04-26T23:32:19.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.799 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140548 s, 0.0 kB/s 2024-04-26T23:32:19.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:19.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:19.903 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131355 s, 0.0 kB/s 2024-04-26T23:32:19.957 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:19.957 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.007 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001344 s, 0.0 kB/s 2024-04-26T23:32:20.061 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.061 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.111 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134253 s, 0.0 kB/s 2024-04-26T23:32:20.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.219 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.272 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.272 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133089 s, 0.0 kB/s 2024-04-26T23:32:20.273 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140506 s, 0.0 kB/s 2024-04-26T23:32:20.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.484 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.484 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.484 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144913 s, 0.0 kB/s 2024-04-26T23:32:20.485 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.485 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154198 s, 0.0 kB/s 2024-04-26T23:32:20.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.640 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014326 s, 0.0 kB/s 2024-04-26T23:32:20.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.694 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145837 s, 0.0 kB/s 2024-04-26T23:32:20.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:20.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:20.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:20.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014304 s, 0.0 kB/s 2024-04-26T23:32:20.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:20.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:20.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:20.952 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149307 s, 0.0 kB/s 2024-04-26T23:32:21.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.060 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146239 s, 0.0 kB/s 2024-04-26T23:32:21.114 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.114 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.218 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.218 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.218 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157288 s, 0.0 kB/s 2024-04-26T23:32:21.219 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.219 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150111 s, 0.0 kB/s 2024-04-26T23:32:21.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.326 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149326 s, 0.0 kB/s 2024-04-26T23:32:21.429 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.480 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141503 s, 0.0 kB/s 2024-04-26T23:32:21.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.636 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140169 s, 0.0 kB/s 2024-04-26T23:32:21.637 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.637 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.691 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149543 s, 0.0 kB/s 2024-04-26T23:32:21.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.796 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140387 s, 0.0 kB/s 2024-04-26T23:32:21.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:21.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:21.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:21.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:21.954 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135375 s, 0.0 kB/s 2024-04-26T23:32:21.956 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:21.956 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.010 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144727 s, 0.0 kB/s 2024-04-26T23:32:22.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148122 s, 0.0 kB/s 2024-04-26T23:32:22.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148293 s, 0.0 kB/s 2024-04-26T23:32:22.271 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143159 s, 0.0 kB/s 2024-04-26T23:32:22.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.383 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151319 s, 0.0 kB/s 2024-04-26T23:32:22.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145727 s, 0.0 kB/s 2024-04-26T23:32:22.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145765 s, 0.0 kB/s 2024-04-26T23:32:22.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.748 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150309 s, 0.0 kB/s 2024-04-26T23:32:22.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:22.915 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:22.915 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:22.915 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145023 s, 0.0 kB/s 2024-04-26T23:32:22.915 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:22.915 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:22.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:22.968 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.025 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146277 s, 0.0 kB/s 2024-04-26T23:32:23.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.026 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.080 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152976 s, 0.0 kB/s 2024-04-26T23:32:23.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.247 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.247 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144485 s, 0.0 kB/s 2024-04-26T23:32:23.248 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.248 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143759 s, 0.0 kB/s 2024-04-26T23:32:23.368 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.368 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.482 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014973 s, 0.0 kB/s 2024-04-26T23:32:23.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.483 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.538 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146581 s, 0.0 kB/s 2024-04-26T23:32:23.596 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.596 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.650 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142981 s, 0.0 kB/s 2024-04-26T23:32:23.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.767 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.827 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.827 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154658 s, 0.0 kB/s 2024-04-26T23:32:23.828 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.828 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.883 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:23.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:23.938 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:23.938 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154434 s, 0.0 kB/s 2024-04-26T23:32:23.939 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:23.939 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:23.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:23.992 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.050 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.051 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146966 s, 0.0 kB/s 2024-04-26T23:32:24.051 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.052 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.104 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146078 s, 0.0 kB/s 2024-04-26T23:32:24.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.158 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.208 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145207 s, 0.0 kB/s 2024-04-26T23:32:24.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.370 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.370 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015372 s, 0.0 kB/s 2024-04-26T23:32:24.371 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.371 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.420 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.473 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150579 s, 0.0 kB/s 2024-04-26T23:32:24.474 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.474 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.524 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150366 s, 0.0 kB/s 2024-04-26T23:32:24.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014718 s, 0.0 kB/s 2024-04-26T23:32:24.683 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152263 s, 0.0 kB/s 2024-04-26T23:32:24.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.790 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148335 s, 0.0 kB/s 2024-04-26T23:32:24.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:24.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:24.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:24.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158035 s, 0.0 kB/s 2024-04-26T23:32:24.999 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:24.999 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.052 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149243 s, 0.0 kB/s 2024-04-26T23:32:25.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148302 s, 0.0 kB/s 2024-04-26T23:32:25.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145224 s, 0.0 kB/s 2024-04-26T23:32:25.322 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.322 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.434 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.434 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146376 s, 0.0 kB/s 2024-04-26T23:32:25.435 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.435 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146428 s, 0.0 kB/s 2024-04-26T23:32:25.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.592 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014482 s, 0.0 kB/s 2024-04-26T23:32:25.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.646 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.749 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145869 s, 0.0 kB/s 2024-04-26T23:32:25.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.750 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.805 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.858 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.858 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151541 s, 0.0 kB/s 2024-04-26T23:32:25.859 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.859 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:25.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:25.912 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:25.964 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:25.964 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:25.965 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138026 s, 0.0 kB/s 2024-04-26T23:32:25.965 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:25.965 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.016 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.069 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.070 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.070 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151579 s, 0.0 kB/s 2024-04-26T23:32:26.071 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.071 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.124 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000163888 s, 0.0 kB/s 2024-04-26T23:32:26.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.182 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150648 s, 0.0 kB/s 2024-04-26T23:32:26.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.341 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.392 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146253 s, 0.0 kB/s 2024-04-26T23:32:26.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.444 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001503 s, 0.0 kB/s 2024-04-26T23:32:26.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.498 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147111 s, 0.0 kB/s 2024-04-26T23:32:26.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.660 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.712 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.713 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148268 s, 0.0 kB/s 2024-04-26T23:32:26.714 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.714 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.769 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.821 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014518 s, 0.0 kB/s 2024-04-26T23:32:26.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.822 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:26.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:26.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:26.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152656 s, 0.0 kB/s 2024-04-26T23:32:26.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:26.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:26.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:26.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147857 s, 0.0 kB/s 2024-04-26T23:32:27.034 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.034 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.138 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.138 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149456 s, 0.0 kB/s 2024-04-26T23:32:27.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.139 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132498 s, 0.0 kB/s 2024-04-26T23:32:27.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137877 s, 0.0 kB/s 2024-04-26T23:32:27.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.404 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.456 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.457 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.457 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143309 s, 0.0 kB/s 2024-04-26T23:32:27.458 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.458 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.512 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.564 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000194576 s, 0.0 kB/s 2024-04-26T23:32:27.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.616 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.669 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141648 s, 0.0 kB/s 2024-04-26T23:32:27.670 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.670 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.720 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.777 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135403 s, 0.0 kB/s 2024-04-26T23:32:27.778 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.778 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.835 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.885 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137331 s, 0.0 kB/s 2024-04-26T23:32:27.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:27.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:27.936 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:27.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:27.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:27.989 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013749 s, 0.0 kB/s 2024-04-26T23:32:27.989 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:27.990 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.040 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.092 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147334 s, 0.0 kB/s 2024-04-26T23:32:28.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000170203 s, 0.0 kB/s 2024-04-26T23:32:28.199 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.199 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.252 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143388 s, 0.0 kB/s 2024-04-26T23:32:28.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152281 s, 0.0 kB/s 2024-04-26T23:32:28.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146579 s, 0.0 kB/s 2024-04-26T23:32:28.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.576 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.629 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144094 s, 0.0 kB/s 2024-04-26T23:32:28.630 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.630 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.680 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.732 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.733 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.733 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147068 s, 0.0 kB/s 2024-04-26T23:32:28.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.784 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144847 s, 0.0 kB/s 2024-04-26T23:32:28.838 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.838 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.888 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:28.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:28.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:28.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148377 s, 0.0 kB/s 2024-04-26T23:32:28.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:28.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:28.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:28.996 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.048 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.049 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.049 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141402 s, 0.0 kB/s 2024-04-26T23:32:29.050 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.050 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.104 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149827 s, 0.0 kB/s 2024-04-26T23:32:29.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.208 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.262 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143441 s, 0.0 kB/s 2024-04-26T23:32:29.263 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.317 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147719 s, 0.0 kB/s 2024-04-26T23:32:29.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.420 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.479 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.479 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.479 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000165268 s, 0.0 kB/s 2024-04-26T23:32:29.480 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.481 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.584 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.584 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.584 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146456 s, 0.0 kB/s 2024-04-26T23:32:29.585 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014285 s, 0.0 kB/s 2024-04-26T23:32:29.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.694 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.752 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.810 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.810 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156825 s, 0.0 kB/s 2024-04-26T23:32:29.811 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.811 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:29.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:29.917 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:29.917 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144473 s, 0.0 kB/s 2024-04-26T23:32:29.918 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:29.918 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:29.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:29.968 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142798 s, 0.0 kB/s 2024-04-26T23:32:30.022 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.022 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.071 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.125 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.125 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153916 s, 0.0 kB/s 2024-04-26T23:32:30.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.126 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.176 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156487 s, 0.0 kB/s 2024-04-26T23:32:30.230 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.280 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.333 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144488 s, 0.0 kB/s 2024-04-26T23:32:30.334 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.440 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137513 s, 0.0 kB/s 2024-04-26T23:32:30.441 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.441 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.495 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.548 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137118 s, 0.0 kB/s 2024-04-26T23:32:30.549 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.600 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132943 s, 0.0 kB/s 2024-04-26T23:32:30.653 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.653 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.703 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.757 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137567 s, 0.0 kB/s 2024-04-26T23:32:30.757 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.758 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.807 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.860 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.860 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.860 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136723 s, 0.0 kB/s 2024-04-26T23:32:30.861 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.861 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:30.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:30.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:30.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:30.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:30.969 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135772 s, 0.0 kB/s 2024-04-26T23:32:30.970 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:30.970 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.023 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139833 s, 0.0 kB/s 2024-04-26T23:32:31.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.188 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.188 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.189 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133608 s, 0.0 kB/s 2024-04-26T23:32:31.189 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.190 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.292 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131525 s, 0.0 kB/s 2024-04-26T23:32:31.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.344 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.400 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.400 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.400 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128229 s, 0.0 kB/s 2024-04-26T23:32:31.401 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.401 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.451 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.508 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.508 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.508 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131753 s, 0.0 kB/s 2024-04-26T23:32:31.509 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.509 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.559 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.612 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.612 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.612 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134822 s, 0.0 kB/s 2024-04-26T23:32:31.613 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.613 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.668 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.722 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.722 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140639 s, 0.0 kB/s 2024-04-26T23:32:31.722 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.722 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.776 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146926 s, 0.0 kB/s 2024-04-26T23:32:31.834 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.835 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144516 s, 0.0 kB/s 2024-04-26T23:32:31.942 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:31.942 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:31.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:31.992 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.047 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.047 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.047 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000159744 s, 0.0 kB/s 2024-04-26T23:32:32.048 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.048 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.101 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.158 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014762 s, 0.0 kB/s 2024-04-26T23:32:32.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148414 s, 0.0 kB/s 2024-04-26T23:32:32.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.376 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138096 s, 0.0 kB/s 2024-04-26T23:32:32.377 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.377 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.427 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142391 s, 0.0 kB/s 2024-04-26T23:32:32.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.588 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.588 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.588 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142429 s, 0.0 kB/s 2024-04-26T23:32:32.589 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.589 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.696 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.696 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143066 s, 0.0 kB/s 2024-04-26T23:32:32.697 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.748 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143586 s, 0.0 kB/s 2024-04-26T23:32:32.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:32.904 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:32.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:32.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148311 s, 0.0 kB/s 2024-04-26T23:32:32.905 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:32.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:32.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:32.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149108 s, 0.0 kB/s 2024-04-26T23:32:33.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.060 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148244 s, 0.0 kB/s 2024-04-26T23:32:33.113 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.113 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.225 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.225 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.225 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141808 s, 0.0 kB/s 2024-04-26T23:32:33.227 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.227 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.280 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.336 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013468 s, 0.0 kB/s 2024-04-26T23:32:33.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.338 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.441 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.441 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137338 s, 0.0 kB/s 2024-04-26T23:32:33.442 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.442 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.492 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.545 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.545 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140079 s, 0.0 kB/s 2024-04-26T23:32:33.546 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.546 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.596 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.648 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.649 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.649 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145178 s, 0.0 kB/s 2024-04-26T23:32:33.650 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.650 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.704 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149769 s, 0.0 kB/s 2024-04-26T23:32:33.758 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.762 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.808 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.862 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154461 s, 0.0 kB/s 2024-04-26T23:32:33.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.863 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:33.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:33.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143441 s, 0.0 kB/s 2024-04-26T23:32:33.973 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:33.973 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.024 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146638 s, 0.0 kB/s 2024-04-26T23:32:34.082 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149768 s, 0.0 kB/s 2024-04-26T23:32:34.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154569 s, 0.0 kB/s 2024-04-26T23:32:34.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151679 s, 0.0 kB/s 2024-04-26T23:32:34.397 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.398 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.452 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147359 s, 0.0 kB/s 2024-04-26T23:32:34.510 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.510 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.564 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149478 s, 0.0 kB/s 2024-04-26T23:32:34.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.676 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152632 s, 0.0 kB/s 2024-04-26T23:32:34.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.730 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.783 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.841 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014813 s, 0.0 kB/s 2024-04-26T23:32:34.842 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.842 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:34.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:34.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153377 s, 0.0 kB/s 2024-04-26T23:32:34.949 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:34.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.058 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.058 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015066 s, 0.0 kB/s 2024-04-26T23:32:35.059 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.059 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.108 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150782 s, 0.0 kB/s 2024-04-26T23:32:35.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151636 s, 0.0 kB/s 2024-04-26T23:32:35.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151599 s, 0.0 kB/s 2024-04-26T23:32:35.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147671 s, 0.0 kB/s 2024-04-26T23:32:35.489 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.489 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.599 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.599 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.599 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142333 s, 0.0 kB/s 2024-04-26T23:32:35.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142515 s, 0.0 kB/s 2024-04-26T23:32:35.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.764 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.819 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.819 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.819 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015236 s, 0.0 kB/s 2024-04-26T23:32:35.820 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.820 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:35.932 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:35.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:35.933 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143022 s, 0.0 kB/s 2024-04-26T23:32:35.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:35.934 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:35.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:35.988 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149851 s, 0.0 kB/s 2024-04-26T23:32:36.046 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.046 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.096 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.153 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.153 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.153 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150628 s, 0.0 kB/s 2024-04-26T23:32:36.154 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.154 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.211 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149284 s, 0.0 kB/s 2024-04-26T23:32:36.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146528 s, 0.0 kB/s 2024-04-26T23:32:36.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145218 s, 0.0 kB/s 2024-04-26T23:32:36.491 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.491 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148891 s, 0.0 kB/s 2024-04-26T23:32:36.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148706 s, 0.0 kB/s 2024-04-26T23:32:36.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.760 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153153 s, 0.0 kB/s 2024-04-26T23:32:36.815 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.816 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:36.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:36.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:36.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147404 s, 0.0 kB/s 2024-04-26T23:32:36.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:36.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:36.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:36.972 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.025 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148529 s, 0.0 kB/s 2024-04-26T23:32:37.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.026 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.076 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.129 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149743 s, 0.0 kB/s 2024-04-26T23:32:37.130 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.130 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.184 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.240 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.240 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.240 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151554 s, 0.0 kB/s 2024-04-26T23:32:37.241 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.241 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.292 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150374 s, 0.0 kB/s 2024-04-26T23:32:37.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.396 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.453 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147981 s, 0.0 kB/s 2024-04-26T23:32:37.454 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.454 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.504 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139017 s, 0.0 kB/s 2024-04-26T23:32:37.557 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.608 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.662 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143307 s, 0.0 kB/s 2024-04-26T23:32:37.663 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.663 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.716 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152471 s, 0.0 kB/s 2024-04-26T23:32:37.770 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.770 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.820 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147552 s, 0.0 kB/s 2024-04-26T23:32:37.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:37.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:37.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:37.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:37.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:37.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146759 s, 0.0 kB/s 2024-04-26T23:32:37.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:37.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.027 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.080 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151093 s, 0.0 kB/s 2024-04-26T23:32:38.081 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.195 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.196 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000280342 s, 0.0 kB/s 2024-04-26T23:32:38.197 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.197 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.252 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.304 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.305 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140116 s, 0.0 kB/s 2024-04-26T23:32:38.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.360 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142046 s, 0.0 kB/s 2024-04-26T23:32:38.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.469 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138529 s, 0.0 kB/s 2024-04-26T23:32:38.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.527 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138098 s, 0.0 kB/s 2024-04-26T23:32:38.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.634 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.684 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141832 s, 0.0 kB/s 2024-04-26T23:32:38.743 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.743 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.800 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.864 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.865 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139829 s, 0.0 kB/s 2024-04-26T23:32:38.865 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.866 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:38.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:38.930 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140476 s, 0.0 kB/s 2024-04-26T23:32:38.981 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:38.981 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.034 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.086 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140143 s, 0.0 kB/s 2024-04-26T23:32:39.087 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.087 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.205 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.205 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150195 s, 0.0 kB/s 2024-04-26T23:32:39.205 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.205 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.260 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.318 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.318 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146839 s, 0.0 kB/s 2024-04-26T23:32:39.319 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.319 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:32:39.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:32:39.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145187 s, 0.0 kB/s 2024-04-26T23:32:39.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.576 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138675 s, 0.0 kB/s 2024-04-26T23:32:39.577 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.577 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.684 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137359 s, 0.0 kB/s 2024-04-26T23:32:39.685 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.685 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.735 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.788 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.788 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138583 s, 0.0 kB/s 2024-04-26T23:32:39.789 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.789 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147188 s, 0.0 kB/s 2024-04-26T23:32:39.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:39.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:39.943 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:39.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144188 s, 0.0 kB/s 2024-04-26T23:32:39.997 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:39.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.052 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.105 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142448 s, 0.0 kB/s 2024-04-26T23:32:40.106 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.106 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.156 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139506 s, 0.0 kB/s 2024-04-26T23:32:40.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154169 s, 0.0 kB/s 2024-04-26T23:32:40.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151775 s, 0.0 kB/s 2024-04-26T23:32:40.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.484 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151637 s, 0.0 kB/s 2024-04-26T23:32:40.543 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.653 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.653 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144612 s, 0.0 kB/s 2024-04-26T23:32:40.654 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.654 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.765 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.765 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148007 s, 0.0 kB/s 2024-04-26T23:32:40.766 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.766 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.816 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146538 s, 0.0 kB/s 2024-04-26T23:32:40.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:40.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:40.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:40.981 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:40.981 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:40.981 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147601 s, 0.0 kB/s 2024-04-26T23:32:40.982 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:40.982 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.036 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145804 s, 0.0 kB/s 2024-04-26T23:32:41.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.144 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.197 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.197 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146624 s, 0.0 kB/s 2024-04-26T23:32:41.198 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.198 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.252 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.304 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.305 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.305 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140879 s, 0.0 kB/s 2024-04-26T23:32:41.306 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.306 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.356 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.412 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.413 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014395 s, 0.0 kB/s 2024-04-26T23:32:41.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.414 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.468 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139948 s, 0.0 kB/s 2024-04-26T23:32:41.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.575 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.628 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.629 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.629 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139942 s, 0.0 kB/s 2024-04-26T23:32:41.630 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.630 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.680 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.736 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143549 s, 0.0 kB/s 2024-04-26T23:32:41.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.788 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152965 s, 0.0 kB/s 2024-04-26T23:32:41.842 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.842 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:41.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:41.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:41.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:41.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:41.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150168 s, 0.0 kB/s 2024-04-26T23:32:41.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:41.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.062 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151613 s, 0.0 kB/s 2024-04-26T23:32:42.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145033 s, 0.0 kB/s 2024-04-26T23:32:42.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140809 s, 0.0 kB/s 2024-04-26T23:32:42.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.380 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143248 s, 0.0 kB/s 2024-04-26T23:32:42.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142135 s, 0.0 kB/s 2024-04-26T23:32:42.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142596 s, 0.0 kB/s 2024-04-26T23:32:42.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145409 s, 0.0 kB/s 2024-04-26T23:32:42.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.694 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.746 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147604 s, 0.0 kB/s 2024-04-26T23:32:42.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147098 s, 0.0 kB/s 2024-04-26T23:32:42.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:42.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:42.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:42.952 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000171776 s, 0.0 kB/s 2024-04-26T23:32:43.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.007 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149856 s, 0.0 kB/s 2024-04-26T23:32:43.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.111 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.165 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144189 s, 0.0 kB/s 2024-04-26T23:32:43.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135432 s, 0.0 kB/s 2024-04-26T23:32:43.321 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.322 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.375 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.428 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133482 s, 0.0 kB/s 2024-04-26T23:32:43.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.483 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.536 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.536 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.537 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135766 s, 0.0 kB/s 2024-04-26T23:32:43.537 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.537 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140739 s, 0.0 kB/s 2024-04-26T23:32:43.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.691 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139363 s, 0.0 kB/s 2024-04-26T23:32:43.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.796 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141509 s, 0.0 kB/s 2024-04-26T23:32:43.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:43.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:43.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:43.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:43.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:43.952 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013676 s, 0.0 kB/s 2024-04-26T23:32:43.953 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:43.953 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.003 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143914 s, 0.0 kB/s 2024-04-26T23:32:44.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.108 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.164 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143874 s, 0.0 kB/s 2024-04-26T23:32:44.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149659 s, 0.0 kB/s 2024-04-26T23:32:44.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.320 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.374 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.374 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148525 s, 0.0 kB/s 2024-04-26T23:32:44.375 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.375 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.486 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.486 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143944 s, 0.0 kB/s 2024-04-26T23:32:44.487 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.487 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.540 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.594 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.594 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149696 s, 0.0 kB/s 2024-04-26T23:32:44.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.705 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.705 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015013 s, 0.0 kB/s 2024-04-26T23:32:44.706 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.706 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.760 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.813 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146699 s, 0.0 kB/s 2024-04-26T23:32:44.814 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.814 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:44.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:44.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:44.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145095 s, 0.0 kB/s 2024-04-26T23:32:44.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:44.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:44.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:44.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015448 s, 0.0 kB/s 2024-04-26T23:32:45.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.031 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.083 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.137 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.137 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139008 s, 0.0 kB/s 2024-04-26T23:32:45.138 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.138 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145887 s, 0.0 kB/s 2024-04-26T23:32:45.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.353 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.353 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153059 s, 0.0 kB/s 2024-04-26T23:32:45.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143614 s, 0.0 kB/s 2024-04-26T23:32:45.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146964 s, 0.0 kB/s 2024-04-26T23:32:45.574 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.681 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.681 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158616 s, 0.0 kB/s 2024-04-26T23:32:45.683 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.683 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.732 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149751 s, 0.0 kB/s 2024-04-26T23:32:45.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.790 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147216 s, 0.0 kB/s 2024-04-26T23:32:45.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:45.898 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:45.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:45.948 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.000 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.000 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150224 s, 0.0 kB/s 2024-04-26T23:32:46.001 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.001 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.051 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.104 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.105 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148088 s, 0.0 kB/s 2024-04-26T23:32:46.105 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.105 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.155 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139209 s, 0.0 kB/s 2024-04-26T23:32:46.213 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.213 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.263 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144535 s, 0.0 kB/s 2024-04-26T23:32:46.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153442 s, 0.0 kB/s 2024-04-26T23:32:46.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154365 s, 0.0 kB/s 2024-04-26T23:32:46.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.531 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014685 s, 0.0 kB/s 2024-04-26T23:32:46.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152962 s, 0.0 kB/s 2024-04-26T23:32:46.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149116 s, 0.0 kB/s 2024-04-26T23:32:46.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.846 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:46.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:46.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:46.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:46.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:46.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145078 s, 0.0 kB/s 2024-04-26T23:32:46.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:46.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.003 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.056 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152525 s, 0.0 kB/s 2024-04-26T23:32:47.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.108 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144164 s, 0.0 kB/s 2024-04-26T23:32:47.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152798 s, 0.0 kB/s 2024-04-26T23:32:47.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155482 s, 0.0 kB/s 2024-04-26T23:32:47.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.420 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147729 s, 0.0 kB/s 2024-04-26T23:32:47.478 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148158 s, 0.0 kB/s 2024-04-26T23:32:47.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149813 s, 0.0 kB/s 2024-04-26T23:32:47.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149327 s, 0.0 kB/s 2024-04-26T23:32:47.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.794 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141311 s, 0.0 kB/s 2024-04-26T23:32:47.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:47.898 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:47.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:47.948 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.005 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.005 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144503 s, 0.0 kB/s 2024-04-26T23:32:48.006 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.006 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.062 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143142 s, 0.0 kB/s 2024-04-26T23:32:48.114 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.114 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.216 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014199 s, 0.0 kB/s 2024-04-26T23:32:48.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132452 s, 0.0 kB/s 2024-04-26T23:32:48.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.326 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.375 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131734 s, 0.0 kB/s 2024-04-26T23:32:48.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.480 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131886 s, 0.0 kB/s 2024-04-26T23:32:48.533 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132581 s, 0.0 kB/s 2024-04-26T23:32:48.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.691 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138635 s, 0.0 kB/s 2024-04-26T23:32:48.747 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.747 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.804 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137132 s, 0.0 kB/s 2024-04-26T23:32:48.863 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.863 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:48.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:48.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:48.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:48.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:48.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143189 s, 0.0 kB/s 2024-04-26T23:32:48.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:48.974 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.025 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145464 s, 0.0 kB/s 2024-04-26T23:32:49.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.083 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.136 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143849 s, 0.0 kB/s 2024-04-26T23:32:49.195 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.195 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.252 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.309 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.309 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141928 s, 0.0 kB/s 2024-04-26T23:32:49.310 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.310 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.416 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139559 s, 0.0 kB/s 2024-04-26T23:32:49.417 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.417 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138389 s, 0.0 kB/s 2024-04-26T23:32:49.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.641 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.641 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136745 s, 0.0 kB/s 2024-04-26T23:32:49.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.752 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143365 s, 0.0 kB/s 2024-04-26T23:32:49.753 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.808 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142853 s, 0.0 kB/s 2024-04-26T23:32:49.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:49.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:49.912 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:49.964 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:49.964 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:49.964 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134602 s, 0.0 kB/s 2024-04-26T23:32:49.965 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:49.965 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.016 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.068 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133004 s, 0.0 kB/s 2024-04-26T23:32:50.069 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.069 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.119 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.176 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128194 s, 0.0 kB/s 2024-04-26T23:32:50.177 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.177 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.227 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.281 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128622 s, 0.0 kB/s 2024-04-26T23:32:50.281 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.281 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.331 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.387 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126133 s, 0.0 kB/s 2024-04-26T23:32:50.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.389 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.439 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.491 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.491 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.491 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130111 s, 0.0 kB/s 2024-04-26T23:32:50.492 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.492 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.596 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129754 s, 0.0 kB/s 2024-04-26T23:32:50.597 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.597 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.648 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.699 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.699 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.700 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012195 s, 0.0 kB/s 2024-04-26T23:32:50.700 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.701 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.808 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.808 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.808 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012517 s, 0.0 kB/s 2024-04-26T23:32:50.810 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.810 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.859 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124117 s, 0.0 kB/s 2024-04-26T23:32:50.913 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:50.913 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:50.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:50.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.015 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.015 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.016 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124799 s, 0.0 kB/s 2024-04-26T23:32:51.016 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.017 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.071 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.128 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.128 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.128 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133487 s, 0.0 kB/s 2024-04-26T23:32:51.129 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.129 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.179 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.235 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.236 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.236 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131837 s, 0.0 kB/s 2024-04-26T23:32:51.237 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.237 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.288 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136757 s, 0.0 kB/s 2024-04-26T23:32:51.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.396 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.448 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.448 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.449 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138692 s, 0.0 kB/s 2024-04-26T23:32:51.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.499 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.552 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.553 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139608 s, 0.0 kB/s 2024-04-26T23:32:51.554 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.554 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.604 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.657 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.657 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144305 s, 0.0 kB/s 2024-04-26T23:32:51.658 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.658 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146552 s, 0.0 kB/s 2024-04-26T23:32:51.762 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.763 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.816 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149965 s, 0.0 kB/s 2024-04-26T23:32:51.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:51.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:51.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:51.976 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:51.977 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:51.977 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152768 s, 0.0 kB/s 2024-04-26T23:32:51.978 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:51.978 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.032 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.085 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.086 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015169 s, 0.0 kB/s 2024-04-26T23:32:52.086 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.086 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.136 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.189 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.189 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154001 s, 0.0 kB/s 2024-04-26T23:32:52.190 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.190 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.294 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157144 s, 0.0 kB/s 2024-04-26T23:32:52.295 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.295 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146969 s, 0.0 kB/s 2024-04-26T23:32:52.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.402 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.452 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.505 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.505 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143735 s, 0.0 kB/s 2024-04-26T23:32:52.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.506 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.556 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151686 s, 0.0 kB/s 2024-04-26T23:32:52.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.664 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.721 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.721 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148231 s, 0.0 kB/s 2024-04-26T23:32:52.722 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.722 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.772 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.825 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147685 s, 0.0 kB/s 2024-04-26T23:32:52.826 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.826 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:52.928 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:52.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:52.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153489 s, 0.0 kB/s 2024-04-26T23:32:52.929 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:52.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:52.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:52.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.036 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150534 s, 0.0 kB/s 2024-04-26T23:32:53.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.038 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.092 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.145 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.145 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.145 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149717 s, 0.0 kB/s 2024-04-26T23:32:53.146 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.146 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.200 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151549 s, 0.0 kB/s 2024-04-26T23:32:53.254 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.254 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.303 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.356 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145108 s, 0.0 kB/s 2024-04-26T23:32:53.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.357 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.464 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.464 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.464 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139025 s, 0.0 kB/s 2024-04-26T23:32:53.465 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.465 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.572 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000162384 s, 0.0 kB/s 2024-04-26T23:32:53.573 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.573 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145774 s, 0.0 kB/s 2024-04-26T23:32:53.686 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.686 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.736 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.789 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.789 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148163 s, 0.0 kB/s 2024-04-26T23:32:53.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.790 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.841 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:53.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:53.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:53.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146628 s, 0.0 kB/s 2024-04-26T23:32:53.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:53.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:53.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:53.948 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.001 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.001 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.001 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151337 s, 0.0 kB/s 2024-04-26T23:32:54.002 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.002 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.056 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144981 s, 0.0 kB/s 2024-04-26T23:32:54.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.160 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146983 s, 0.0 kB/s 2024-04-26T23:32:54.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.214 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.316 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.316 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154493 s, 0.0 kB/s 2024-04-26T23:32:54.317 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.317 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001481 s, 0.0 kB/s 2024-04-26T23:32:54.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000168166 s, 0.0 kB/s 2024-04-26T23:32:54.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.580 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148051 s, 0.0 kB/s 2024-04-26T23:32:54.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148389 s, 0.0 kB/s 2024-04-26T23:32:54.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.750 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.800 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149313 s, 0.0 kB/s 2024-04-26T23:32:54.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:54.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:54.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014997 s, 0.0 kB/s 2024-04-26T23:32:54.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:54.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150176 s, 0.0 kB/s 2024-04-26T23:32:55.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.116 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150538 s, 0.0 kB/s 2024-04-26T23:32:55.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.220 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015001 s, 0.0 kB/s 2024-04-26T23:32:55.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146906 s, 0.0 kB/s 2024-04-26T23:32:55.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.438 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.493 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.493 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146873 s, 0.0 kB/s 2024-04-26T23:32:55.494 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.495 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.602 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148599 s, 0.0 kB/s 2024-04-26T23:32:55.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.603 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.656 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145601 s, 0.0 kB/s 2024-04-26T23:32:55.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.814 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.814 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156957 s, 0.0 kB/s 2024-04-26T23:32:55.815 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.815 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151718 s, 0.0 kB/s 2024-04-26T23:32:55.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:55.931 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:55.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:55.984 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.041 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.042 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150467 s, 0.0 kB/s 2024-04-26T23:32:56.043 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.043 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.096 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146599 s, 0.0 kB/s 2024-04-26T23:32:56.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.150 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.200 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.254 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.254 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148213 s, 0.0 kB/s 2024-04-26T23:32:56.254 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.254 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.365 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148736 s, 0.0 kB/s 2024-04-26T23:32:56.366 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.366 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.416 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.472 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.473 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.473 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148478 s, 0.0 kB/s 2024-04-26T23:32:56.474 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.474 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.528 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151282 s, 0.0 kB/s 2024-04-26T23:32:56.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144726 s, 0.0 kB/s 2024-04-26T23:32:56.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.694 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014849 s, 0.0 kB/s 2024-04-26T23:32:56.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:56.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:56.909 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:56.909 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151061 s, 0.0 kB/s 2024-04-26T23:32:56.910 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:56.910 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:56.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:56.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.018 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.018 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015321 s, 0.0 kB/s 2024-04-26T23:32:57.019 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.019 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.076 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.130 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153767 s, 0.0 kB/s 2024-04-26T23:32:57.131 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.131 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.184 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.238 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.238 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152746 s, 0.0 kB/s 2024-04-26T23:32:57.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.240 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.293 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147791 s, 0.0 kB/s 2024-04-26T23:32:57.347 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.347 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.404 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.461 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148365 s, 0.0 kB/s 2024-04-26T23:32:57.462 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.462 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.512 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151998 s, 0.0 kB/s 2024-04-26T23:32:57.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.672 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.673 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.673 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147498 s, 0.0 kB/s 2024-04-26T23:32:57.674 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.674 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.724 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.776 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151436 s, 0.0 kB/s 2024-04-26T23:32:57.777 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.777 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.832 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.885 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149911 s, 0.0 kB/s 2024-04-26T23:32:57.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:57.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:57.936 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:57.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:57.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:57.989 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148554 s, 0.0 kB/s 2024-04-26T23:32:57.989 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:57.990 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.040 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149311 s, 0.0 kB/s 2024-04-26T23:32:58.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.145 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.202 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.202 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147811 s, 0.0 kB/s 2024-04-26T23:32:58.204 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.204 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.256 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.313 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014514 s, 0.0 kB/s 2024-04-26T23:32:58.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.364 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150463 s, 0.0 kB/s 2024-04-26T23:32:58.417 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.418 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.473 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.525 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.525 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148236 s, 0.0 kB/s 2024-04-26T23:32:58.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.527 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144847 s, 0.0 kB/s 2024-04-26T23:32:58.637 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143675 s, 0.0 kB/s 2024-04-26T23:32:58.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.799 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.852 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.852 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.852 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140454 s, 0.0 kB/s 2024-04-26T23:32:58.853 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.853 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:58.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:58.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:58.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:58.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:58.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146687 s, 0.0 kB/s 2024-04-26T23:32:58.957 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:58.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145927 s, 0.0 kB/s 2024-04-26T23:32:59.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.121 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.177 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155453 s, 0.0 kB/s 2024-04-26T23:32:59.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.285 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145976 s, 0.0 kB/s 2024-04-26T23:32:59.286 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.286 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.336 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143375 s, 0.0 kB/s 2024-04-26T23:32:59.390 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.390 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.444 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150038 s, 0.0 kB/s 2024-04-26T23:32:59.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.498 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.548 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147576 s, 0.0 kB/s 2024-04-26T23:32:59.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.603 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.718 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.719 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153741 s, 0.0 kB/s 2024-04-26T23:32:59.720 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.720 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.773 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156428 s, 0.0 kB/s 2024-04-26T23:32:59.828 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.828 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.881 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:32:59.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:32:59.933 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:32:59.933 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148633 s, 0.0 kB/s 2024-04-26T23:32:59.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:32:59.934 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:32:59.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:32:59.984 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.037 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.037 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147988 s, 0.0 kB/s 2024-04-26T23:33:00.038 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.038 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.090 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144829 s, 0.0 kB/s 2024-04-26T23:33:00.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152968 s, 0.0 kB/s 2024-04-26T23:33:00.247 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.247 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.304 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.357 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.357 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146903 s, 0.0 kB/s 2024-04-26T23:33:00.358 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.358 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.461 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147473 s, 0.0 kB/s 2024-04-26T23:33:00.462 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.462 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.512 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.565 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014519 s, 0.0 kB/s 2024-04-26T23:33:00.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146722 s, 0.0 kB/s 2024-04-26T23:33:00.670 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.670 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.720 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153453 s, 0.0 kB/s 2024-04-26T23:33:00.778 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.778 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.832 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148581 s, 0.0 kB/s 2024-04-26T23:33:00.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:00.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:00.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:00.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.000 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.000 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.001 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144259 s, 0.0 kB/s 2024-04-26T23:33:01.001 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.002 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.056 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148737 s, 0.0 kB/s 2024-04-26T23:33:01.110 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.110 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.160 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014964 s, 0.0 kB/s 2024-04-26T23:33:01.213 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.214 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144086 s, 0.0 kB/s 2024-04-26T23:33:01.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.425 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.425 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148634 s, 0.0 kB/s 2024-04-26T23:33:01.426 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.426 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014574 s, 0.0 kB/s 2024-04-26T23:33:01.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.642 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.642 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149377 s, 0.0 kB/s 2024-04-26T23:33:01.642 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.642 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144759 s, 0.0 kB/s 2024-04-26T23:33:01.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.746 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.796 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148082 s, 0.0 kB/s 2024-04-26T23:33:01.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:01.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:01.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:01.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:01.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149607 s, 0.0 kB/s 2024-04-26T23:33:01.957 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:01.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145298 s, 0.0 kB/s 2024-04-26T23:33:02.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.120 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015063 s, 0.0 kB/s 2024-04-26T23:33:02.178 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.178 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.228 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.285 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141249 s, 0.0 kB/s 2024-04-26T23:33:02.286 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.286 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.335 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137267 s, 0.0 kB/s 2024-04-26T23:33:02.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.390 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.439 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137941 s, 0.0 kB/s 2024-04-26T23:33:02.493 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.493 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.596 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013637 s, 0.0 kB/s 2024-04-26T23:33:02.597 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.597 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.648 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.706 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.706 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148597 s, 0.0 kB/s 2024-04-26T23:33:02.707 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.707 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.815 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.815 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.815 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141012 s, 0.0 kB/s 2024-04-26T23:33:02.816 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.816 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:02.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:02.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:02.920 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142888 s, 0.0 kB/s 2024-04-26T23:33:02.921 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:02.921 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:02.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:02.971 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.025 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148458 s, 0.0 kB/s 2024-04-26T23:33:03.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.026 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.076 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.128 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.129 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.129 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143303 s, 0.0 kB/s 2024-04-26T23:33:03.130 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.130 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.180 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147548 s, 0.0 kB/s 2024-04-26T23:33:03.234 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.234 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.284 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131925 s, 0.0 kB/s 2024-04-26T23:33:03.337 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.337 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.387 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.440 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.440 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142942 s, 0.0 kB/s 2024-04-26T23:33:03.441 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.441 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.491 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.544 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.544 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.544 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133023 s, 0.0 kB/s 2024-04-26T23:33:03.545 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.545 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.595 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134111 s, 0.0 kB/s 2024-04-26T23:33:03.653 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.653 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.703 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.756 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134266 s, 0.0 kB/s 2024-04-26T23:33:03.757 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.757 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.807 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146597 s, 0.0 kB/s 2024-04-26T23:33:03.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:03.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:03.916 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:03.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:03.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:03.968 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014022 s, 0.0 kB/s 2024-04-26T23:33:03.969 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:03.969 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.024 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.080 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.080 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.080 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145361 s, 0.0 kB/s 2024-04-26T23:33:04.081 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.188 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133794 s, 0.0 kB/s 2024-04-26T23:33:04.189 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.189 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.242 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.292 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140507 s, 0.0 kB/s 2024-04-26T23:33:04.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.343 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.397 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.397 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138891 s, 0.0 kB/s 2024-04-26T23:33:04.398 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.398 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.447 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.500 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.500 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134081 s, 0.0 kB/s 2024-04-26T23:33:04.501 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.502 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.604 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.604 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.604 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144594 s, 0.0 kB/s 2024-04-26T23:33:04.605 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.605 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.656 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138257 s, 0.0 kB/s 2024-04-26T23:33:04.714 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.714 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.842 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.842 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142628 s, 0.0 kB/s 2024-04-26T23:33:04.843 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.843 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:04.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:04.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:04.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:04.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:04.962 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138057 s, 0.0 kB/s 2024-04-26T23:33:04.964 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:04.964 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146329 s, 0.0 kB/s 2024-04-26T23:33:05.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.186 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.187 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.187 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143352 s, 0.0 kB/s 2024-04-26T23:33:05.188 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.188 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.295 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.295 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.295 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000159611 s, 0.0 kB/s 2024-04-26T23:33:05.296 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.296 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.348 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157705 s, 0.0 kB/s 2024-04-26T23:33:05.403 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.403 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.509 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014752 s, 0.0 kB/s 2024-04-26T23:33:05.510 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.510 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.560 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015425 s, 0.0 kB/s 2024-04-26T23:33:05.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.614 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.664 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.717 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.717 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149851 s, 0.0 kB/s 2024-04-26T23:33:05.718 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.718 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.768 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.821 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.821 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157261 s, 0.0 kB/s 2024-04-26T23:33:05.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.823 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.876 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:05.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:05.929 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:05.929 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146431 s, 0.0 kB/s 2024-04-26T23:33:05.930 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:05.930 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:05.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:05.980 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.032 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.033 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.033 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143466 s, 0.0 kB/s 2024-04-26T23:33:06.034 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.034 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.084 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149907 s, 0.0 kB/s 2024-04-26T23:33:06.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.142 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.244 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149778 s, 0.0 kB/s 2024-04-26T23:33:06.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.300 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.357 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148416 s, 0.0 kB/s 2024-04-26T23:33:06.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.358 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.412 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.465 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.465 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146711 s, 0.0 kB/s 2024-04-26T23:33:06.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.466 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151564 s, 0.0 kB/s 2024-04-26T23:33:06.570 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.570 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.619 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.672 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.672 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.672 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144669 s, 0.0 kB/s 2024-04-26T23:33:06.673 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.673 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.723 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.777 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.777 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156291 s, 0.0 kB/s 2024-04-26T23:33:06.778 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.778 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.828 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.885 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014692 s, 0.0 kB/s 2024-04-26T23:33:06.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:06.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:06.940 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153192 s, 0.0 kB/s 2024-04-26T23:33:06.993 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:06.993 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.048 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.100 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146758 s, 0.0 kB/s 2024-04-26T23:33:07.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.151 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150239 s, 0.0 kB/s 2024-04-26T23:33:07.210 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.317 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.317 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150758 s, 0.0 kB/s 2024-04-26T23:33:07.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155938 s, 0.0 kB/s 2024-04-26T23:33:07.421 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.471 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.524 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145271 s, 0.0 kB/s 2024-04-26T23:33:07.525 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.525 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014725 s, 0.0 kB/s 2024-04-26T23:33:07.634 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.634 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.684 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143748 s, 0.0 kB/s 2024-04-26T23:33:07.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.850 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.850 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157591 s, 0.0 kB/s 2024-04-26T23:33:07.851 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.851 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:07.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:07.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:07.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:07.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:07.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142762 s, 0.0 kB/s 2024-04-26T23:33:07.958 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:07.958 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148605 s, 0.0 kB/s 2024-04-26T23:33:08.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.164 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151196 s, 0.0 kB/s 2024-04-26T23:33:08.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.268 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.269 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143826 s, 0.0 kB/s 2024-04-26T23:33:08.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146708 s, 0.0 kB/s 2024-04-26T23:33:08.377 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.377 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.427 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132169 s, 0.0 kB/s 2024-04-26T23:33:08.481 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.481 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.532 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134772 s, 0.0 kB/s 2024-04-26T23:33:08.585 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.585 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.635 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.688 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127697 s, 0.0 kB/s 2024-04-26T23:33:08.689 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.689 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.792 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.792 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.792 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131529 s, 0.0 kB/s 2024-04-26T23:33:08.793 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.793 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.843 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.896 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:08.896 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:08.896 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127333 s, 0.0 kB/s 2024-04-26T23:33:08.897 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:08.897 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:08.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:08.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:08.999 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.000 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.000 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013071 s, 0.0 kB/s 2024-04-26T23:33:09.000 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.001 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.051 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.103 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.103 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.104 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128266 s, 0.0 kB/s 2024-04-26T23:33:09.104 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.104 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.155 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135186 s, 0.0 kB/s 2024-04-26T23:33:09.209 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.209 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.312 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129352 s, 0.0 kB/s 2024-04-26T23:33:09.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131655 s, 0.0 kB/s 2024-04-26T23:33:09.417 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.417 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:09.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:09.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.467 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.524 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000203068 s, 0.0 kB/s 2024-04-26T23:33:09.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.526 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.631 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123399 s, 0.0 kB/s 2024-04-26T23:33:09.632 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.632 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.687 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.740 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128762 s, 0.0 kB/s 2024-04-26T23:33:09.741 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.741 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.795 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.848 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128406 s, 0.0 kB/s 2024-04-26T23:33:09.849 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.849 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:09.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:09.903 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:09.959 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:09.959 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:09.959 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129169 s, 0.0 kB/s 2024-04-26T23:33:09.960 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:09.960 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.011 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.063 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.064 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.064 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126301 s, 0.0 kB/s 2024-04-26T23:33:10.064 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.065 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.119 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.171 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.172 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.172 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125913 s, 0.0 kB/s 2024-04-26T23:33:10.173 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.173 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.223 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.275 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.276 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126047 s, 0.0 kB/s 2024-04-26T23:33:10.276 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.277 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.327 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.382 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.383 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.383 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128853 s, 0.0 kB/s 2024-04-26T23:33:10.384 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.384 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.435 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.487 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.487 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.488 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126504 s, 0.0 kB/s 2024-04-26T23:33:10.488 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.489 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.539 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.592 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.592 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.592 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012676 s, 0.0 kB/s 2024-04-26T23:33:10.593 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.593 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.647 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.699 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.699 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.700 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128833 s, 0.0 kB/s 2024-04-26T23:33:10.701 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.701 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.804 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126136 s, 0.0 kB/s 2024-04-26T23:33:10.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.805 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.855 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:10.907 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:10.907 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119513 s, 0.0 kB/s 2024-04-26T23:33:10.909 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:10.909 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:10.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:10.959 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.011 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.011 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.011 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126489 s, 0.0 kB/s 2024-04-26T23:33:11.012 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.012 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.063 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.115 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.116 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124693 s, 0.0 kB/s 2024-04-26T23:33:11.117 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.117 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.223 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.223 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.224 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124701 s, 0.0 kB/s 2024-04-26T23:33:11.224 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.225 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.275 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.332 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123409 s, 0.0 kB/s 2024-04-26T23:33:11.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.333 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.387 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.444 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.444 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127458 s, 0.0 kB/s 2024-04-26T23:33:11.445 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.445 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.551 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.551 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.551 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012301 s, 0.0 kB/s 2024-04-26T23:33:11.552 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.552 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.603 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.656 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124162 s, 0.0 kB/s 2024-04-26T23:33:11.656 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.657 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.759 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.759 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.759 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124824 s, 0.0 kB/s 2024-04-26T23:33:11.760 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.760 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.811 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128319 s, 0.0 kB/s 2024-04-26T23:33:11.869 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.869 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:11.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:11.919 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:11.976 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125951 s, 0.0 kB/s 2024-04-26T23:33:11.977 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:11.977 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.027 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.084 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.084 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.084 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127335 s, 0.0 kB/s 2024-04-26T23:33:12.085 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.085 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.135 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.187 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.187 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.188 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126075 s, 0.0 kB/s 2024-04-26T23:33:12.188 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.188 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.292 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126819 s, 0.0 kB/s 2024-04-26T23:33:12.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.343 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124016 s, 0.0 kB/s 2024-04-26T23:33:12.397 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.397 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.447 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.499 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.499 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.499 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000121265 s, 0.0 kB/s 2024-04-26T23:33:12.500 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.500 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.551 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.604 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.604 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.604 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122943 s, 0.0 kB/s 2024-04-26T23:33:12.605 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.605 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.655 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012501 s, 0.0 kB/s 2024-04-26T23:33:12.708 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.708 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127973 s, 0.0 kB/s 2024-04-26T23:33:12.813 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.813 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.862 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:12.915 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124039 s, 0.0 kB/s 2024-04-26T23:33:12.917 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:12.917 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:12.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:12.967 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000122358 s, 0.0 kB/s 2024-04-26T23:33:13.020 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.020 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.071 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000119205 s, 0.0 kB/s 2024-04-26T23:33:13.124 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.124 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.175 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012736 s, 0.0 kB/s 2024-04-26T23:33:13.229 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.229 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.280 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.332 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129423 s, 0.0 kB/s 2024-04-26T23:33:13.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.333 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.383 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130799 s, 0.0 kB/s 2024-04-26T23:33:13.437 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.437 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.491 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.547 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.547 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.547 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129239 s, 0.0 kB/s 2024-04-26T23:33:13.548 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.548 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.599 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.651 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.651 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.651 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000125751 s, 0.0 kB/s 2024-04-26T23:33:13.652 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.652 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.702 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012655 s, 0.0 kB/s 2024-04-26T23:33:13.752 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.752 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.803 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.856 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.856 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.856 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134058 s, 0.0 kB/s 2024-04-26T23:33:13.857 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.857 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:13.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:13.907 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:13.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:13.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:13.960 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000123988 s, 0.0 kB/s 2024-04-26T23:33:13.961 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:13.961 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.015 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.071 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.072 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000124979 s, 0.0 kB/s 2024-04-26T23:33:14.073 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.073 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.123 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.176 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127632 s, 0.0 kB/s 2024-04-26T23:33:14.177 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.177 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.227 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00012637 s, 0.0 kB/s 2024-04-26T23:33:14.285 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.285 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.335 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129298 s, 0.0 kB/s 2024-04-26T23:33:14.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.389 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.439 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000126625 s, 0.0 kB/s 2024-04-26T23:33:14.497 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.497 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.547 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.601 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.601 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128811 s, 0.0 kB/s 2024-04-26T23:33:14.602 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.602 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.651 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132209 s, 0.0 kB/s 2024-04-26T23:33:14.705 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.705 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131817 s, 0.0 kB/s 2024-04-26T23:33:14.813 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.813 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.863 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:14.919 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:14.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:14.920 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128155 s, 0.0 kB/s 2024-04-26T23:33:14.921 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:14.921 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:14.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:14.971 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.024 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128794 s, 0.0 kB/s 2024-04-26T23:33:15.025 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.025 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.075 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.127 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.128 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131263 s, 0.0 kB/s 2024-04-26T23:33:15.129 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.129 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.179 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.236 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130664 s, 0.0 kB/s 2024-04-26T23:33:15.237 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.237 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.287 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.344 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000129955 s, 0.0 kB/s 2024-04-26T23:33:15.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.399 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.452 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.452 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132958 s, 0.0 kB/s 2024-04-26T23:33:15.453 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.453 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.507 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137198 s, 0.0 kB/s 2024-04-26T23:33:15.561 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.561 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.668 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.668 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.668 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132284 s, 0.0 kB/s 2024-04-26T23:33:15.669 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.669 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.723 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149024 s, 0.0 kB/s 2024-04-26T23:33:15.781 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.781 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.832 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.884 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.884 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.884 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158315 s, 0.0 kB/s 2024-04-26T23:33:15.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:15.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:15.939 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:15.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:15.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:15.993 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134488 s, 0.0 kB/s 2024-04-26T23:33:15.993 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:15.993 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.047 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141218 s, 0.0 kB/s 2024-04-26T23:33:16.102 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.102 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.151 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134679 s, 0.0 kB/s 2024-04-26T23:33:16.205 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.205 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.255 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.310 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.310 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132858 s, 0.0 kB/s 2024-04-26T23:33:16.311 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.311 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.417 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.417 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139769 s, 0.0 kB/s 2024-04-26T23:33:16.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.418 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.471 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.529 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145184 s, 0.0 kB/s 2024-04-26T23:33:16.530 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.530 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.633 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.633 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000173381 s, 0.0 kB/s 2024-04-26T23:33:16.635 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.635 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146371 s, 0.0 kB/s 2024-04-26T23:33:16.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146282 s, 0.0 kB/s 2024-04-26T23:33:16.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.846 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:16.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:16.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:16.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:16.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:16.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146627 s, 0.0 kB/s 2024-04-26T23:33:16.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:16.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.000 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151971 s, 0.0 kB/s 2024-04-26T23:33:17.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.107 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147975 s, 0.0 kB/s 2024-04-26T23:33:17.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.216 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148835 s, 0.0 kB/s 2024-04-26T23:33:17.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.271 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144139 s, 0.0 kB/s 2024-04-26T23:33:17.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.427 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.480 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.481 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.481 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141248 s, 0.0 kB/s 2024-04-26T23:33:17.481 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.482 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.531 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145039 s, 0.0 kB/s 2024-04-26T23:33:17.586 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.586 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.635 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150723 s, 0.0 kB/s 2024-04-26T23:33:17.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.794 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151123 s, 0.0 kB/s 2024-04-26T23:33:17.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.795 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:17.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:17.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:17.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151565 s, 0.0 kB/s 2024-04-26T23:33:17.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:17.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:17.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:17.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149606 s, 0.0 kB/s 2024-04-26T23:33:18.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.059 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.134 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000160438 s, 0.0 kB/s 2024-04-26T23:33:18.135 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.135 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.189 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145277 s, 0.0 kB/s 2024-04-26T23:33:18.242 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.242 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.292 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.348 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.348 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.348 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135599 s, 0.0 kB/s 2024-04-26T23:33:18.349 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.349 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.399 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.456 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134792 s, 0.0 kB/s 2024-04-26T23:33:18.457 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.457 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.511 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.564 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.564 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.565 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143514 s, 0.0 kB/s 2024-04-26T23:33:18.566 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.566 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149845 s, 0.0 kB/s 2024-04-26T23:33:18.669 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.669 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.719 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.772 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.772 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.773 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001488 s, 0.0 kB/s 2024-04-26T23:33:18.773 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.774 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.823 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.876 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.877 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.877 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148019 s, 0.0 kB/s 2024-04-26T23:33:18.878 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.878 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:18.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:18.927 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143413 s, 0.0 kB/s 2024-04-26T23:33:18.981 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:18.981 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.037 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142941 s, 0.0 kB/s 2024-04-26T23:33:19.090 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.090 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.140 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.192 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.193 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.193 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147148 s, 0.0 kB/s 2024-04-26T23:33:19.194 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.194 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.248 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156001 s, 0.0 kB/s 2024-04-26T23:33:19.304 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.304 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.360 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.413 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.413 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152671 s, 0.0 kB/s 2024-04-26T23:33:19.414 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.414 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147349 s, 0.0 kB/s 2024-04-26T23:33:19.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148071 s, 0.0 kB/s 2024-04-26T23:33:19.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.673 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.725 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.725 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148849 s, 0.0 kB/s 2024-04-26T23:33:19.726 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.727 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.837 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.838 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.838 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151957 s, 0.0 kB/s 2024-04-26T23:33:19.839 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.839 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:19.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:19.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:19.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152297 s, 0.0 kB/s 2024-04-26T23:33:19.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:19.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.004 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148822 s, 0.0 kB/s 2024-04-26T23:33:20.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144431 s, 0.0 kB/s 2024-04-26T23:33:20.169 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.169 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.223 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.275 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.276 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.276 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000131915 s, 0.0 kB/s 2024-04-26T23:33:20.277 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.277 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.346 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.389 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130383 s, 0.0 kB/s 2024-04-26T23:33:20.390 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.390 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.439 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.491 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.492 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.492 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136561 s, 0.0 kB/s 2024-04-26T23:33:20.493 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.493 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.595 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.596 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000127042 s, 0.0 kB/s 2024-04-26T23:33:20.597 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.597 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.647 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.700 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000130288 s, 0.0 kB/s 2024-04-26T23:33:20.701 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.701 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.804 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137308 s, 0.0 kB/s 2024-04-26T23:33:20.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.805 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.855 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:20.908 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:20.908 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:20.908 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140349 s, 0.0 kB/s 2024-04-26T23:33:20.909 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:20.909 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:20.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:20.959 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134106 s, 0.0 kB/s 2024-04-26T23:33:21.013 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.013 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.063 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001365 s, 0.0 kB/s 2024-04-26T23:33:21.117 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.117 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.220 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.221 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146734 s, 0.0 kB/s 2024-04-26T23:33:21.222 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.222 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.324 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152369 s, 0.0 kB/s 2024-04-26T23:33:21.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.326 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.380 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.433 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.433 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144741 s, 0.0 kB/s 2024-04-26T23:33:21.434 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.434 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151494 s, 0.0 kB/s 2024-04-26T23:33:21.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.592 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147799 s, 0.0 kB/s 2024-04-26T23:33:21.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.646 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147204 s, 0.0 kB/s 2024-04-26T23:33:21.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.804 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.857 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.857 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148799 s, 0.0 kB/s 2024-04-26T23:33:21.858 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.858 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:21.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:21.908 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:21.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:21.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:21.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143497 s, 0.0 kB/s 2024-04-26T23:33:21.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:21.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.012 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.065 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.065 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147852 s, 0.0 kB/s 2024-04-26T23:33:22.066 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.066 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.116 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158219 s, 0.0 kB/s 2024-04-26T23:33:22.171 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.171 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153821 s, 0.0 kB/s 2024-04-26T23:33:22.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.329 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152797 s, 0.0 kB/s 2024-04-26T23:33:22.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150601 s, 0.0 kB/s 2024-04-26T23:33:22.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.536 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000161127 s, 0.0 kB/s 2024-04-26T23:33:22.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149209 s, 0.0 kB/s 2024-04-26T23:33:22.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.747 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.800 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155192 s, 0.0 kB/s 2024-04-26T23:33:22.801 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:22.904 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:22.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:22.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154478 s, 0.0 kB/s 2024-04-26T23:33:22.905 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:22.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:22.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:22.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152125 s, 0.0 kB/s 2024-04-26T23:33:23.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.066 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148763 s, 0.0 kB/s 2024-04-26T23:33:23.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.121 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.171 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.245 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.245 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152994 s, 0.0 kB/s 2024-04-26T23:33:23.246 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.246 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.299 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.356 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134544 s, 0.0 kB/s 2024-04-26T23:33:23.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.357 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.407 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.460 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.460 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.460 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135432 s, 0.0 kB/s 2024-04-26T23:33:23.461 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.461 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.515 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013663 s, 0.0 kB/s 2024-04-26T23:33:23.574 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.627 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.684 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.684 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139007 s, 0.0 kB/s 2024-04-26T23:33:23.685 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.685 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.792 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.793 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.793 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149563 s, 0.0 kB/s 2024-04-26T23:33:23.794 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.794 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:23.900 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:23.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:23.901 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138782 s, 0.0 kB/s 2024-04-26T23:33:23.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:23.902 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:23.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:23.951 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.004 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.004 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.004 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014606 s, 0.0 kB/s 2024-04-26T23:33:24.005 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.005 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.055 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147239 s, 0.0 kB/s 2024-04-26T23:33:24.113 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.114 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.163 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.216 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151172 s, 0.0 kB/s 2024-04-26T23:33:24.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147368 s, 0.0 kB/s 2024-04-26T23:33:24.321 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.321 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.371 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.424 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148972 s, 0.0 kB/s 2024-04-26T23:33:24.425 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.425 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.480 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.532 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147673 s, 0.0 kB/s 2024-04-26T23:33:24.533 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.533 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.645 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.645 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145743 s, 0.0 kB/s 2024-04-26T23:33:24.646 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.646 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.753 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.753 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147056 s, 0.0 kB/s 2024-04-26T23:33:24.754 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.754 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.808 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.865 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.865 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152348 s, 0.0 kB/s 2024-04-26T23:33:24.866 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.866 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:24.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:24.915 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:24.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146384 s, 0.0 kB/s 2024-04-26T23:33:24.970 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:24.970 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145387 s, 0.0 kB/s 2024-04-26T23:33:25.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.074 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.127 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156361 s, 0.0 kB/s 2024-04-26T23:33:25.182 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.182 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.285 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.285 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144356 s, 0.0 kB/s 2024-04-26T23:33:25.286 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.287 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.341 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.392 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.393 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.393 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156286 s, 0.0 kB/s 2024-04-26T23:33:25.394 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.394 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.444 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.496 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.496 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148657 s, 0.0 kB/s 2024-04-26T23:33:25.497 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.497 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.551 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.609 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.609 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150382 s, 0.0 kB/s 2024-04-26T23:33:25.610 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.610 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.660 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.713 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.713 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152046 s, 0.0 kB/s 2024-04-26T23:33:25.714 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.714 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.764 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.817 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.817 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153208 s, 0.0 kB/s 2024-04-26T23:33:25.818 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.818 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.869 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:25.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:25.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:25.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151878 s, 0.0 kB/s 2024-04-26T23:33:25.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:25.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:25.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:25.976 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.029 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.029 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150519 s, 0.0 kB/s 2024-04-26T23:33:26.030 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.030 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.079 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.132 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.132 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015257 s, 0.0 kB/s 2024-04-26T23:33:26.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.134 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.184 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.237 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152816 s, 0.0 kB/s 2024-04-26T23:33:26.238 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.238 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.287 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.340 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.341 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.341 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154687 s, 0.0 kB/s 2024-04-26T23:33:26.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.391 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.444 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.444 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.444 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151218 s, 0.0 kB/s 2024-04-26T23:33:26.445 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.445 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.496 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.549 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.549 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149533 s, 0.0 kB/s 2024-04-26T23:33:26.550 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.550 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.600 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015313 s, 0.0 kB/s 2024-04-26T23:33:26.653 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.653 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.703 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.757 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.757 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155795 s, 0.0 kB/s 2024-04-26T23:33:26.758 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.758 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.808 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.861 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150751 s, 0.0 kB/s 2024-04-26T23:33:26.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:26.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:26.912 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:26.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:26.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:26.968 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146778 s, 0.0 kB/s 2024-04-26T23:33:26.969 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:26.969 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.020 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.073 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148358 s, 0.0 kB/s 2024-04-26T23:33:27.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.074 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.124 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.176 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156839 s, 0.0 kB/s 2024-04-26T23:33:27.177 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.178 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.228 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145748 s, 0.0 kB/s 2024-04-26T23:33:27.281 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.282 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.385 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157538 s, 0.0 kB/s 2024-04-26T23:33:27.386 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.386 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147969 s, 0.0 kB/s 2024-04-26T23:33:27.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.539 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.592 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.593 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.593 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146745 s, 0.0 kB/s 2024-04-26T23:33:27.594 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.594 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.696 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.697 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.697 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148087 s, 0.0 kB/s 2024-04-26T23:33:27.698 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.698 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.747 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.801 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.801 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156929 s, 0.0 kB/s 2024-04-26T23:33:27.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.802 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.852 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:27.904 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:27.905 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:27.905 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014259 s, 0.0 kB/s 2024-04-26T23:33:27.906 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:27.906 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:27.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:27.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147088 s, 0.0 kB/s 2024-04-26T23:33:28.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.060 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.112 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140367 s, 0.0 kB/s 2024-04-26T23:33:28.113 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.113 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138256 s, 0.0 kB/s 2024-04-26T23:33:28.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.320 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000136458 s, 0.0 kB/s 2024-04-26T23:33:28.321 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.321 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.371 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132557 s, 0.0 kB/s 2024-04-26T23:33:28.425 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.425 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.475 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.528 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142954 s, 0.0 kB/s 2024-04-26T23:33:28.529 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.529 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.632 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.632 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.632 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141992 s, 0.0 kB/s 2024-04-26T23:33:28.633 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.633 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.683 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144454 s, 0.0 kB/s 2024-04-26T23:33:28.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.787 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.845 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.845 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147126 s, 0.0 kB/s 2024-04-26T23:33:28.846 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.847 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:28.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:28.949 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:28.949 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150159 s, 0.0 kB/s 2024-04-26T23:33:28.950 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:28.950 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:28.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:28.999 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.052 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.053 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147428 s, 0.0 kB/s 2024-04-26T23:33:29.053 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.104 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150627 s, 0.0 kB/s 2024-04-26T23:33:29.158 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.158 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.208 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.260 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.261 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.261 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144694 s, 0.0 kB/s 2024-04-26T23:33:29.263 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.263 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.316 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.372 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143798 s, 0.0 kB/s 2024-04-26T23:33:29.374 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.374 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.477 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.477 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150717 s, 0.0 kB/s 2024-04-26T23:33:29.478 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.478 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.527 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146697 s, 0.0 kB/s 2024-04-26T23:33:29.581 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.581 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.688 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.689 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.689 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153207 s, 0.0 kB/s 2024-04-26T23:33:29.690 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.690 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150853 s, 0.0 kB/s 2024-04-26T23:33:29.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.848 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153305 s, 0.0 kB/s 2024-04-26T23:33:29.903 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:29.903 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:29.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:29.955 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147225 s, 0.0 kB/s 2024-04-26T23:33:30.010 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.010 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.059 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.116 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.116 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148461 s, 0.0 kB/s 2024-04-26T23:33:30.118 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.118 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155063 s, 0.0 kB/s 2024-04-26T23:33:30.222 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.222 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146996 s, 0.0 kB/s 2024-04-26T23:33:30.326 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.326 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.377 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150712 s, 0.0 kB/s 2024-04-26T23:33:30.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.480 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150445 s, 0.0 kB/s 2024-04-26T23:33:30.533 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145887 s, 0.0 kB/s 2024-04-26T23:33:30.637 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.687 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.740 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150145 s, 0.0 kB/s 2024-04-26T23:33:30.741 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.741 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148708 s, 0.0 kB/s 2024-04-26T23:33:30.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:30.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:30.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154041 s, 0.0 kB/s 2024-04-26T23:33:30.954 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:30.954 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.003 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.060 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146118 s, 0.0 kB/s 2024-04-26T23:33:31.061 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.061 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.168 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.168 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.168 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152483 s, 0.0 kB/s 2024-04-26T23:33:31.169 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.169 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.223 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.280 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150328 s, 0.0 kB/s 2024-04-26T23:33:31.282 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.282 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149622 s, 0.0 kB/s 2024-04-26T23:33:31.385 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.385 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.435 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014825 s, 0.0 kB/s 2024-04-26T23:33:31.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.596 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148808 s, 0.0 kB/s 2024-04-26T23:33:31.597 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.648 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.701 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156314 s, 0.0 kB/s 2024-04-26T23:33:31.702 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.702 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.752 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.805 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154159 s, 0.0 kB/s 2024-04-26T23:33:31.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.806 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.860 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148648 s, 0.0 kB/s 2024-04-26T23:33:31.914 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:31.914 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:31.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:31.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.016 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.016 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.017 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015064 s, 0.0 kB/s 2024-04-26T23:33:32.017 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.018 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.067 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147695 s, 0.0 kB/s 2024-04-26T23:33:32.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.121 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.172 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145599 s, 0.0 kB/s 2024-04-26T23:33:32.225 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.225 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.275 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014259 s, 0.0 kB/s 2024-04-26T23:33:32.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.333 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.384 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.436 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139218 s, 0.0 kB/s 2024-04-26T23:33:32.437 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.437 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.487 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.540 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141721 s, 0.0 kB/s 2024-04-26T23:33:32.541 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.541 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.591 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.644 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150614 s, 0.0 kB/s 2024-04-26T23:33:32.645 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.645 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.699 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.756 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.756 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145759 s, 0.0 kB/s 2024-04-26T23:33:32.757 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.757 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.807 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.864 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.864 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.864 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148248 s, 0.0 kB/s 2024-04-26T23:33:32.865 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.865 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:32.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:32.915 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:32.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:32.968 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:32.968 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141947 s, 0.0 kB/s 2024-04-26T23:33:32.969 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:32.969 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.019 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.073 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.073 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152045 s, 0.0 kB/s 2024-04-26T23:33:33.074 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.074 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.123 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.176 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.177 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.177 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149682 s, 0.0 kB/s 2024-04-26T23:33:33.178 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.178 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.231 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.288 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.288 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.288 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000229013 s, 0.0 kB/s 2024-04-26T23:33:33.289 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.290 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.339 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137853 s, 0.0 kB/s 2024-04-26T23:33:33.397 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.397 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.447 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.500 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.500 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.500 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141608 s, 0.0 kB/s 2024-04-26T23:33:33.501 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.501 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.551 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.608 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.608 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.608 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014432 s, 0.0 kB/s 2024-04-26T23:33:33.609 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.609 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.663 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150525 s, 0.0 kB/s 2024-04-26T23:33:33.717 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.717 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.768 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.825 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.826 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.826 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000171321 s, 0.0 kB/s 2024-04-26T23:33:33.827 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.827 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.884 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:33.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:33.937 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:33.937 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152213 s, 0.0 kB/s 2024-04-26T23:33:33.938 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:33.938 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:33.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:33.987 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150569 s, 0.0 kB/s 2024-04-26T23:33:34.046 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.046 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.099 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.157 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.158 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.158 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148523 s, 0.0 kB/s 2024-04-26T23:33:34.159 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.159 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147335 s, 0.0 kB/s 2024-04-26T23:33:34.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.319 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.377 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.377 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148889 s, 0.0 kB/s 2024-04-26T23:33:34.378 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.378 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148274 s, 0.0 kB/s 2024-04-26T23:33:34.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143967 s, 0.0 kB/s 2024-04-26T23:33:34.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014902 s, 0.0 kB/s 2024-04-26T23:33:34.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.813 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.813 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151722 s, 0.0 kB/s 2024-04-26T23:33:34.814 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.814 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147988 s, 0.0 kB/s 2024-04-26T23:33:34.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:34.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:34.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:34.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000215488 s, 0.0 kB/s 2024-04-26T23:33:35.035 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.035 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.088 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.142 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.143 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.143 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149418 s, 0.0 kB/s 2024-04-26T23:33:35.144 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.144 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.200 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.257 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.258 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151806 s, 0.0 kB/s 2024-04-26T23:33:35.258 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.259 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.315 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.368 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.368 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.368 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146644 s, 0.0 kB/s 2024-04-26T23:33:35.369 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.369 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.419 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.472 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.472 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.472 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144927 s, 0.0 kB/s 2024-04-26T23:33:35.473 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.473 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.523 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.576 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.576 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153978 s, 0.0 kB/s 2024-04-26T23:33:35.577 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.578 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.628 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.680 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.680 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.680 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149049 s, 0.0 kB/s 2024-04-26T23:33:35.681 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.681 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.732 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.785 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148933 s, 0.0 kB/s 2024-04-26T23:33:35.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.840 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:35.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:35.893 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:35.893 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148674 s, 0.0 kB/s 2024-04-26T23:33:35.894 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:35.894 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:35.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:35.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.007 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143771 s, 0.0 kB/s 2024-04-26T23:33:36.008 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.008 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.060 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.112 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.112 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144364 s, 0.0 kB/s 2024-04-26T23:33:36.113 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.113 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.164 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.216 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.217 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.217 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149638 s, 0.0 kB/s 2024-04-26T23:33:36.218 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.218 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.321 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.321 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154831 s, 0.0 kB/s 2024-04-26T23:33:36.322 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.322 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.375 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.428 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.429 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.429 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150513 s, 0.0 kB/s 2024-04-26T23:33:36.430 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.430 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148765 s, 0.0 kB/s 2024-04-26T23:33:36.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149538 s, 0.0 kB/s 2024-04-26T23:33:36.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153141 s, 0.0 kB/s 2024-04-26T23:33:36.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001495 s, 0.0 kB/s 2024-04-26T23:33:36.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:36.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:36.903 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:36.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:36.956 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:36.956 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014847 s, 0.0 kB/s 2024-04-26T23:33:36.957 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:36.957 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.060 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150873 s, 0.0 kB/s 2024-04-26T23:33:37.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.062 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.116 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.168 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149636 s, 0.0 kB/s 2024-04-26T23:33:37.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.224 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146339 s, 0.0 kB/s 2024-04-26T23:33:37.278 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.278 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151604 s, 0.0 kB/s 2024-04-26T23:33:37.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149346 s, 0.0 kB/s 2024-04-26T23:33:37.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.535 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.588 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148003 s, 0.0 kB/s 2024-04-26T23:33:37.590 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.590 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.639 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.692 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.692 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.692 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152538 s, 0.0 kB/s 2024-04-26T23:33:37.693 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.693 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.748 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.808 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.808 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.808 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149015 s, 0.0 kB/s 2024-04-26T23:33:37.809 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.809 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.860 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:37.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:37.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:37.912 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144087 s, 0.0 kB/s 2024-04-26T23:33:37.913 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:37.913 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:37.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:37.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.016 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.017 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.017 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000159445 s, 0.0 kB/s 2024-04-26T23:33:38.018 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.018 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.068 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.121 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155283 s, 0.0 kB/s 2024-04-26T23:33:38.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.122 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.171 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.228 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.228 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.229 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146128 s, 0.0 kB/s 2024-04-26T23:33:38.229 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.230 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.279 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.333 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146335 s, 0.0 kB/s 2024-04-26T23:33:38.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.383 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.436 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.436 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145833 s, 0.0 kB/s 2024-04-26T23:33:38.437 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.437 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.487 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.540 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.540 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138858 s, 0.0 kB/s 2024-04-26T23:33:38.541 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.542 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.591 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.644 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142093 s, 0.0 kB/s 2024-04-26T23:33:38.645 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.645 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141938 s, 0.0 kB/s 2024-04-26T23:33:38.749 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.749 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.852 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147495 s, 0.0 kB/s 2024-04-26T23:33:38.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:38.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:38.909 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:38.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:38.961 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149866 s, 0.0 kB/s 2024-04-26T23:33:38.962 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:38.962 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.013 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150999 s, 0.0 kB/s 2024-04-26T23:33:39.065 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.065 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.116 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.172 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.172 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.173 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145391 s, 0.0 kB/s 2024-04-26T23:33:39.173 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.173 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.284 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.284 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.284 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144761 s, 0.0 kB/s 2024-04-26T23:33:39.285 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.285 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.336 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.388 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.388 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158038 s, 0.0 kB/s 2024-04-26T23:33:39.389 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.389 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.441 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.497 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.497 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015249 s, 0.0 kB/s 2024-04-26T23:33:39.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.498 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:39.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147896 s, 0.0 kB/s 2024-04-26T23:33:39.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:39.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150915 s, 0.0 kB/s 2024-04-26T23:33:39.709 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.759 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.812 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.812 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153569 s, 0.0 kB/s 2024-04-26T23:33:39.813 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.813 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014035 s, 0.0 kB/s 2024-04-26T23:33:39.922 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:39.922 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:39.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:39.971 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.025 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.025 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014491 s, 0.0 kB/s 2024-04-26T23:33:40.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.026 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.079 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147089 s, 0.0 kB/s 2024-04-26T23:33:40.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.134 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.183 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.236 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.237 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153311 s, 0.0 kB/s 2024-04-26T23:33:40.238 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.238 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.291 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.344 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.344 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151648 s, 0.0 kB/s 2024-04-26T23:33:40.345 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.345 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.395 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.448 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.449 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.449 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143894 s, 0.0 kB/s 2024-04-26T23:33:40.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.500 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.553 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.553 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149312 s, 0.0 kB/s 2024-04-26T23:33:40.554 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.554 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.607 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.666 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144965 s, 0.0 kB/s 2024-04-26T23:33:40.667 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.668 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.723 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.776 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.776 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146752 s, 0.0 kB/s 2024-04-26T23:33:40.777 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.777 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.830 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.888 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.888 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.888 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151639 s, 0.0 kB/s 2024-04-26T23:33:40.889 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.889 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:40.939 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:40.996 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149534 s, 0.0 kB/s 2024-04-26T23:33:40.998 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:40.998 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.047 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152479 s, 0.0 kB/s 2024-04-26T23:33:41.106 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.106 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.156 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.209 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150352 s, 0.0 kB/s 2024-04-26T23:33:41.209 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.210 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.312 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000159207 s, 0.0 kB/s 2024-04-26T23:33:41.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.421 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.421 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146377 s, 0.0 kB/s 2024-04-26T23:33:41.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.422 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.471 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.528 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.529 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147206 s, 0.0 kB/s 2024-04-26T23:33:41.531 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.531 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144756 s, 0.0 kB/s 2024-04-26T23:33:41.638 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.638 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.688 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150484 s, 0.0 kB/s 2024-04-26T23:33:41.741 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.791 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142139 s, 0.0 kB/s 2024-04-26T23:33:41.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:41.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:41.899 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:41.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:41.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:41.952 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141378 s, 0.0 kB/s 2024-04-26T23:33:41.953 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:41.953 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.003 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143365 s, 0.0 kB/s 2024-04-26T23:33:42.057 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.057 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.110 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.165 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153034 s, 0.0 kB/s 2024-04-26T23:33:42.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.166 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.219 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152101 s, 0.0 kB/s 2024-04-26T23:33:42.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.323 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.380 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.381 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.381 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152708 s, 0.0 kB/s 2024-04-26T23:33:42.382 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.382 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.431 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.488 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014666 s, 0.0 kB/s 2024-04-26T23:33:42.489 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.489 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143317 s, 0.0 kB/s 2024-04-26T23:33:42.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.647 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.701 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.701 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142776 s, 0.0 kB/s 2024-04-26T23:33:42.702 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.702 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.804 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141038 s, 0.0 kB/s 2024-04-26T23:33:42.805 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.805 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.855 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150059 s, 0.0 kB/s 2024-04-26T23:33:42.909 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:42.909 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:42.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:42.960 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.012 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.012 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.012 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145837 s, 0.0 kB/s 2024-04-26T23:33:43.013 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.013 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.064 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.120 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.120 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146353 s, 0.0 kB/s 2024-04-26T23:33:43.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.121 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.171 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134895 s, 0.0 kB/s 2024-04-26T23:33:43.226 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.227 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.279 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.332 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.332 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141876 s, 0.0 kB/s 2024-04-26T23:33:43.333 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.333 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.383 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.435 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.435 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.436 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137299 s, 0.0 kB/s 2024-04-26T23:33:43.436 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.437 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.491 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135561 s, 0.0 kB/s 2024-04-26T23:33:43.549 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.549 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.599 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.651 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.652 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.652 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00013893 s, 0.0 kB/s 2024-04-26T23:33:43.652 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.653 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139968 s, 0.0 kB/s 2024-04-26T23:33:43.765 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.765 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.819 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.872 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.873 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.873 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139282 s, 0.0 kB/s 2024-04-26T23:33:43.874 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.874 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:43.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:43.927 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:43.984 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:43.984 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:43.984 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000132427 s, 0.0 kB/s 2024-04-26T23:33:43.985 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:43.985 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.039 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.098 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.098 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139959 s, 0.0 kB/s 2024-04-26T23:33:44.099 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.099 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.147 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.200 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.200 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.200 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135002 s, 0.0 kB/s 2024-04-26T23:33:44.201 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.201 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.255 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139421 s, 0.0 kB/s 2024-04-26T23:33:44.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.416 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.416 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000138451 s, 0.0 kB/s 2024-04-26T23:33:44.417 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.417 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.467 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.520 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.520 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.520 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139602 s, 0.0 kB/s 2024-04-26T23:33:44.521 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.521 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.571 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.624 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.624 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.624 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141795 s, 0.0 kB/s 2024-04-26T23:33:44.625 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.625 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.679 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.732 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.732 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.732 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141883 s, 0.0 kB/s 2024-04-26T23:33:44.734 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.734 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.784 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.836 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.836 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.836 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143204 s, 0.0 kB/s 2024-04-26T23:33:44.837 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.837 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.887 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:44.940 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:44.940 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:44.940 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146304 s, 0.0 kB/s 2024-04-26T23:33:44.941 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:44.941 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:44.991 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.044 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.044 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.0001472 s, 0.0 kB/s 2024-04-26T23:33:45.045 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.045 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.096 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.149 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.149 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149839 s, 0.0 kB/s 2024-04-26T23:33:45.150 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.150 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.199 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144407 s, 0.0 kB/s 2024-04-26T23:33:45.257 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.257 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.360 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.360 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.360 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148324 s, 0.0 kB/s 2024-04-26T23:33:45.361 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.361 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.415 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.469 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.469 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149936 s, 0.0 kB/s 2024-04-26T23:33:45.470 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.470 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.520 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.573 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.573 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145309 s, 0.0 kB/s 2024-04-26T23:33:45.574 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.574 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.623 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.676 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147276 s, 0.0 kB/s 2024-04-26T23:33:45.677 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.677 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.731 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.785 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.786 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142684 s, 0.0 kB/s 2024-04-26T23:33:45.786 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.786 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.836 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.888 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139376 s, 0.0 kB/s 2024-04-26T23:33:45.889 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.890 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:45.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:45.939 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:45.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:45.992 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:45.992 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137034 s, 0.0 kB/s 2024-04-26T23:33:45.993 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:45.993 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.043 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.096 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.096 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.096 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141339 s, 0.0 kB/s 2024-04-26T23:33:46.097 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.097 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.151 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.208 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.208 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135011 s, 0.0 kB/s 2024-04-26T23:33:46.209 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.209 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.312 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148411 s, 0.0 kB/s 2024-04-26T23:33:46.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.363 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.420 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150007 s, 0.0 kB/s 2024-04-26T23:33:46.421 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.421 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.475 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.533 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.533 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146639 s, 0.0 kB/s 2024-04-26T23:33:46.534 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.534 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.644 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.644 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014948 s, 0.0 kB/s 2024-04-26T23:33:46.645 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.645 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.752 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.752 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.752 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149822 s, 0.0 kB/s 2024-04-26T23:33:46.753 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.753 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.803 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.860 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.860 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.861 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146631 s, 0.0 kB/s 2024-04-26T23:33:46.861 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:46.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:46.915 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:46.972 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:46.973 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:46.973 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151683 s, 0.0 kB/s 2024-04-26T23:33:46.973 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:46.973 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.027 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.080 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.081 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.081 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151591 s, 0.0 kB/s 2024-04-26T23:33:47.081 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.082 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.131 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.184 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.184 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.184 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149618 s, 0.0 kB/s 2024-04-26T23:33:47.185 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.185 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.235 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.292 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015133 s, 0.0 kB/s 2024-04-26T23:33:47.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.347 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.405 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.406 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149735 s, 0.0 kB/s 2024-04-26T23:33:47.407 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.407 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.463 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.516 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.517 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.517 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145615 s, 0.0 kB/s 2024-04-26T23:33:47.518 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.518 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.572 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.625 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.625 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155909 s, 0.0 kB/s 2024-04-26T23:33:47.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.626 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.681 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146575 s, 0.0 kB/s 2024-04-26T23:33:47.738 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.738 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.849 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.849 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150796 s, 0.0 kB/s 2024-04-26T23:33:47.850 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.850 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:47.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:47.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147421 s, 0.0 kB/s 2024-04-26T23:33:47.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:47.959 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.012 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.076 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.076 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.076 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152392 s, 0.0 kB/s 2024-04-26T23:33:48.077 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.077 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.132 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000157275 s, 0.0 kB/s 2024-04-26T23:33:48.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.293 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.293 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000141274 s, 0.0 kB/s 2024-04-26T23:33:48.294 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.294 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.343 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.396 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.396 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149261 s, 0.0 kB/s 2024-04-26T23:33:48.397 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.397 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.447 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.500 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.501 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.501 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015365 s, 0.0 kB/s 2024-04-26T23:33:48.502 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.502 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.604 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.605 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.605 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145373 s, 0.0 kB/s 2024-04-26T23:33:48.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.606 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.655 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.708 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.709 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.709 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143344 s, 0.0 kB/s 2024-04-26T23:33:48.710 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.710 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.760 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148407 s, 0.0 kB/s 2024-04-26T23:33:48.817 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.817 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.871 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:48.924 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:48.924 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:48.924 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147794 s, 0.0 kB/s 2024-04-26T23:33:48.925 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:48.925 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:48.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:48.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.032 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.032 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.032 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144967 s, 0.0 kB/s 2024-04-26T23:33:49.033 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.033 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.083 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000224006 s, 0.0 kB/s 2024-04-26T23:33:49.142 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.143 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.195 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.253 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.253 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146454 s, 0.0 kB/s 2024-04-26T23:33:49.254 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.254 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.303 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.356 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.356 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014558 s, 0.0 kB/s 2024-04-26T23:33:49.357 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.357 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.407 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.460 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.461 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.461 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143244 s, 0.0 kB/s 2024-04-26T23:33:49.461 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.462 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.515 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.572 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.572 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151686 s, 0.0 kB/s 2024-04-26T23:33:49.573 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.573 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.623 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.676 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.676 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145087 s, 0.0 kB/s 2024-04-26T23:33:49.677 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.677 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.728 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.781 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.781 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.781 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144027 s, 0.0 kB/s 2024-04-26T23:33:49.782 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.782 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.832 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.885 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.885 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149426 s, 0.0 kB/s 2024-04-26T23:33:49.886 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.886 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:49.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:49.935 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:49.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:49.988 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:49.988 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145192 s, 0.0 kB/s 2024-04-26T23:33:49.989 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:49.989 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.093 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.093 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000134878 s, 0.0 kB/s 2024-04-26T23:33:50.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.147 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.204 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.205 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133149 s, 0.0 kB/s 2024-04-26T23:33:50.206 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.206 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.259 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000128899 s, 0.0 kB/s 2024-04-26T23:33:50.313 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.313 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.367 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137152 s, 0.0 kB/s 2024-04-26T23:33:50.421 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.421 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.471 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.524 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.524 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000133779 s, 0.0 kB/s 2024-04-26T23:33:50.525 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.525 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.575 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.631 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.632 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.632 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000139348 s, 0.0 kB/s 2024-04-26T23:33:50.633 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.633 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.687 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.741 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.741 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000135732 s, 0.0 kB/s 2024-04-26T23:33:50.742 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.742 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.791 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.848 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.848 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000137371 s, 0.0 kB/s 2024-04-26T23:33:50.849 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.849 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:50.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:50.899 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:50.952 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146128 s, 0.0 kB/s 2024-04-26T23:33:50.953 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:50.953 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.003 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.061 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.061 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151995 s, 0.0 kB/s 2024-04-26T23:33:51.062 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.063 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.115 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.169 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.169 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146369 s, 0.0 kB/s 2024-04-26T23:33:51.170 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.170 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.219 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.273 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.273 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000156053 s, 0.0 kB/s 2024-04-26T23:33:51.274 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.274 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.323 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.380 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.380 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.380 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147906 s, 0.0 kB/s 2024-04-26T23:33:51.381 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.381 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.435 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.488 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.489 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.489 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142796 s, 0.0 kB/s 2024-04-26T23:33:51.490 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.490 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.597 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.597 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151703 s, 0.0 kB/s 2024-04-26T23:33:51.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.648 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.700 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148973 s, 0.0 kB/s 2024-04-26T23:33:51.701 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.702 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.809 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.809 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.809 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147555 s, 0.0 kB/s 2024-04-26T23:33:51.810 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.810 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.860 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:51.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:51.912 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:51.912 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148808 s, 0.0 kB/s 2024-04-26T23:33:51.913 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:51.913 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:51.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:51.967 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140259 s, 0.0 kB/s 2024-04-26T23:33:52.025 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.025 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.080 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.133 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.133 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150415 s, 0.0 kB/s 2024-04-26T23:33:52.134 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.134 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.183 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.236 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.237 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.237 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146598 s, 0.0 kB/s 2024-04-26T23:33:52.238 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.238 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.291 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.345 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.345 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151997 s, 0.0 kB/s 2024-04-26T23:33:52.346 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.346 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.453 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.454 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152231 s, 0.0 kB/s 2024-04-26T23:33:52.455 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.455 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.507 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.560 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000154889 s, 0.0 kB/s 2024-04-26T23:33:52.561 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.562 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.611 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149118 s, 0.0 kB/s 2024-04-26T23:33:52.666 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.666 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.719 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.773 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.773 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.773 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147226 s, 0.0 kB/s 2024-04-26T23:33:52.774 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.774 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.823 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.876 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.876 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.876 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014672 s, 0.0 kB/s 2024-04-26T23:33:52.877 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.877 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:52.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:52.927 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149797 s, 0.0 kB/s 2024-04-26T23:33:52.981 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:52.981 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.031 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.084 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.084 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.084 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149389 s, 0.0 kB/s 2024-04-26T23:33:53.085 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.085 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.136 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.216 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000158814 s, 0.0 kB/s 2024-04-26T23:33:53.217 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.217 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.320 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.320 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000142093 s, 0.0 kB/s 2024-04-26T23:33:53.321 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.321 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.372 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000140099 s, 0.0 kB/s 2024-04-26T23:33:53.425 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.425 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.532 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.532 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014773 s, 0.0 kB/s 2024-04-26T23:33:53.533 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.533 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.588 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.640 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.640 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000144223 s, 0.0 kB/s 2024-04-26T23:33:53.641 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.641 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.691 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.745 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.745 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151662 s, 0.0 kB/s 2024-04-26T23:33:53.746 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.747 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.799 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.853 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.853 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153667 s, 0.0 kB/s 2024-04-26T23:33:53.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:53.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:53.908 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:53.961 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:53.962 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:53.962 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149633 s, 0.0 kB/s 2024-04-26T23:33:53.963 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:53.963 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.077 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.077 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147371 s, 0.0 kB/s 2024-04-26T23:33:54.078 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.079 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.131 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000155338 s, 0.0 kB/s 2024-04-26T23:33:54.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.297 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.297 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000146228 s, 0.0 kB/s 2024-04-26T23:33:54.298 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.298 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.347 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.401 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.401 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000153858 s, 0.0 kB/s 2024-04-26T23:33:54.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.402 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.455 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.510 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.510 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000150892 s, 0.0 kB/s 2024-04-26T23:33:54.511 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.511 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147598 s, 0.0 kB/s 2024-04-26T23:33:54.622 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.622 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.671 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.729 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.729 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000151733 s, 0.0 kB/s 2024-04-26T23:33:54.730 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.730 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.788 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000152346 s, 0.0 kB/s 2024-04-26T23:33:54.842 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.842 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:54.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:54.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147337 s, 0.0 kB/s 2024-04-26T23:33:54.946 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:54.946 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.000 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.056 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.057 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.057 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000149617 s, 0.0 kB/s 2024-04-26T23:33:55.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.108 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00015046 s, 0.0 kB/s 2024-04-26T23:33:55.162 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.162 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.211 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.00014546 s, 0.0 kB/s 2024-04-26T23:33:55.266 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.266 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.315 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.369 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.369 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000145632 s, 0.0 kB/s 2024-04-26T23:33:55.370 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.370 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.427 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.484 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.485 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.485 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000143022 s, 0.0 kB/s 2024-04-26T23:33:55.486 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.486 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.535 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.590 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.590 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000147645 s, 0.0 kB/s 2024-04-26T23:33:55.592 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:33:55.592 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:33:55.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:33:55.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol62860/71816828-f26b-416d-87b9-bc735b054d1e/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2024-04-26T23:33:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records in 2024-04-26T23:33:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:0+0 records out 2024-04-26T23:33:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:0 bytes copied, 0.000148633 s, 0.0 kB/s 2024-04-26T23:33:55.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol62860 2024-04-26T23:33:55.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.890+0000 7f9cd3e00640 1 Processor -- start 2024-04-26T23:33:55.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.890+0000 7f9cd3e00640 1 -- start start 2024-04-26T23:33:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0d11e0 0x7f9ccc06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd3e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ccc0b41f0 0x7f9ccc0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd3e00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc072cf0 con 0x7f9ccc0d15c0 2024-04-26T23:33:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd3e00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc072ad0 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd3e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc072fd0 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd0a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9ccc0d15c0 0x7f9ccc0723c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44434/0 (socket says 172.21.15.39:44434) 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd0a00640 1 -- 172.21.15.39:0/2036811414 learned_addr learned my addr 172.21.15.39:0/2036811414 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1e00640 1 --2- 172.21.15.39:0/2036811414 >> v2:172.21.15.39:3300/0 conn(0x7f9ccc0b41f0 0x7f9ccc0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1400640 1 --2- 172.21.15.39:0/2036811414 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0d11e0 0x7f9ccc06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1e00640 1 -- 172.21.15.39:0/2036811414 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0d11e0 msgr2=0x7f9ccc06f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:33:55.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1e00640 1 --2- 172.21.15.39:0/2036811414 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0d11e0 0x7f9ccc06f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:55.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9ccbe00640 1 -- 172.21.15.39:0/2036811414 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128397864 0 0) 0x7f9ccc072cf0 con 0x7f9ccc0d15c0 2024-04-26T23:33:55.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1e00640 1 -- 172.21.15.39:0/2036811414 >> v1:172.21.15.39:6789/0 conn(0x7f9ccc0d15c0 legacy=0x7f9ccc0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:33:55.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.894+0000 7f9cd1e00640 1 -- 172.21.15.39:0/2036811414 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0732b0 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd1e00640 1 --2- 172.21.15.39:0/2036811414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc0b4660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b64c0 tx=0x7f9cc401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359fb85c3b835a8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:33:55.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9ccbe00640 1 -- 172.21.15.39:0/2036811414 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40b2070 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9ccbe00640 1 -- 172.21.15.39:0/2036811414 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40a58f0 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9ccbe00640 1 -- 172.21.15.39:0/2036811414 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40a5cc0 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2036811414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0b41f0 msgr2=0x7f9ccc0b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- 172.21.15.39:0/2036811414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc0b4660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b64c0 tx=0x7f9cc401c810 comp rx=0 tx=0).stop 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2036811414 shutdown_connections 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- 172.21.15.39:0/2036811414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc0b4660 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- 172.21.15.39:0/2036811414 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0d11e0 0x7f9ccc06f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2036811414 >> 172.21.15.39:0/2036811414 conn(0x7f9ccc06c7d0 msgr2=0x7f9ccc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2036811414 shutdown_connections 2024-04-26T23:33:55.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2036811414 wait complete. 2024-04-26T23:33:55.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 Processor -- start 2024-04-26T23:33:55.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- start start 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0d11e0 0x7f9ccc1501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc0d15c0 0x7f9ccc14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc162b70 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc1629f0 con 0x7f9ccc0b41f0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd3e00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc16c1c0 con 0x7f9ccc0d15c0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.898+0000 7f9cd0a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0d11e0 0x7f9ccc1501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0d11e0 0x7f9ccc1501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52198/0 (socket says 172.21.15.39:52198) 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 -- 172.21.15.39:0/2560572067 learned_addr learned my addr 172.21.15.39:0/2560572067 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd1400640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd1e00640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc0d15c0 0x7f9ccc14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 -- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc0d15c0 msgr2=0x7f9ccc14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc0d15c0 0x7f9ccc14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 -- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ccc0b41f0 msgr2=0x7f9ccc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ccc0b41f0 0x7f9ccc159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 -- 172.21.15.39:0/2560572067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc150c90 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd1e00640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc0d15c0 0x7f9ccc14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd0a00640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ccc0d11e0 0x7f9ccc1501d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80011f0 tx=0x7f9cb800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8018070 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb80074e0 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8004a10 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2560572067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc150f70 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2560572067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc151530 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2560572067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc06a720 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.902+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f9cb801b070 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.906+0000 7f9cc9600640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9cac0684d0 0x7f9cac06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:55.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.906+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f9cb8085ef0 con 0x7f9ccc0d11e0 2024-04-26T23:33:55.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.906+0000 7f9cd1400640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9cac0684d0 0x7f9cac06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:55.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.906+0000 7f9cd1400640 1 --2- 172.21.15.39:0/2560572067 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9cac0684d0 0x7f9cac06a990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000b930 tx=0x7f9cc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:33:55.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:55.910+0000 7f9cc9600640 1 -- 172.21.15.39:0/2560572067 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9cb80562c0 con 0x7f9ccc0d11e0 2024-04-26T23:33:56.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:33:56.098+0000 7f9cd3e00640 1 -- 172.21.15.39:0/2560572067 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol62860", "target": ["mon-mgr", ""]}) -- 0x7f9ccc0b18b0 con 0x7f9cac0684d0 2024-04-26T23:34:09.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:09.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:39.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:39.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:09.927 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:09.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:39.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:39.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:55.771 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-26T23:35:55.772 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:35:55.772 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:35:55.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:35:55.959 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:35:55.959 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:35:55.959 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:35:55.960 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:55.969 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:35:55.969 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:56.023 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:35:56.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.217+0000 7efda7400640 1 Processor -- start 2024-04-26T23:35:56.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.217+0000 7efda7400640 1 -- start start 2024-04-26T23:35:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda7400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efda00cfe00 0x7efda006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda7400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda0074750 con 0x7efda00cd810 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda7400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda00d0290 con 0x7efda00742f0 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda7400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7efda00d0b10 con 0x7efda00cfe00 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efda00cd810 0x7efda0144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39824/0 (socket says 172.21.15.39:39824) 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 -- 172.21.15.39:0/1242895383 learned_addr learned my addr 172.21.15.39:0/1242895383 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:35:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda5400640 1 --2- 172.21.15.39:0/1242895383 >> v2:172.21.15.71:3300/0 conn(0x7efda00cfe00 0x7efda006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577949550 0 0) 0x7efda0074750 con 0x7efda00cd810 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd88003530 con 0x7efda00cd810 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751419461 0 0) 0x7efda00d0290 con 0x7efda00742f0 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda0074750 con 0x7efda00742f0 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 93367218 0 0) 0x7efd88003530 con 0x7efda00cd810 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 >> v2:172.21.15.71:3300/0 conn(0x7efda00cfe00 msgr2=0x7efda006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 --2- 172.21.15.39:0/1242895383 >> v2:172.21.15.71:3300/0 conn(0x7efda00cfe00 0x7efda006ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 >> v1:172.21.15.71:6789/0 conn(0x7efda00742f0 legacy=0x7efda00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda00d0550 con 0x7efda00cd810 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7efd94001680 con 0x7efda00cd810 2024-04-26T23:35:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 >> v1:172.21.15.39:6789/0 conn(0x7efda00cd810 legacy=0x7efda0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efd88003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd88004810 0x7efd88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd880051d0 0x7efd8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efda00d0b10 con 0x7efd88003b50 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd8800c100 con 0x7efd880051d0 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efd8800c300 con 0x7efd88004810 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efd88003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd88004810 0x7efd88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda5400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd880051d0 0x7efd8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 -- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd88004810 msgr2=0x7efd88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd88004810 0x7efd88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 -- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd880051d0 msgr2=0x7efd8800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd880051d0 0x7efd8800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda4a00640 1 -- 172.21.15.39:0/1242895383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd88003530 con 0x7efd88003b50 2024-04-26T23:35:56.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efda5400640 1 -- 172.21.15.39:0/1242895383 reap_dead start 2024-04-26T23:35:56.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.221+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efd88004810 0x7efd88004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:35:56.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda4a00640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efd88003f50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c190 tx=0x7efd9401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26e12c3676f41d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94007cd0 con 0x7efd88003b50 2024-04-26T23:35:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940a9020 con 0x7efd88003b50 2024-04-26T23:35:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efd9f400640 1 -- 172.21.15.39:0/1242895383 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94005ae0 con 0x7efd88003b50 2024-04-26T23:35:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 -- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 msgr2=0x7efd88003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efd88003f50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c190 tx=0x7efd9401cc20 comp rx=0 tx=0).stop 2024-04-26T23:35:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 -- 172.21.15.39:0/1242895383 shutdown_connections 2024-04-26T23:35:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 --2- 172.21.15.39:0/1242895383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efd88003f50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 -- 172.21.15.39:0/1242895383 >> 172.21.15.39:0/1242895383 conn(0x7efda00b2af0 msgr2=0x7efda00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 -- 172.21.15.39:0/1242895383 shutdown_connections 2024-04-26T23:35:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.225+0000 7efda7400640 1 -- 172.21.15.39:0/1242895383 wait complete. 2024-04-26T23:35:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 Processor -- start 2024-04-26T23:35:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- start start 2024-04-26T23:35:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 0x7efda00aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efda0141f10 0x7efda0142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efda00ce180 con 0x7efd88003b50 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efda00ce000 con 0x7efda00afa80 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efda0143bb0 con 0x7efda0141f10 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33142/0 (socket says 172.21.15.39:33142) 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 -- 172.21.15.39:0/1606231266 learned_addr learned my addr 172.21.15.39:0/1606231266 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 -- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efda0141f10 msgr2=0x7efda0142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 0x7efda00aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efda0141f10 0x7efda0142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 -- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 msgr2=0x7efda00aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 0x7efda00aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 -- 172.21.15.39:0/1606231266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda00b3ef0 con 0x7efd88003b50 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 0x7efda00aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda4a00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd940ab040 tx=0x7efd88005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94007cd0 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940b2070 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda00b41d0 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94001c10 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda00b4790 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.229+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda0050740 con 0x7efd88003b50 2024-04-26T23:35:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.233+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7efd94004a10 con 0x7efd88003b50 2024-04-26T23:35:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.233+0000 7efd9cc00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 0x7efd8006a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.233+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7efd9411fcb0 con 0x7efd88003b50 2024-04-26T23:35:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.233+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 0x7efd8006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.233+0000 7efd9fe00640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 0x7efd8006a990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007fd0 tx=0x7efd8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.237+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efd94016930 con 0x7efd88003b50 2024-04-26T23:35:56.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.401+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efda00b1c50 con 0x7efd88003b50 2024-04-26T23:35:56.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efd9cc00640 1 -- 172.21.15.39:0/1606231266 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16705 (secure 0 0 0) 0x7efd940f01a0 con 0x7efd88003b50 2024-04-26T23:35:56.407 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:35:56.408 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:55.787466+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:35:56.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 msgr2=0x7efd8006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 0x7efd8006a990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007fd0 tx=0x7efd8c009040 comp rx=0 tx=0).stop 2024-04-26T23:35:56.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 msgr2=0x7efda0140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd940ab040 tx=0x7efd88005840 comp rx=0 tx=0).stop 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 shutdown_connections 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efd800684d0 0x7efd8006a990 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efda0141f10 0x7efda0142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efda00afa80 0x7efda00aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 --2- 172.21.15.39:0/1606231266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd88003b50 0x7efda0140aa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 >> 172.21.15.39:0/1606231266 conn(0x7efda00b2af0 msgr2=0x7efda0073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 shutdown_connections 2024-04-26T23:35:56.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.405+0000 7efda7400640 1 -- 172.21.15.39:0/1606231266 wait complete. 2024-04-26T23:35:56.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:28:21.185178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:28:22.371317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:35:56.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:35:56.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.569+0000 7f1cad200640 1 Processor -- start 2024-04-26T23:35:56.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.569+0000 7f1cad200640 1 -- start start 2024-04-26T23:35:56.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1cad200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1cad200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ca806d4c0 0x7f1ca806f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1cad200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca81492a0 con 0x7f1ca80cf770 2024-04-26T23:35:56.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1cad200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca80cfbd0 con 0x7f1ca806d4c0 2024-04-26T23:35:56.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1cad200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca8070840 con 0x7f1ca81488f0 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ca806d4c0 0x7f1ca806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:59424/0 (socket says 172.21.15.39:59424) 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 -- 172.21.15.39:0/527736038 learned_addr learned my addr 172.21.15.39:0/527736038 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 -- 172.21.15.39:0/527736038 >> v2:172.21.15.71:3300/0 conn(0x7f1ca806d4c0 msgr2=0x7f1ca806f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 --2- 172.21.15.39:0/527736038 >> v2:172.21.15.71:3300/0 conn(0x7f1ca806d4c0 0x7f1ca806f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 -- 172.21.15.39:0/527736038 >> v1:172.21.15.71:6789/0 conn(0x7f1ca80cf770 legacy=0x7f1ca806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.573+0000 7f1ca5e00640 1 -- 172.21.15.39:0/527736038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca806d9c0 con 0x7f1ca81488f0 2024-04-26T23:35:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1ca5e00640 1 --2- 172.21.15.39:0/527736038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009e50 tx=0x7f1c9801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a824cb39eea4266e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1ca5400640 1 -- 172.21.15.39:0/527736038 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980a58d0 con 0x7f1ca81488f0 2024-04-26T23:35:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1ca5400640 1 -- 172.21.15.39:0/527736038 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c980a5a70 con 0x7f1ca81488f0 2024-04-26T23:35:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1ca5400640 1 -- 172.21.15.39:0/527736038 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980a5e40 con 0x7f1ca81488f0 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- 172.21.15.39:0/527736038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 msgr2=0x7f1ca80cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- 172.21.15.39:0/527736038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009e50 tx=0x7f1c9801ca00 comp rx=0 tx=0).stop 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- 172.21.15.39:0/527736038 shutdown_connections 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- 172.21.15.39:0/527736038 >> v2:172.21.15.71:3300/0 conn(0x7f1ca806d4c0 0x7f1ca806f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- 172.21.15.39:0/527736038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca80cf230 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- 172.21.15.39:0/527736038 >> 172.21.15.39:0/527736038 conn(0x7f1ca80ce0e0 msgr2=0x7f1ca80ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- 172.21.15.39:0/527736038 shutdown_connections 2024-04-26T23:35:56.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- 172.21.15.39:0/527736038 wait complete. 2024-04-26T23:35:56.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 Processor -- start 2024-04-26T23:35:56.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- start start 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ca806d4c0 0x7f1ca80c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8148cd0 con 0x7f1ca80cf770 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca806f070 con 0x7f1ca806d4c0 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.577+0000 7f1cad200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca80702e0 con 0x7f1ca81488f0 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33148/0 (socket says 172.21.15.39:33148) 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 -- 172.21.15.39:0/2633829427 learned_addr learned my addr 172.21.15.39:0/2633829427 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:56.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1ca6800640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1ca5e00640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ca806d4c0 0x7f1ca80c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 -- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 msgr2=0x7f1ca815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 -- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ca806d4c0 msgr2=0x7f1ca80c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ca806d4c0 0x7f1ca80c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 -- 172.21.15.39:0/2633829427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca80b7370 con 0x7f1ca80cf770 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1ca6800640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9d400640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c450 tx=0x7f1c9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90016020 con 0x7f1ca80cf770 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c900052d0 con 0x7f1ca80cf770 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90007260 con 0x7f1ca80cf770 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca80c9b60 con 0x7f1ca80cf770 2024-04-26T23:35:56.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca80ca120 con 0x7f1ca80cf770 2024-04-26T23:35:56.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca806a720 con 0x7f1ca80cf770 2024-04-26T23:35:56.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f1c90007400 con 0x7f1ca80cf770 2024-04-26T23:35:56.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.581+0000 7f1c9ea00640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 0x7f1c8406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.585+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f1c90086540 con 0x7f1ca80cf770 2024-04-26T23:35:56.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.585+0000 7f1ca5e00640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 0x7f1c8406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.585+0000 7f1ca5e00640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 0x7f1c8406a960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c980ae000 tx=0x7f1c980a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.589+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c90020020 con 0x7f1ca80cf770 2024-04-26T23:35:56.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.749+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ca815eb10 con 0x7f1ca80cf770 2024-04-26T23:35:56.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1c9ea00640 1 -- 172.21.15.39:0/2633829427 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7f1c90005480 con 0x7f1ca80cf770 2024-04-26T23:35:56.755 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:35:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 msgr2=0x7f1c8406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 0x7f1c8406a960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c980ae000 tx=0x7f1c980a7070 comp rx=0 tx=0).stop 2024-04-26T23:35:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 msgr2=0x7f1ca80c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c450 tx=0x7f1c9000c910 comp rx=0 tx=0).stop 2024-04-26T23:35:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 shutdown_connections 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1c840684a0 0x7f1c8406a960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ca81488f0 0x7f1ca815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ca80cf770 0x7f1ca80c9110 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 --2- 172.21.15.39:0/2633829427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ca806d4c0 0x7f1ca80c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 >> 172.21.15.39:0/2633829427 conn(0x7f1ca80ce0e0 msgr2=0x7f1ca80b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:56.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 shutdown_connections 2024-04-26T23:35:56.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.753+0000 7f1cad200640 1 -- 172.21.15.39:0/2633829427 wait complete. 2024-04-26T23:35:56.775 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:35:56.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.917+0000 7f7433800640 1 Processor -- start 2024-04-26T23:35:56.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.917+0000 7f7433800640 1 -- start start 2024-04-26T23:35:56.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7433800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f742c161850 0x7f742c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7433800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7433800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c06e500 con 0x7f742c140170 2024-04-26T23:35:56.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7433800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f742c06f110 con 0x7f742c161850 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7433800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f742c06e7e0 con 0x7f742c0d1720 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f742c161850 0x7f742c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7430e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f742c140170 0x7f742c15de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39828/0 (socket says 172.21.15.39:39828) 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7430e00640 1 -- 172.21.15.39:0/1651046802 learned_addr learned my addr 172.21.15.39:0/1651046802 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7431800640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 -- 172.21.15.39:0/1651046802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 msgr2=0x7f742c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 -- 172.21.15.39:0/1651046802 >> v1:172.21.15.39:6789/0 conn(0x7f742c140170 legacy=0x7f742c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 -- 172.21.15.39:0/1651046802 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c06eac0 con 0x7f742c161850 2024-04-26T23:35:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f742be00640 1 -- 172.21.15.39:0/1651046802 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079952837 0 0) 0x7f742c06e500 con 0x7f742c140170 2024-04-26T23:35:56.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f7423e00640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c161850 0x7f742c0d11e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f542cd9114846ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f742be00640 1 -- 172.21.15.39:0/1651046802 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140b0070 con 0x7f742c161850 2024-04-26T23:35:56.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f742be00640 1 -- 172.21.15.39:0/1651046802 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140ab600 con 0x7f742c161850 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.921+0000 7f742be00640 1 -- 172.21.15.39:0/1651046802 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140ab9d0 con 0x7f742c161850 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- 172.21.15.39:0/1651046802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c161850 msgr2=0x7f742c0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c161850 0x7f742c0d11e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ce30 comp rx=0 tx=0).stop 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- 172.21.15.39:0/1651046802 shutdown_connections 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- 172.21.15.39:0/1651046802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c161850 0x7f742c0d11e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- 172.21.15.39:0/1651046802 >> 172.21.15.39:0/1651046802 conn(0x7f742c06c7d0 msgr2=0x7f742c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- 172.21.15.39:0/1651046802 shutdown_connections 2024-04-26T23:35:56.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- 172.21.15.39:0/1651046802 wait complete. 2024-04-26T23:35:56.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 Processor -- start 2024-04-26T23:35:56.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- start start 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 0x7f742c129db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0d0810 con 0x7f742c140170 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0d0690 con 0x7f742c161850 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7433800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f742c0d0990 con 0x7f742c0d1720 2024-04-26T23:35:56.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33178/0 (socket says 172.21.15.39:33178) 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 -- 172.21.15.39:0/3114300981 learned_addr learned my addr 172.21.15.39:0/3114300981 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7430e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 -- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 msgr2=0x7f742c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 -- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 msgr2=0x7f742c129db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7431800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 0x7f742c129db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 0x7f742c129db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7423e00640 1 -- 172.21.15.39:0/3114300981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c142070 con 0x7f742c140170 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7430e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.925+0000 7f7431800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 0x7f742c129db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7423e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f741401a000 tx=0x7f7414019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140ba070 con 0x7f742c140170 2024-04-26T23:35:56.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140b5460 con 0x7f742c140170 2024-04-26T23:35:56.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140b0040 con 0x7f742c140170 2024-04-26T23:35:56.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c142350 con 0x7f742c140170 2024-04-26T23:35:56.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c142e30 con 0x7f742c140170 2024-04-26T23:35:56.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c06a720 con 0x7f742c140170 2024-04-26T23:35:56.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f74140bd070 con 0x7f742c140170 2024-04-26T23:35:56.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 0x7f740806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:56.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f7414121150 con 0x7f742c140170 2024-04-26T23:35:56.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.929+0000 7f7430e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 0x7f740806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:56.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.933+0000 7f7430e00640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 0x7f740806a960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f741c000f70 tx=0x7f741c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:56.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:56.933+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7414016050 con 0x7f742c140170 2024-04-26T23:35:57.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.097+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f742c06fdc0 con 0x7f742c140170 2024-04-26T23:35:57.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7429600640 1 -- 172.21.15.39:0/3114300981 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) ==== 104+0+11 (secure 0 0 0) 0x7f74140f1530 con 0x7f742c140170 2024-04-26T23:35:57.102 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 msgr2=0x7f740806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 0x7f740806a960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f741c000f70 tx=0x7f741c009040 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 msgr2=0x7f742c157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f741401a000 tx=0x7f7414019170 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 shutdown_connections 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f74080684a0 0x7f740806a960 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c161850 0x7f742c129db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f742c140170 0x7f742c157440 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 --2- 172.21.15.39:0/3114300981 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f742c0d1720 0x7f742c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 >> 172.21.15.39:0/3114300981 conn(0x7f742c06c7d0 msgr2=0x7f742c15efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 shutdown_connections 2024-04-26T23:35:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.101+0000 7f7433800640 1 -- 172.21.15.39:0/3114300981 wait complete. 2024-04-26T23:35:57.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:35:57.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 Processor -- start 2024-04-26T23:35:57.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 -- start start 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c7006def0 0x7f2c7009c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c700d14f0 con 0x7f2c7006d760 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2c700d1e20 con 0x7f2c7006def0 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.265+0000 7f2c76000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700d17d0 con 0x7f2c7015f810 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c7006def0 0x7f2c7009c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c7006def0 0x7f2c7009c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33192/0 (socket says 172.21.15.39:33192) 2024-04-26T23:35:57.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 -- 172.21.15.39:0/2198285345 learned_addr learned my addr 172.21.15.39:0/2198285345 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:57.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 -- 172.21.15.39:0/2198285345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 msgr2=0x7f2c700d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:57.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 --2- 172.21.15.39:0/2198285345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 -- 172.21.15.39:0/2198285345 >> v1:172.21.15.71:6789/0 conn(0x7f2c7006d760 legacy=0x7f2c7006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:57.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 -- 172.21.15.39:0/2198285345 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700d1ab0 con 0x7f2c7006def0 2024-04-26T23:35:57.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6f400640 1 --2- 172.21.15.39:0/2198285345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006def0 0x7f2c7009c3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c6001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b8458032d74e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6ea00640 1 -- 172.21.15.39:0/2198285345 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600a7070 con 0x7f2c7006def0 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6ea00640 1 -- 172.21.15.39:0/2198285345 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c600b0070 con 0x7f2c7006def0 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.269+0000 7f2c6ea00640 1 -- 172.21.15.39:0/2198285345 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600ab890 con 0x7f2c7006def0 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- 172.21.15.39:0/2198285345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006def0 msgr2=0x7f2c7009c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- 172.21.15.39:0/2198285345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006def0 0x7f2c7009c3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c6001c4e0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- 172.21.15.39:0/2198285345 shutdown_connections 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- 172.21.15.39:0/2198285345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- 172.21.15.39:0/2198285345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006def0 0x7f2c7009c3c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- 172.21.15.39:0/2198285345 >> 172.21.15.39:0/2198285345 conn(0x7f2c700b4c20 msgr2=0x7f2c700b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- 172.21.15.39:0/2198285345 shutdown_connections 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- 172.21.15.39:0/2198285345 wait complete. 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 Processor -- start 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- start start 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7006def0 0x7f2c701536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700ce110 con 0x7f2c7006d760 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700cdf90 con 0x7f2c7006def0 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c76000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700ce290 con 0x7f2c7015f810 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33208/0 (socket says 172.21.15.39:33208) 2024-04-26T23:35:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 -- 172.21.15.39:0/2353872984 learned_addr learned my addr 172.21.15.39:0/2353872984 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6fe00640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c67e00640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7006def0 0x7f2c701536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 -- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 msgr2=0x7f2c700c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 -- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7006def0 msgr2=0x7f2c701536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7006def0 0x7f2c701536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 -- 172.21.15.39:0/2353872984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700c84f0 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.273+0000 7f2c6f400640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ad040 tx=0x7f2c6001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600b4800 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c600b49c0 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600b4db0 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c700c87d0 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c700c8d90 con 0x7f2c7006d760 2024-04-26T23:35:57.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7006a720 con 0x7f2c7006d760 2024-04-26T23:35:57.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f2c600c7390 con 0x7f2c7006d760 2024-04-26T23:35:57.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 0x7f2c4c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f2c601215a0 con 0x7f2c7006d760 2024-04-26T23:35:57.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.277+0000 7f2c67e00640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 0x7f2c4c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.281+0000 7f2c67e00640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 0x7f2c4c06a960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c58006fd0 tx=0x7f2c58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.281+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2c600c4060 con 0x7f2c7006d760 2024-04-26T23:35:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.445+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c7015f040 con 0x7f2c7006d760 2024-04-26T23:35:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.445+0000 7f2c67400640 1 -- 172.21.15.39:0/2353872984 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) ==== 100+0+11 (secure 0 0 0) 0x7f2c600160d0 con 0x7f2c7006d760 2024-04-26T23:35:57.449 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:35:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 msgr2=0x7f2c4c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 0x7f2c4c06a960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c58006fd0 tx=0x7f2c58008040 comp rx=0 tx=0).stop 2024-04-26T23:35:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 msgr2=0x7f2c700c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ad040 tx=0x7f2c6001ad20 comp rx=0 tx=0).stop 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 shutdown_connections 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f2c4c0684a0 0x7f2c4c06a960 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c7015f810 0x7f2c700c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7006def0 0x7f2c701536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 --2- 172.21.15.39:0/2353872984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7006d760 0x7f2c700c7f10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 >> 172.21.15.39:0/2353872984 conn(0x7f2c700b4c20 msgr2=0x7f2c700cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 shutdown_connections 2024-04-26T23:35:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.449+0000 7f2c76000640 1 -- 172.21.15.39:0/2353872984 wait complete. 2024-04-26T23:35:57.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:35:57.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 Processor -- start 2024-04-26T23:35:57.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 -- start start 2024-04-26T23:35:57.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f526c0b2050 0x7f526c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f526c0cfd30 0x7f526c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c0d06b0 con 0x7f526c0d1110 2024-04-26T23:35:57.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f526c0d2490 con 0x7f526c0b2050 2024-04-26T23:35:57.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f526c0b2430 con 0x7f526c0cfd30 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f526c0b2050 0x7f526c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f526c0b2050 0x7f526c15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33210/0 (socket says 172.21.15.39:33210) 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 -- 172.21.15.39:0/2495849046 learned_addr learned my addr 172.21.15.39:0/2495849046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f5262000640 1 --1- 172.21.15.39:0/2495849046 >> v1:172.21.15.39:6789/0 conn(0x7f526c0d1110 0x7f526c0cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39832/0 (socket says 172.21.15.39:39832) 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526b400640 1 --2- 172.21.15.39:0/2495849046 >> v2:172.21.15.71:3300/0 conn(0x7f526c0cfd30 0x7f526c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 -- 172.21.15.39:0/2495849046 >> v2:172.21.15.71:3300/0 conn(0x7f526c0cfd30 msgr2=0x7f526c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:57.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 --2- 172.21.15.39:0/2495849046 >> v2:172.21.15.71:3300/0 conn(0x7f526c0cfd30 0x7f526c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 -- 172.21.15.39:0/2495849046 >> v1:172.21.15.39:6789/0 conn(0x7f526c0d1110 legacy=0x7f526c0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.609+0000 7f526aa00640 1 -- 172.21.15.39:0/2495849046 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c0d1880 con 0x7f526c0b2050 2024-04-26T23:35:57.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526aa00640 1 --2- 172.21.15.39:0/2495849046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c15f770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7753943e454275 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526a000640 1 -- 172.21.15.39:0/2495849046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0b1070 con 0x7f526c0b2050 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526a000640 1 -- 172.21.15.39:0/2495849046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c0ac640 con 0x7f526c0b2050 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526a000640 1 -- 172.21.15.39:0/2495849046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0aca10 con 0x7f526c0b2050 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 -- 172.21.15.39:0/2495849046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 msgr2=0x7f526c15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 --2- 172.21.15.39:0/2495849046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c15f770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c01c310 comp rx=0 tx=0).stop 2024-04-26T23:35:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 -- 172.21.15.39:0/2495849046 shutdown_connections 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 --2- 172.21.15.39:0/2495849046 >> v2:172.21.15.71:3300/0 conn(0x7f526c0cfd30 0x7f526c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 --2- 172.21.15.39:0/2495849046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c15f770 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 -- 172.21.15.39:0/2495849046 >> 172.21.15.39:0/2495849046 conn(0x7f526c0d2da0 msgr2=0x7f526c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 -- 172.21.15.39:0/2495849046 shutdown_connections 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.613+0000 7f526be00640 1 -- 172.21.15.39:0/2495849046 wait complete. 2024-04-26T23:35:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 Processor -- start 2024-04-26T23:35:57.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- start start 2024-04-26T23:35:57.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526c0cfd30 0x7f526c14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f526c0d1110 0x7f526c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f526c06d720 con 0x7f526c0b2050 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f526c0d1520 con 0x7f526c0cfd30 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f526c06d8a0 con 0x7f526c0d1110 2024-04-26T23:35:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33214/0 (socket says 172.21.15.39:33214) 2024-04-26T23:35:57.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 -- 172.21.15.39:0/614567602 learned_addr learned my addr 172.21.15.39:0/614567602 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:57.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 -- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f526c0d1110 msgr2=0x7f526c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f526c0d1110 0x7f526c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 -- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526c0cfd30 msgr2=0x7f526c14f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526c0cfd30 0x7f526c14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 -- 172.21.15.39:0/614567602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c158b90 con 0x7f526c0b2050 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526aa00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f525c0af040 tx=0x7f525c0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0bb070 con 0x7f526c0b2050 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c0b5640 con 0x7f526c0b2050 2024-04-26T23:35:57.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526c158e70 con 0x7f526c0b2050 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0b1040 con 0x7f526c0b2050 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526c0c6bb0 con 0x7f526c0b2050 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.617+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526c0506d0 con 0x7f526c0b2050 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.621+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f525c0be070 con 0x7f526c0b2050 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.621+0000 7f5263e00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 0x7f524806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.621+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f525c11fbf0 con 0x7f526c0b2050 2024-04-26T23:35:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.621+0000 7f5262000640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 0x7f524806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.621+0000 7f5262000640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 0x7f524806a960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5254000f70 tx=0x7f5254007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.625+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f526c0cf230 con 0x7f526c0b2050 2024-04-26T23:35:57.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f526c0cf8d0 con 0x7f526c0b2050 2024-04-26T23:35:57.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f5263e00640 1 -- 172.21.15.39:0/614567602 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f525c0f0040 con 0x7f526c0b2050 2024-04-26T23:35:57.804 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 msgr2=0x7f524806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 0x7f524806a960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5254000f70 tx=0x7f5254007a10 comp rx=0 tx=0).stop 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 msgr2=0x7f526c0b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f525c0af040 tx=0x7f525c0190b0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 shutdown_connections 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f52480684a0 0x7f524806a960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f526c0d1110 0x7f526c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526c0cfd30 0x7f526c14f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 --2- 172.21.15.39:0/614567602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c0b2050 0x7f526c0b0800 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:57.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 >> 172.21.15.39:0/614567602 conn(0x7f526c0d2da0 msgr2=0x7f526c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:57.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 shutdown_connections 2024-04-26T23:35:57.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:57.801+0000 7f526be00640 1 -- 172.21.15.39:0/614567602 wait complete. 2024-04-26T23:35:57.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:35:57.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:35:57.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T23:35:57.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:35:57.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:35:57.911 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:35:57.920 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:35:57.920 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:35:57.920 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:57.930 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:35:57.930 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:57.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:35:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 Processor -- start 2024-04-26T23:35:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 -- start start 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99740cf2a0 0x7f997406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99740cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9974160060 con 0x7f9974145820 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f99740cd5c0 con 0x7f99740cf2a0 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9979a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9974160340 con 0x7f997406fab0 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99740cf2a0 0x7f997406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99740cf2a0 0x7f997406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33226/0 (socket says 172.21.15.39:33226) 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9972a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9974145820 0x7f99740b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39834/0 (socket says 172.21.15.39:39834) 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 -- 172.21.15.39:0/3621423691 learned_addr learned my addr 172.21.15.39:0/3621423691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9973400640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99740cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 -- 172.21.15.39:0/3621423691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 msgr2=0x7f99740cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99740cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 -- 172.21.15.39:0/3621423691 >> v1:172.21.15.39:6789/0 conn(0x7f9974145820 legacy=0x7f99740b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f996a000640 1 -- 172.21.15.39:0/3621423691 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9974160620 con 0x7f99740cf2a0 2024-04-26T23:35:58.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.125+0000 7f9972000640 1 -- 172.21.15.39:0/3621423691 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155691967 0 0) 0x7f9974160060 con 0x7f9974145820 2024-04-26T23:35:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f996a000640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99740cf2a0 0x7f997406f570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f995c00bb10 tx=0x7f995c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e0eeec014b4225 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9972000640 1 -- 172.21.15.39:0/3621423691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c0b4070 con 0x7f99740cf2a0 2024-04-26T23:35:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9972000640 1 -- 172.21.15.39:0/3621423691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c0a7b00 con 0x7f99740cf2a0 2024-04-26T23:35:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9972000640 1 -- 172.21.15.39:0/3621423691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c0af440 con 0x7f99740cf2a0 2024-04-26T23:35:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 -- 172.21.15.39:0/3621423691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99740cf2a0 msgr2=0x7f997406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99740cf2a0 0x7f997406f570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f995c00bb10 tx=0x7f995c01ec30 comp rx=0 tx=0).stop 2024-04-26T23:35:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 -- 172.21.15.39:0/3621423691 shutdown_connections 2024-04-26T23:35:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99740cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 --2- 172.21.15.39:0/3621423691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99740cf2a0 0x7f997406f570 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 -- 172.21.15.39:0/3621423691 >> 172.21.15.39:0/3621423691 conn(0x7f99740b2af0 msgr2=0x7f99740b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 -- 172.21.15.39:0/3621423691 shutdown_connections 2024-04-26T23:35:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.129+0000 7f9979a00640 1 -- 172.21.15.39:0/3621423691 wait complete. 2024-04-26T23:35:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 Processor -- start 2024-04-26T23:35:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- start start 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99741563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 0x7f99741433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f997415fdb0 con 0x7f9974145820 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f997415fc30 con 0x7f99740cf2a0 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f997406e460 con 0x7f997406fab0 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33230/0 (socket says 172.21.15.39:33230) 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 -- 172.21.15.39:0/1236876469 learned_addr learned my addr 172.21.15.39:0/1236876469 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f996a000640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 0x7f99741433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9972a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99741563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 -- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 msgr2=0x7f99741563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99741563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 -- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 msgr2=0x7f99741433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 0x7f99741433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 -- 172.21.15.39:0/1236876469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9974143920 con 0x7f9974145820 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9972a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99741563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f996a000640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 0x7f99741433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9973400640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f996c009dd0 tx=0x7f996c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c018020 con 0x7f9974145820 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f996c014480 con 0x7f9974145820 2024-04-26T23:35:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c014870 con 0x7f9974145820 2024-04-26T23:35:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9974156a80 con 0x7f9974145820 2024-04-26T23:35:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9974157040 con 0x7f9974145820 2024-04-26T23:35:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.133+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9974050740 con 0x7f9974145820 2024-04-26T23:35:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.137+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f996c01b020 con 0x7f9974145820 2024-04-26T23:35:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.137+0000 7f996b400640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 0x7f995006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.137+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f996c0877a0 con 0x7f9974145820 2024-04-26T23:35:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.137+0000 7f9972a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 0x7f995006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.137+0000 7f9972a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 0x7f995006a960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9964007fd0 tx=0x7f9964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.141+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f996c022070 con 0x7f9974145820 2024-04-26T23:35:58.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.309+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99740b52e0 con 0x7f9974145820 2024-04-26T23:35:58.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.309+0000 7f996b400640 1 -- 172.21.15.39:0/1236876469 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16705 (secure 0 0 0) 0x7f9974143920 con 0x7f9974145820 2024-04-26T23:35:58.312 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:35:58.313 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:55.787466+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 msgr2=0x7f995006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 0x7f995006a960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9964007fd0 tx=0x7f9964009040 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 msgr2=0x7f997413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f996c009dd0 tx=0x7f996c00c490 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 shutdown_connections 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f99500684a0 0x7f995006a960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9974145820 0x7f997413b7a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99740cf2a0 0x7f99741433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 --2- 172.21.15.39:0/1236876469 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f997406fab0 0x7f99741563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 >> 172.21.15.39:0/1236876469 conn(0x7f99740b2af0 msgr2=0x7f99740b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 shutdown_connections 2024-04-26T23:35:58.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.313+0000 7f9979a00640 1 -- 172.21.15.39:0/1236876469 wait complete. 2024-04-26T23:35:58.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:28:21.185178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:28:22.371317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:35:58.334 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:35:58.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 Processor -- start 2024-04-26T23:35:58.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 -- start start 2024-04-26T23:35:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48f816a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f8072cf0 con 0x7f48f806f2b0 2024-04-26T23:35:58.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f8072fd0 con 0x7f48f80d11e0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48ff600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f48f8072ad0 con 0x7f48f81681a0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f48f806f2b0 0x7f48f80723c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39836/0 (socket says 172.21.15.39:39836) 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7e00640 1 -- 172.21.15.39:0/3417006831 learned_addr learned my addr 172.21.15.39:0/3417006831 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48f816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820153317 0 0) 0x7f48f8072cf0 con 0x7f48f806f2b0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e0003530 con 0x7f48f806f2b0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198914204 0 0) 0x7f48f8072fd0 con 0x7f48f80d11e0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f8072cf0 con 0x7f48f80d11e0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1696639583 0 0) 0x7f48e0003530 con 0x7f48f806f2b0 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 msgr2=0x7f48f816a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48f816a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 >> v1:172.21.15.71:6789/0 conn(0x7f48f80d11e0 legacy=0x7f48f80d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f80732b0 con 0x7f48f806f2b0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f48e4001600 con 0x7f48f806f2b0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 >> v1:172.21.15.39:6789/0 conn(0x7f48f806f2b0 legacy=0x7f48f80723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48e0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e00040e0 0x7f48e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48e0004d50 0x7f48e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8072ad0 con 0x7f48e0004d50 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48e000bbe0 con 0x7f48e00040e0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f48e000bde0 con 0x7f48f81681a0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48e0004d50 0x7f48e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48f7e00640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e00040e0 0x7f48e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fcc00640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48e0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 -- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 msgr2=0x7f48e0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48f81681a0 0x7f48e0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 -- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e00040e0 msgr2=0x7f48e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:58.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e00040e0 0x7f48e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.477+0000 7f48fd600640 1 -- 172.21.15.39:0/3417006831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e0003530 con 0x7f48e0004d50 2024-04-26T23:35:58.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48fd600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48e0004d50 0x7f48e00051d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f48f80d0d90 tx=0x7f48f001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce5ec7422776d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b2070 con 0x7f48e0004d50 2024-04-26T23:35:58.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00a5b20 con 0x7f48e0004d50 2024-04-26T23:35:58.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48f7400640 1 -- 172.21.15.39:0/3417006831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0009c10 con 0x7f48e0004d50 2024-04-26T23:35:58.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 -- 172.21.15.39:0/3417006831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48e0004d50 msgr2=0x7f48e00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 --2- 172.21.15.39:0/3417006831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48e0004d50 0x7f48e00051d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f48f80d0d90 tx=0x7f48f001cc20 comp rx=0 tx=0).stop 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48fd600640 1 -- 172.21.15.39:0/3417006831 reap_dead start 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 -- 172.21.15.39:0/3417006831 shutdown_connections 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 -- 172.21.15.39:0/3417006831 >> 172.21.15.39:0/3417006831 conn(0x7f48f806c7d0 msgr2=0x7f48f806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 -- 172.21.15.39:0/3417006831 shutdown_connections 2024-04-26T23:35:58.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.481+0000 7f48ff600640 1 -- 172.21.15.39:0/3417006831 wait complete. 2024-04-26T23:35:58.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 Processor -- start 2024-04-26T23:35:58.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- start start 2024-04-26T23:35:58.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48e0004d50 0x7f48f8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8156c50 0x7f48f81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8162b70 con 0x7f48f8154750 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81629f0 con 0x7f48f8156c50 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f48f816ada0 con 0x7f48e0004d50 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33252/0 (socket says 172.21.15.39:33252) 2024-04-26T23:35:58.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 -- 172.21.15.39:0/2461670437 learned_addr learned my addr 172.21.15.39:0/2461670437 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fcc00640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48e0004d50 0x7f48f8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48f7e00640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8156c50 0x7f48f81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 -- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48e0004d50 msgr2=0x7f48f8145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48e0004d50 0x7f48f8145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 -- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8156c50 msgr2=0x7f48f81570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8156c50 0x7f48f81570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 -- 172.21.15.39:0/2461670437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f8155110 con 0x7f48f8154750 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48fd600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f48f0002240 tx=0x7f48f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00bd070 con 0x7f48f8154750 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00a5920 con 0x7f48f8154750 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f81553a0 con 0x7f48f8154750 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b2040 con 0x7f48f8154750 2024-04-26T23:35:58.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.485+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f8155960 con 0x7f48f8154750 2024-04-26T23:35:58.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f81f9170 con 0x7f48f8154750 2024-04-26T23:35:58.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f48f00c0070 con 0x7f48f8154750 2024-04-26T23:35:58.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48f4c00640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 0x7f48d806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f48f0120870 con 0x7f48f8154750 2024-04-26T23:35:58.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48fcc00640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 0x7f48d806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.489+0000 7f48fcc00640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 0x7f48d806a990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48ec007fd0 tx=0x7f48ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.493+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f48f0016930 con 0x7f48f8154750 2024-04-26T23:35:58.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.657+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f48f806a720 con 0x7f48f8154750 2024-04-26T23:35:58.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.657+0000 7f48f4c00640 1 -- 172.21.15.39:0/2461670437 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7f48f00f05f0 con 0x7f48f8154750 2024-04-26T23:35:58.661 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 msgr2=0x7f48d806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 0x7f48d806a990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48ec007fd0 tx=0x7f48ec009040 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 msgr2=0x7f48f8154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f48f0002240 tx=0x7f48f0009750 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 shutdown_connections 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f48d80684d0 0x7f48d806a990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f8154750 0x7f48f8154bd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8156c50 0x7f48f81570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 --2- 172.21.15.39:0/2461670437 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48e0004d50 0x7f48f8145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 >> 172.21.15.39:0/2461670437 conn(0x7f48f806c7d0 msgr2=0x7f48f80b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 shutdown_connections 2024-04-26T23:35:58.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.661+0000 7f48ff600640 1 -- 172.21.15.39:0/2461670437 wait complete. 2024-04-26T23:35:58.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:35:58.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 Processor -- start 2024-04-26T23:35:58.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 -- start start 2024-04-26T23:35:58.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc08140170 0x7fbc0815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc0815e340 0x7fbc080d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0806e500 con 0x7fbc08161850 2024-04-26T23:35:58.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0806f110 con 0x7fbc0815e340 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc10600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0806e7e0 con 0x7fbc08140170 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc0815e340 0x7fbc080d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc0815e340 0x7fbc080d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33268/0 (socket says 172.21.15.39:33268) 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 -- 172.21.15.39:0/111235612 learned_addr learned my addr 172.21.15.39:0/111235612 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0dc00640 1 --2- 172.21.15.39:0/111235612 >> v2:172.21.15.71:3300/0 conn(0x7fbc08140170 0x7fbc0815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 -- 172.21.15.39:0/111235612 >> v2:172.21.15.71:3300/0 conn(0x7fbc08140170 msgr2=0x7fbc0815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 --2- 172.21.15.39:0/111235612 >> v2:172.21.15.71:3300/0 conn(0x7fbc08140170 0x7fbc0815de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 -- 172.21.15.39:0/111235612 >> v1:172.21.15.71:6789/0 conn(0x7fbc08161850 legacy=0x7fbc08142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.825+0000 7fbc0d200640 1 -- 172.21.15.39:0/111235612 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0806eac0 con 0x7fbc0815e340 2024-04-26T23:35:58.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc0d200640 1 --2- 172.21.15.39:0/111235612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc080d11e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc080b64c0 tx=0x7fbbf401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f33f7997cbb7d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc07e00640 1 -- 172.21.15.39:0/111235612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40b0070 con 0x7fbc0815e340 2024-04-26T23:35:58.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc07e00640 1 -- 172.21.15.39:0/111235612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40ab600 con 0x7fbc0815e340 2024-04-26T23:35:58.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc07e00640 1 -- 172.21.15.39:0/111235612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab9d0 con 0x7fbc0815e340 2024-04-26T23:35:58.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 -- 172.21.15.39:0/111235612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 msgr2=0x7fbc080d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 --2- 172.21.15.39:0/111235612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc080d11e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc080b64c0 tx=0x7fbbf401c460 comp rx=0 tx=0).stop 2024-04-26T23:35:58.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 -- 172.21.15.39:0/111235612 shutdown_connections 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 --2- 172.21.15.39:0/111235612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc080d11e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 --2- 172.21.15.39:0/111235612 >> v2:172.21.15.71:3300/0 conn(0x7fbc08140170 0x7fbc0815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 -- 172.21.15.39:0/111235612 >> 172.21.15.39:0/111235612 conn(0x7fbc0806c7d0 msgr2=0x7fbc0806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 -- 172.21.15.39:0/111235612 shutdown_connections 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 -- 172.21.15.39:0/111235612 wait complete. 2024-04-26T23:35:58.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.829+0000 7fbc10600640 1 Processor -- start 2024-04-26T23:35:58.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- start start 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc08140170 0x7fbc08142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 0x7fbc08152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0816a340 con 0x7fbc0815e340 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0816a1c0 con 0x7fbc08161850 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0816a4c0 con 0x7fbc08140170 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33270/0 (socket says 172.21.15.39:33270) 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 -- 172.21.15.39:0/2004914486 learned_addr learned my addr 172.21.15.39:0/2004914486 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0dc00640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc08140170 0x7fbc08142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0e600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 0x7fbc08152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 -- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc08140170 msgr2=0x7fbc08142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc08140170 0x7fbc08142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 -- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 msgr2=0x7fbc08152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 0x7fbc08152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 -- 172.21.15.39:0/2004914486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc08157640 con 0x7fbc0815e340 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0e600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 0x7fbc08152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc0d200640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4019070 tx=0x7fbbf4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40b0040 con 0x7fbc0815e340 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40b9070 con 0x7fbc0815e340 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40b4840 con 0x7fbc0815e340 2024-04-26T23:35:58.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc08157920 con 0x7fbc0815e340 2024-04-26T23:35:58.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0815ea00 con 0x7fbc0815e340 2024-04-26T23:35:58.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.833+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0806a720 con 0x7fbc0815e340 2024-04-26T23:35:58.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.837+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fbbf40b49e0 con 0x7fbc0815e340 2024-04-26T23:35:58.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.837+0000 7fbc05600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 0x7fbbe806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:58.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.837+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fbbf4120b10 con 0x7fbc0815e340 2024-04-26T23:35:58.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.837+0000 7fbc0dc00640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 0x7fbbe806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:58.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.837+0000 7fbc0dc00640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 0x7fbbe806a960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbc0806d170 tx=0x7fbbfc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:58.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:58.841+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbc080d1b30 con 0x7fbc0815e340 2024-04-26T23:35:59.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.005+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc080cf260 con 0x7fbc0815e340 2024-04-26T23:35:59.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.005+0000 7fbc05600640 1 -- 172.21.15.39:0/2004914486 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) ==== 104+0+11 (secure 0 0 0) 0x7fbbf4016110 con 0x7fbc0815e340 2024-04-26T23:35:59.009 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:35:59.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 msgr2=0x7fbbe806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 0x7fbbe806a960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbc0806d170 tx=0x7fbbfc009190 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 msgr2=0x7fbc08156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4019070 tx=0x7fbbf4019200 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 shutdown_connections 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbbe80684a0 0x7fbbe806a960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc08161850 0x7fbc08152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc0815e340 0x7fbc08156c60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 --2- 172.21.15.39:0/2004914486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc08140170 0x7fbc08142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 >> 172.21.15.39:0/2004914486 conn(0x7fbc0806c7d0 msgr2=0x7fbc080b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 shutdown_connections 2024-04-26T23:35:59.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.009+0000 7fbc10600640 1 -- 172.21.15.39:0/2004914486 wait complete. 2024-04-26T23:35:59.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:35:59.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 Processor -- start 2024-04-26T23:35:59.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 -- start start 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91f80713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f91f8071920 0x7f91f815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f8160f20 con 0x7f91f806c3d0 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f91f8161200 con 0x7f91f8071920 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f9200200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91f81614e0 con 0x7f91f80b12a0 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fd800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f91f806c3d0 0x7f91f806c7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39840/0 (socket says 172.21.15.39:39840) 2024-04-26T23:35:59.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fd800640 1 -- 172.21.15.39:0/4188975087 learned_addr learned my addr 172.21.15.39:0/4188975087 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:35:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fce00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91f80713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559251313 0 0) 0x7f91f8160f20 con 0x7f91f806c3d0 2024-04-26T23:35:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 --2- 172.21.15.39:0/4188975087 >> v2:172.21.15.71:3300/0 conn(0x7f91f8071920 0x7f91f815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91e0003530 con 0x7f91f806c3d0 2024-04-26T23:35:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 395146728 0 0) 0x7f91e0003530 con 0x7f91f806c3d0 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 msgr2=0x7f91f80713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91f80713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 >> v2:172.21.15.71:3300/0 conn(0x7f91f8071920 msgr2=0x7f91f815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 --2- 172.21.15.39:0/4188975087 >> v2:172.21.15.71:3300/0 conn(0x7f91f8071920 0x7f91f815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f81617c0 con 0x7f91f806c3d0 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f91ec001800 con 0x7f91f806c3d0 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 >> v1:172.21.15.39:6789/0 conn(0x7f91f806c3d0 legacy=0x7f91f806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91e00039c0 0x7f91e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91e0004d50 0x7f91e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91f8161200 con 0x7f91e0004d50 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81614e0 con 0x7f91e00039c0 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91e000b9d0 con 0x7f91f80b12a0 2024-04-26T23:35:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91e0004d50 0x7f91e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fd800640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91e00039c0 0x7f91e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fce00640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 -- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 msgr2=0x7f91e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91f80b12a0 0x7f91e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 -- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91e00039c0 msgr2=0x7f91e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91e00039c0 0x7f91e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.173+0000 7f91fe200640 1 -- 172.21.15.39:0/4188975087 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e0003530 con 0x7f91e0004d50 2024-04-26T23:35:59.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f91fe200640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91e0004d50 0x7f91e00051d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f91f8073150 tx=0x7f91f001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc57381d932b1a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f00b2070 con 0x7f91e0004d50 2024-04-26T23:35:59.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f00a5c70 con 0x7f91e0004d50 2024-04-26T23:35:59.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f91f7e00640 1 -- 172.21.15.39:0/4188975087 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0009c10 con 0x7f91e0004d50 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 -- 172.21.15.39:0/4188975087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91e0004d50 msgr2=0x7f91e00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 --2- 172.21.15.39:0/4188975087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91e0004d50 0x7f91e00051d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f91f8073150 tx=0x7f91f001cc60 comp rx=0 tx=0).stop 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f91fe200640 1 -- 172.21.15.39:0/4188975087 reap_dead start 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 -- 172.21.15.39:0/4188975087 shutdown_connections 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 -- 172.21.15.39:0/4188975087 >> 172.21.15.39:0/4188975087 conn(0x7f91f80d1f30 msgr2=0x7f91f80d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 -- 172.21.15.39:0/4188975087 shutdown_connections 2024-04-26T23:35:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.177+0000 7f9200200640 1 -- 172.21.15.39:0/4188975087 wait complete. 2024-04-26T23:35:59.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 Processor -- start 2024-04-26T23:35:59.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- start start 2024-04-26T23:35:59.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91e0004d50 0x7f91f80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f8159ff0 0x7f91f80b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91f80aed20 con 0x7f91f80ca730 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91f815b120 con 0x7f91f8159ff0 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91f80aeea0 con 0x7f91e0004d50 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33286/0 (socket says 172.21.15.39:33286) 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 -- 172.21.15.39:0/2603477062 learned_addr learned my addr 172.21.15.39:0/2603477062 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fd800640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91e0004d50 0x7f91f80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fe200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f8159ff0 0x7f91f80b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 -- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91e0004d50 msgr2=0x7f91f80c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91e0004d50 0x7f91f80c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 -- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f8159ff0 msgr2=0x7f91f80b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f8159ff0 0x7f91f80b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 -- 172.21.15.39:0/2603477062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f80c9690 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91fce00640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f91e40119d0 tx=0x7f91e4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e400fb50 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e400fcf0 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f80c9970 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e400fea0 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.181+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f80c9f30 con 0x7f91f80ca730 2024-04-26T23:35:59.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f806a720 con 0x7f91f80ca730 2024-04-26T23:35:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f91e4012040 con 0x7f91f80ca730 2024-04-26T23:35:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f91f5600640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 0x7f91d806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f91e4087180 con 0x7f91f80ca730 2024-04-26T23:35:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f91fd800640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 0x7f91d806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.185+0000 7f91fd800640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 0x7f91d806a990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c10 tx=0x7f91ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.189+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f91e4019030 con 0x7f91f80ca730 2024-04-26T23:35:59.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91f815d260 con 0x7f91f80ca730 2024-04-26T23:35:59.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f91f5600640 1 -- 172.21.15.39:0/2603477062 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) ==== 100+0+11 (secure 0 0 0) 0x7f91e4056fc0 con 0x7f91f80ca730 2024-04-26T23:35:59.359 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:35:59.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 msgr2=0x7f91d806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 0x7f91d806a990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c10 tx=0x7f91ec009040 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 msgr2=0x7f91f80cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f91e40119d0 tx=0x7f91e4011e90 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 shutdown_connections 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91d80684d0 0x7f91d806a990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f8159ff0 0x7f91f80b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91f80ca730 0x7f91f80cba30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 --2- 172.21.15.39:0/2603477062 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91e0004d50 0x7f91f80c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 >> 172.21.15.39:0/2603477062 conn(0x7f91f80d1f30 msgr2=0x7f91f815c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 shutdown_connections 2024-04-26T23:35:59.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.357+0000 7f9200200640 1 -- 172.21.15.39:0/2603477062 wait complete. 2024-04-26T23:35:59.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:35:59.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.517+0000 7f46efc00640 1 Processor -- start 2024-04-26T23:35:59.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 -- start start 2024-04-26T23:35:59.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f46e8073400 0x7f46e8072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e8072e50 0x7f46e80ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e8072180 con 0x7f46e81458d0 2024-04-26T23:35:59.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f46e80739a0 con 0x7f46e8073400 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46efc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f46e8073c80 con 0x7f46e8072e50 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f46e8073400 0x7f46e8072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f46e8073400 0x7f46e8072910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33298/0 (socket says 172.21.15.39:33298) 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 -- 172.21.15.39:0/88041418 learned_addr learned my addr 172.21.15.39:0/88041418 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46edc00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e8072e50 0x7f46e80ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 -- 172.21.15.39:0/88041418 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e8072e50 msgr2=0x7f46e80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:59.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e8072e50 0x7f46e80ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 -- 172.21.15.39:0/88041418 >> v1:172.21.15.71:6789/0 conn(0x7f46e81458d0 legacy=0x7f46e80b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.521+0000 7f46e7e00640 1 -- 172.21.15.39:0/88041418 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8145cb0 con 0x7f46e8073400 2024-04-26T23:35:59.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46e7e00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e8072910 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def0f3de3e74cefd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46e7400640 1 -- 172.21.15.39:0/88041418 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40b1070 con 0x7f46e8073400 2024-04-26T23:35:59.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46e7400640 1 -- 172.21.15.39:0/88041418 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d40a8050 con 0x7f46e8073400 2024-04-26T23:35:59.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46e7400640 1 -- 172.21.15.39:0/88041418 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40ac860 con 0x7f46e8073400 2024-04-26T23:35:59.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- 172.21.15.39:0/88041418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 msgr2=0x7f46e8072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e8072910 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d401c4d0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- 172.21.15.39:0/88041418 shutdown_connections 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e8072e50 0x7f46e80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 --2- 172.21.15.39:0/88041418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e8072910 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- 172.21.15.39:0/88041418 >> 172.21.15.39:0/88041418 conn(0x7f46e806c7d0 msgr2=0x7f46e806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- 172.21.15.39:0/88041418 shutdown_connections 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- 172.21.15.39:0/88041418 wait complete. 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 Processor -- start 2024-04-26T23:35:59.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.525+0000 7f46efc00640 1 -- start start 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46e8072e50 0x7f46e8130140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e81458d0 0x7f46e8166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80cef30 con 0x7f46e8073400 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8073260 con 0x7f46e8072e50 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f46e8169150 con 0x7f46e81458d0 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33302/0 (socket says 172.21.15.39:33302) 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 -- 172.21.15.39:0/1032436408 learned_addr learned my addr 172.21.15.39:0/1032436408 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:35:59.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46ed200640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46e8072e50 0x7f46e8130140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46edc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e81458d0 0x7f46e8166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 -- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e81458d0 msgr2=0x7f46e8166910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e81458d0 0x7f46e8166910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 -- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46e8072e50 msgr2=0x7f46e8130140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46e8072e50 0x7f46e8130140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 -- 172.21.15.39:0/1032436408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8165610 con 0x7f46e8073400 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e7e00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d40af040 tx=0x7f46d4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40b1040 con 0x7f46e8073400 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d40ba070 con 0x7f46e8073400 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e81658f0 con 0x7f46e8073400 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40b5680 con 0x7f46e8073400 2024-04-26T23:35:59.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e81652c0 con 0x7f46e8073400 2024-04-26T23:35:59.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e806a720 con 0x7f46e8073400 2024-04-26T23:35:59.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.529+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f46d40b5820 con 0x7f46e8073400 2024-04-26T23:35:59.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.533+0000 7f46e4c00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 0x7f46c806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:59.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.533+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f46d4120860 con 0x7f46e8073400 2024-04-26T23:35:59.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.533+0000 7f46ed200640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 0x7f46c806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:59.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.533+0000 7f46ed200640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 0x7f46c806a990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f46dc001770 tx=0x7f46dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.537+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46d4016150 con 0x7f46e8073400 2024-04-26T23:35:59.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46e80b50b0 con 0x7f46e8073400 2024-04-26T23:35:59.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46e4c00640 1 -- 172.21.15.39:0/1032436408 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f46d40f0790 con 0x7f46e8073400 2024-04-26T23:35:59.715 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 msgr2=0x7f46c806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 0x7f46c806a990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f46dc001770 tx=0x7f46dc009040 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 msgr2=0x7f46e81663d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d40af040 tx=0x7f46d4019270 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 shutdown_connections 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f46c80684d0 0x7f46c806a990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46e81458d0 0x7f46e8166910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46e8073400 0x7f46e81663d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 --2- 172.21.15.39:0/1032436408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46e8072e50 0x7f46e8130140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 >> 172.21.15.39:0/1032436408 conn(0x7f46e806c7d0 msgr2=0x7f46e8143b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:59.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 shutdown_connections 2024-04-26T23:35:59.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:35:59.713+0000 7f46efc00640 1 -- 172.21.15.39:0/1032436408 wait complete. 2024-04-26T23:35:59.736 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T23:35:59.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:35:59.736 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-26T23:35:59.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:35:59.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:35:59.765 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:35:59.821 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:35:59.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:35:59.822 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:59.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:35:59.831 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:35:59.831 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:35:59.831 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:35:59.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:35:59.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:36:00.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.009+0000 7fd662c00640 1 Processor -- start 2024-04-26T23:36:00.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.009+0000 7fd662c00640 1 -- start start 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd662c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd65c15f5d0 0x7fd65c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd662c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd65c06eab0 con 0x7fd65c15f1f0 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd662c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd65c0aedf0 con 0x7fd65c0ae850 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd662c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd65c0b4d70 con 0x7fd65c15f5d0 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd65c15f5d0 0x7fd65c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd65c15f5d0 0x7fd65c06d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33316/0 (socket says 172.21.15.39:33316) 2024-04-26T23:36:00.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 -- 172.21.15.39:0/1857526454 learned_addr learned my addr 172.21.15.39:0/1857526454 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd65be00640 1 --1- 172.21.15.39:0/1857526454 >> v1:172.21.15.39:6789/0 conn(0x7fd65c15f1f0 0x7fd65c073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39852/0 (socket says 172.21.15.39:39852) 2024-04-26T23:36:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 -- 172.21.15.39:0/1857526454 >> v1:172.21.15.71:6789/0 conn(0x7fd65c0ae850 legacy=0x7fd65c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 -- 172.21.15.39:0/1857526454 >> v1:172.21.15.39:6789/0 conn(0x7fd65c15f1f0 legacy=0x7fd65c073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.013+0000 7fd653e00640 1 -- 172.21.15.39:0/1857526454 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c0b4720 con 0x7fd65c15f5d0 2024-04-26T23:36:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd653e00640 1 --2- 172.21.15.39:0/1857526454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c06d3e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b4ef0 tx=0x7fd64401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca5b087513f7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd65b400640 1 -- 172.21.15.39:0/1857526454 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440b5070 con 0x7fd65c15f5d0 2024-04-26T23:36:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd65b400640 1 -- 172.21.15.39:0/1857526454 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6440a8a30 con 0x7fd65c15f5d0 2024-04-26T23:36:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd65b400640 1 -- 172.21.15.39:0/1857526454 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440a8e00 con 0x7fd65c15f5d0 2024-04-26T23:36:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- 172.21.15.39:0/1857526454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 msgr2=0x7fd65c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 --2- 172.21.15.39:0/1857526454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c06d3e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b4ef0 tx=0x7fd64401ed30 comp rx=0 tx=0).stop 2024-04-26T23:36:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- 172.21.15.39:0/1857526454 shutdown_connections 2024-04-26T23:36:00.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 --2- 172.21.15.39:0/1857526454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c06d3e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- 172.21.15.39:0/1857526454 >> 172.21.15.39:0/1857526454 conn(0x7fd65c0729d0 msgr2=0x7fd65c072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- 172.21.15.39:0/1857526454 shutdown_connections 2024-04-26T23:36:00.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- 172.21.15.39:0/1857526454 wait complete. 2024-04-26T23:36:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 Processor -- start 2024-04-26T23:36:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 -- start start 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.017+0000 7fd662c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd65c0ae850 0x7fd65c152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65c15f1f0 0x7fd65c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c06daa0 con 0x7fd65c15f5d0 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c06d920 con 0x7fd65c15f1f0 2024-04-26T23:36:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd65c06dc20 con 0x7fd65c0ae850 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33332/0 (socket says 172.21.15.39:33332) 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 -- 172.21.15.39:0/1263218965 learned_addr learned my addr 172.21.15.39:0/1263218965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd653e00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65c15f1f0 0x7fd65c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd65be00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd65c0ae850 0x7fd65c152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 -- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd65c0ae850 msgr2=0x7fd65c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd65c0ae850 0x7fd65c152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 -- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65c15f1f0 msgr2=0x7fd65c06fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65c15f1f0 0x7fd65c06fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 -- 172.21.15.39:0/1263218965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c0ce110 con 0x7fd65c15f5d0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd660c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c7a0 tx=0x7fd65400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654003b80 con 0x7fd65c15f5d0 2024-04-26T23:36:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654003d20 con 0x7fd65c15f5d0 2024-04-26T23:36:00.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65400aa90 con 0x7fd65c15f5d0 2024-04-26T23:36:00.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c0ce3f0 con 0x7fd65c15f5d0 2024-04-26T23:36:00.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c0ce9b0 con 0x7fd65c15f5d0 2024-04-26T23:36:00.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c050740 con 0x7fd65c15f5d0 2024-04-26T23:36:00.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.021+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fd65400ac30 con 0x7fd65c15f5d0 2024-04-26T23:36:00.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.025+0000 7fd658c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 0x7fd63806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.025+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fd654086a40 con 0x7fd65c15f5d0 2024-04-26T23:36:00.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.025+0000 7fd65be00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 0x7fd63806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.025+0000 7fd65be00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 0x7fd63806a990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd64c000f70 tx=0x7fd64c007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.029+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd654056730 con 0x7fd65c15f5d0 2024-04-26T23:36:00.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.229+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd65c068d20 con 0x7fd65c15f5d0 2024-04-26T23:36:00.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.229+0000 7fd658c00640 1 -- 172.21.15.39:0/1263218965 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5183 (secure 0 0 0) 0x7fd65405aa30 con 0x7fd65c15f5d0 2024-04-26T23:36:00.233 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:00.233 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:36:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 msgr2=0x7fd63806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 0x7fd63806a990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd64c000f70 tx=0x7fd64c007e50 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 msgr2=0x7fd65c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c7a0 tx=0x7fd65400cc60 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 shutdown_connections 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd6380684d0 0x7fd63806a990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd65c15f5d0 0x7fd65c0703e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65c15f1f0 0x7fd65c06fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 --2- 172.21.15.39:0/1263218965 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd65c0ae850 0x7fd65c152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 >> 172.21.15.39:0/1263218965 conn(0x7fd65c0729d0 msgr2=0x7fd65c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 shutdown_connections 2024-04-26T23:36:00.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.233+0000 7fd662c00640 1 -- 172.21.15.39:0/1263218965 wait complete. 2024-04-26T23:36:00.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:36:00.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 Processor -- start 2024-04-26T23:36:00.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 -- start start 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9e00cf2a0 0x7fb9e006f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb9e006fab0 0x7fb9e00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e0160060 con 0x7fb9e0145820 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e006ff20 con 0x7fb9e006fab0 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9e5400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e00cd5c0 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb9e006fab0 0x7fb9e00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb9e006fab0 0x7fb9e00cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59978/0 (socket says 172.21.15.39:59978) 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 -- 172.21.15.39:0/403796936 learned_addr learned my addr 172.21.15.39:0/403796936 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9d7e00640 1 --2- 172.21.15.39:0/403796936 >> v2:172.21.15.71:3300/0 conn(0x7fb9e00cf2a0 0x7fb9e006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 -- 172.21.15.39:0/403796936 >> v2:172.21.15.71:3300/0 conn(0x7fb9e00cf2a0 msgr2=0x7fb9e006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 --2- 172.21.15.39:0/403796936 >> v2:172.21.15.71:3300/0 conn(0x7fb9e00cf2a0 0x7fb9e006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 -- 172.21.15.39:0/403796936 >> v1:172.21.15.71:6789/0 conn(0x7fb9e0145820 legacy=0x7fb9e00b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:00.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.393+0000 7fb9df200640 1 -- 172.21.15.39:0/403796936 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e0160340 con 0x7fb9e006fab0 2024-04-26T23:36:00.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9df200640 1 --2- 172.21.15.39:0/403796936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e006fab0 0x7fb9e00cda50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00ce9b0 tx=0x7fb9d801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41922396bca170c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9dde00640 1 -- 172.21.15.39:0/403796936 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80a5760 con 0x7fb9e006fab0 2024-04-26T23:36:00.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9dde00640 1 -- 172.21.15.39:0/403796936 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d80a5900 con 0x7fb9e006fab0 2024-04-26T23:36:00.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9dde00640 1 -- 172.21.15.39:0/403796936 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80a5cd0 con 0x7fb9e006fab0 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 -- 172.21.15.39:0/403796936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e006fab0 msgr2=0x7fb9e00cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 --2- 172.21.15.39:0/403796936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e006fab0 0x7fb9e00cda50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00ce9b0 tx=0x7fb9d801c9b0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 -- 172.21.15.39:0/403796936 shutdown_connections 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 --2- 172.21.15.39:0/403796936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e006fab0 0x7fb9e00cda50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 --2- 172.21.15.39:0/403796936 >> v2:172.21.15.71:3300/0 conn(0x7fb9e00cf2a0 0x7fb9e006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 -- 172.21.15.39:0/403796936 >> 172.21.15.39:0/403796936 conn(0x7fb9e00b2af0 msgr2=0x7fb9e00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 -- 172.21.15.39:0/403796936 shutdown_connections 2024-04-26T23:36:00.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.397+0000 7fb9e5400640 1 -- 172.21.15.39:0/403796936 wait complete. 2024-04-26T23:36:00.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 Processor -- start 2024-04-26T23:36:00.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- start start 2024-04-26T23:36:00.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb9e006fab0 0x7fb9e013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 0x7fb9e00d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0145d80 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0145c00 con 0x7fb9e0145820 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e015fc30 con 0x7fb9e006fab0 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59984/0 (socket says 172.21.15.39:59984) 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 -- 172.21.15.39:0/2468791442 learned_addr learned my addr 172.21.15.39:0/2468791442 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9df200640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 0x7fb9e00d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9de800640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb9e006fab0 0x7fb9e013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 -- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb9e006fab0 msgr2=0x7fb9e013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb9e006fab0 0x7fb9e013a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 -- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 msgr2=0x7fb9e00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 0x7fb9e00d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 -- 172.21.15.39:0/2468791442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e015e050 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9df200640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 0x7fb9e00d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d7e00640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d800 tx=0x7fb9c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800b660 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8019070 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e015e330 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800ba00 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e015e8f0 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.401+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e0050740 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.405+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fb9c800bba0 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.405+0000 7fb9d6a00640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 0x7fb9bc06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.405+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fb9c8087060 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.405+0000 7fb9de800640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 0x7fb9bc06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.405+0000 7fb9de800640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 0x7fb9bc06a960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9e013bdc0 tx=0x7fb9d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.409+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb9c8057430 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.573+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9e00d03e0 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9d6a00640 1 -- 172.21.15.39:0/2468791442 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16705 (secure 0 0 0) 0x7fb9c8056d30 con 0x7fb9e00cf2a0 2024-04-26T23:36:00.579 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:00.579 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:55.787466+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 msgr2=0x7fb9bc06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 0x7fb9bc06a960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9e013bdc0 tx=0x7fb9d0008040 comp rx=0 tx=0).stop 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 msgr2=0x7fb9e01402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d800 tx=0x7fb9c800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 shutdown_connections 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb9bc0684a0 0x7fb9bc06a960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9e0145820 0x7fb9e00d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9e00cf2a0 0x7fb9e01402b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 --2- 172.21.15.39:0/2468791442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb9e006fab0 0x7fb9e013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 >> 172.21.15.39:0/2468791442 conn(0x7fb9e00b2af0 msgr2=0x7fb9e00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 shutdown_connections 2024-04-26T23:36:00.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.577+0000 7fb9e5400640 1 -- 172.21.15.39:0/2468791442 wait complete. 2024-04-26T23:36:00.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:26:01.681858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:28:21.185178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:28:22.371317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:36:00.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:36:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 Processor -- start 2024-04-26T23:36:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 -- start start 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 0x7fcb7015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb7015e340 0x7fcb700d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7006e500 con 0x7fcb70161850 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7006f110 con 0x7fcb7015e340 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb77c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7006e7e0 con 0x7fcb70140170 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb75c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcb70161850 0x7fcb70142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36358/0 (socket says 172.21.15.39:36358) 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb75c00640 1 -- 172.21.15.39:0/2244180034 learned_addr learned my addr 172.21.15.39:0/2244180034 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb75200640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 0x7fcb7015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2244180034 >> v2:172.21.15.71:3300/0 conn(0x7fcb7015e340 0x7fcb700d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb6fe00640 1 -- 172.21.15.39:0/2244180034 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892562344 0 0) 0x7fcb7006e500 con 0x7fcb70161850 2024-04-26T23:36:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb6fe00640 1 -- 172.21.15.39:0/2244180034 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb54003530 con 0x7fcb70161850 2024-04-26T23:36:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb67e00640 1 -- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 msgr2=0x7fcb7015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.741+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 0x7fcb7015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb67e00640 1 -- 172.21.15.39:0/2244180034 >> v1:172.21.15.39:6789/0 conn(0x7fcb70161850 legacy=0x7fcb70142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb67e00640 1 -- 172.21.15.39:0/2244180034 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7006eac0 con 0x7fcb7015e340 2024-04-26T23:36:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb75200640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 0x7fcb7015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7015e340 0x7fcb700d11e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097c0 tx=0x7fcb5801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6670d70c5aaafeca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb6fe00640 1 -- 172.21.15.39:0/2244180034 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580b0070 con 0x7fcb7015e340 2024-04-26T23:36:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb6fe00640 1 -- 172.21.15.39:0/2244180034 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb580ab600 con 0x7fcb7015e340 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb6fe00640 1 -- 172.21.15.39:0/2244180034 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580ab9b0 con 0x7fcb7015e340 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 -- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7015e340 msgr2=0x7fcb700d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7015e340 0x7fcb700d11e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097c0 tx=0x7fcb5801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 -- 172.21.15.39:0/2244180034 shutdown_connections 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7015e340 0x7fcb700d11e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2244180034 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb70140170 0x7fcb7015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 -- 172.21.15.39:0/2244180034 >> 172.21.15.39:0/2244180034 conn(0x7fcb7006c7d0 msgr2=0x7fcb7006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 -- 172.21.15.39:0/2244180034 shutdown_connections 2024-04-26T23:36:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.745+0000 7fcb77c00640 1 -- 172.21.15.39:0/2244180034 wait complete. 2024-04-26T23:36:00.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 Processor -- start 2024-04-26T23:36:00.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 -- start start 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb7015e340 0x7fcb7013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb70161850 0x7fcb700b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7016a340 con 0x7fcb70140170 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7016a1c0 con 0x7fcb70161850 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7016a4c0 con 0x7fcb7015e340 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59988/0 (socket says 172.21.15.39:59988) 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 -- 172.21.15.39:0/2382178676 learned_addr learned my addr 172.21.15.39:0/2382178676 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb7015e340 0x7fcb7013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb70161850 0x7fcb700b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 -- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb7015e340 msgr2=0x7fcb7013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb7015e340 0x7fcb7013ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 -- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb70161850 msgr2=0x7fcb700b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb70161850 0x7fcb700b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 -- 172.21.15.39:0/2382178676 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7015e8c0 con 0x7fcb70140170 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb75200640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000ec10 tx=0x7fcb6000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60017070 con 0x7fcb70140170 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6000cc30 con 0x7fcb70140170 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60013470 con 0x7fcb70140170 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.749+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb70158810 con 0x7fcb70140170 2024-04-26T23:36:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7013fa10 con 0x7fcb70140170 2024-04-26T23:36:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7006a720 con 0x7fcb70140170 2024-04-26T23:36:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fcb6001a070 con 0x7fcb70140170 2024-04-26T23:36:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb6d600640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 0x7fcb4c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fcb60086e40 con 0x7fcb70140170 2024-04-26T23:36:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 0x7fcb4c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.753+0000 7fcb67e00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 0x7fcb4c06a960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcb580ad000 tx=0x7fcb580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.757+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb60056c60 con 0x7fcb70140170 2024-04-26T23:36:00.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.921+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb700697b0 con 0x7fcb70140170 2024-04-26T23:36:00.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.921+0000 7fcb6d600640 1 -- 172.21.15.39:0/2382178676 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7fcb6005af60 con 0x7fcb70140170 2024-04-26T23:36:00.925 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 msgr2=0x7fcb4c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 0x7fcb4c06a960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcb580ad000 tx=0x7fcb580a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 msgr2=0x7fcb7015f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000ec10 tx=0x7fcb6000c520 comp rx=0 tx=0).stop 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 shutdown_connections 2024-04-26T23:36:00.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fcb4c0684a0 0x7fcb4c06a960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb70161850 0x7fcb700b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb7015e340 0x7fcb7013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 --2- 172.21.15.39:0/2382178676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb70140170 0x7fcb7015f360 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 >> 172.21.15.39:0/2382178676 conn(0x7fcb7006c7d0 msgr2=0x7fcb7006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 shutdown_connections 2024-04-26T23:36:00.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:00.925+0000 7fcb77c00640 1 -- 172.21.15.39:0/2382178676 wait complete. 2024-04-26T23:36:00.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:36:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 Processor -- start 2024-04-26T23:36:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 -- start start 2024-04-26T23:36:01.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb168140170 0x7fb16815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1680d18f0 0x7fb1680cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16806e500 con 0x7fb16815e340 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb16806f110 con 0x7fb168140170 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16f400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb16806e7e0 con 0x7fb1680d18f0 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb168140170 0x7fb16815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb168140170 0x7fb16815de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60004/0 (socket says 172.21.15.39:60004) 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 -- 172.21.15.39:0/4275707596 learned_addr learned my addr 172.21.15.39:0/4275707596 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16d400640 1 --2- 172.21.15.39:0/4275707596 >> v2:172.21.15.71:3300/0 conn(0x7fb1680d18f0 0x7fb1680cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 -- 172.21.15.39:0/4275707596 >> v2:172.21.15.71:3300/0 conn(0x7fb1680d18f0 msgr2=0x7fb1680cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 --2- 172.21.15.39:0/4275707596 >> v2:172.21.15.71:3300/0 conn(0x7fb1680d18f0 0x7fb1680cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 -- 172.21.15.39:0/4275707596 >> v1:172.21.15.71:6789/0 conn(0x7fb16815e340 legacy=0x7fb1680d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.089+0000 7fb16ca00640 1 -- 172.21.15.39:0/4275707596 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16806eac0 con 0x7fb168140170 2024-04-26T23:36:01.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16ca00640 1 --2- 172.21.15.39:0/4275707596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb168140170 0x7fb16815de00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb16806fd90 tx=0x7fb15801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9d5dc12a778084 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb167e00640 1 -- 172.21.15.39:0/4275707596 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1580ab680 con 0x7fb168140170 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb167e00640 1 -- 172.21.15.39:0/4275707596 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1580b0070 con 0x7fb168140170 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb167e00640 1 -- 172.21.15.39:0/4275707596 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1580aba40 con 0x7fb168140170 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 -- 172.21.15.39:0/4275707596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb168140170 msgr2=0x7fb16815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 --2- 172.21.15.39:0/4275707596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb168140170 0x7fb16815de00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb16806fd90 tx=0x7fb15801c420 comp rx=0 tx=0).stop 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 -- 172.21.15.39:0/4275707596 shutdown_connections 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 --2- 172.21.15.39:0/4275707596 >> v2:172.21.15.71:3300/0 conn(0x7fb1680d18f0 0x7fb1680cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 --2- 172.21.15.39:0/4275707596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb168140170 0x7fb16815de00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 -- 172.21.15.39:0/4275707596 >> 172.21.15.39:0/4275707596 conn(0x7fb16806c7d0 msgr2=0x7fb16806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 -- 172.21.15.39:0/4275707596 shutdown_connections 2024-04-26T23:36:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.093+0000 7fb16f400640 1 -- 172.21.15.39:0/4275707596 wait complete. 2024-04-26T23:36:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 Processor -- start 2024-04-26T23:36:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- start start 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1680d18f0 0x7fb168142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb168140170 0x7fb1680b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680d07d0 con 0x7fb16815e340 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680d0650 con 0x7fb168140170 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb1680d0950 con 0x7fb1680d18f0 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60020/0 (socket says 172.21.15.39:60020) 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 -- 172.21.15.39:0/903049093 learned_addr learned my addr 172.21.15.39:0/903049093 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb15fe00640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb168140170 0x7fb1680b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16ca00640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1680d18f0 0x7fb168142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 -- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1680d18f0 msgr2=0x7fb168142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1680d18f0 0x7fb168142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 -- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb168140170 msgr2=0x7fb1680b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb168140170 0x7fb1680b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 -- 172.21.15.39:0/903049093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16813d780 con 0x7fb16815e340 2024-04-26T23:36:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16d400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb160007de0 tx=0x7fb16000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160014620 con 0x7fb16815e340 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb160019070 con 0x7fb16815e340 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160014a20 con 0x7fb16815e340 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb168155410 con 0x7fb16815e340 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16813dcd0 con 0x7fb16815e340 2024-04-26T23:36:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.097+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16806a720 con 0x7fb16815e340 2024-04-26T23:36:01.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.101+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fb160014bc0 con 0x7fb16815e340 2024-04-26T23:36:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.101+0000 7fb165600640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 0x7fb14406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.101+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fb160087340 con 0x7fb16815e340 2024-04-26T23:36:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.101+0000 7fb16ca00640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 0x7fb14406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.101+0000 7fb16ca00640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 0x7fb14406a960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1580af000 tx=0x7fb1580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.105+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb160057150 con 0x7fb16815e340 2024-04-26T23:36:01.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1680cde70 con 0x7fb16815e340 2024-04-26T23:36:01.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb165600640 1 -- 172.21.15.39:0/903049093 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) ==== 104+0+11 (secure 0 0 0) 0x7fb16005b450 con 0x7fb16815e340 2024-04-26T23:36:01.271 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 msgr2=0x7fb14406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 0x7fb14406a960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1580af000 tx=0x7fb1580a7000 comp rx=0 tx=0).stop 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 msgr2=0x7fb16813e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb160007de0 tx=0x7fb16000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 shutdown_connections 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb1440684a0 0x7fb14406a960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb16815e340 0x7fb16813e1f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb168140170 0x7fb1680b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 --2- 172.21.15.39:0/903049093 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1680d18f0 0x7fb168142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 >> 172.21.15.39:0/903049093 conn(0x7fb16806c7d0 msgr2=0x7fb168160730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 shutdown_connections 2024-04-26T23:36:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.269+0000 7fb16f400640 1 -- 172.21.15.39:0/903049093 wait complete. 2024-04-26T23:36:01.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:36:01.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 Processor -- start 2024-04-26T23:36:01.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 -- start start 2024-04-26T23:36:01.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 0x7fc93c072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c072180 con 0x7fc93c072e50 2024-04-26T23:36:01.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c0739a0 con 0x7fc93c1458d0 2024-04-26T23:36:01.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc941800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c073c80 con 0x7fc93c073400 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93b400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc93c072e50 0x7fc93c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36370/0 (socket says 172.21.15.39:36370) 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93b400640 1 -- 172.21.15.39:0/984305633 learned_addr learned my addr 172.21.15.39:0/984305633 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc932000640 1 --2- 172.21.15.39:0/984305633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 0x7fc93c072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284551279 0 0) 0x7fc93c072180 con 0x7fc93c072e50 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc920003530 con 0x7fc93c072e50 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145467717 0 0) 0x7fc93c0739a0 con 0x7fc93c1458d0 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc93c072180 con 0x7fc93c1458d0 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc932000640 1 -- 172.21.15.39:0/984305633 >> v1:172.21.15.71:6789/0 conn(0x7fc93c1458d0 legacy=0x7fc93c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc932000640 1 -- 172.21.15.39:0/984305633 >> v1:172.21.15.39:6789/0 conn(0x7fc93c072e50 legacy=0x7fc93c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.433+0000 7fc932000640 1 -- 172.21.15.39:0/984305633 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c145cb0 con 0x7fc93c073400 2024-04-26T23:36:01.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc932000640 1 --2- 172.21.15.39:0/984305633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 0x7fc93c072910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc924009820 tx=0x7fc92401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39368bdd7394ce8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240b0070 con 0x7fc93c073400 2024-04-26T23:36:01.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9240ab600 con 0x7fc93c073400 2024-04-26T23:36:01.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc93a000640 1 -- 172.21.15.39:0/984305633 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240ab9d0 con 0x7fc93c073400 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 -- 172.21.15.39:0/984305633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 msgr2=0x7fc93c072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 --2- 172.21.15.39:0/984305633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 0x7fc93c072910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc924009820 tx=0x7fc92401c430 comp rx=0 tx=0).stop 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 -- 172.21.15.39:0/984305633 shutdown_connections 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 --2- 172.21.15.39:0/984305633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c073400 0x7fc93c072910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 -- 172.21.15.39:0/984305633 >> 172.21.15.39:0/984305633 conn(0x7fc93c06c7d0 msgr2=0x7fc93c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 -- 172.21.15.39:0/984305633 shutdown_connections 2024-04-26T23:36:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.437+0000 7fc941800640 1 -- 172.21.15.39:0/984305633 wait complete. 2024-04-26T23:36:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 Processor -- start 2024-04-26T23:36:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- start start 2024-04-26T23:36:01.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc93c073400 0x7fc93c13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 0x7fc93c0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c06ee80 con 0x7fc93c072e50 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c073260 con 0x7fc93c073400 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c06f000 con 0x7fc93c1458d0 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60032/0 (socket says 172.21.15.39:60032) 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 -- 172.21.15.39:0/3066003643 learned_addr learned my addr 172.21.15.39:0/3066003643 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc932000640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc93c073400 0x7fc93c13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93b400640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 0x7fc93c0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 -- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 msgr2=0x7fc93c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 0x7fc93c0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 -- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc93c073400 msgr2=0x7fc93c13da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc93c073400 0x7fc93c13da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 -- 172.21.15.39:0/3066003643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c13f0a0 con 0x7fc93c072e50 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93b400640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 0x7fc93c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:01.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc93aa00640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c460 tx=0x7fc92c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c017070 con 0x7fc93c072e50 2024-04-26T23:36:01.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c0052f0 con 0x7fc93c072e50 2024-04-26T23:36:01.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c13df90 con 0x7fc93c072e50 2024-04-26T23:36:01.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003840 con 0x7fc93c072e50 2024-04-26T23:36:01.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.441+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c0c6040 con 0x7fc93c072e50 2024-04-26T23:36:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c06a720 con 0x7fc93c072e50 2024-04-26T23:36:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fc92c01a070 con 0x7fc93c072e50 2024-04-26T23:36:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc933400640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 0x7fc91806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fc92c085f30 con 0x7fc93c072e50 2024-04-26T23:36:01.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc932000640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 0x7fc91806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.445+0000 7fc932000640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 0x7fc91806a960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc9240097f0 tx=0x7fc9240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.449+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc92c056390 con 0x7fc93c072e50 2024-04-26T23:36:01.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.613+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc93c0d0330 con 0x7fc93c072e50 2024-04-26T23:36:01.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.613+0000 7fc933400640 1 -- 172.21.15.39:0/3066003643 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) ==== 100+0+11 (secure 0 0 0) 0x7fc92c055c90 con 0x7fc93c072e50 2024-04-26T23:36:01.616 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 msgr2=0x7fc91806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 0x7fc91806a960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc9240097f0 tx=0x7fc9240a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 msgr2=0x7fc93c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c460 tx=0x7fc92c00c920 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 shutdown_connections 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fc9180684a0 0x7fc91806a960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc93c1458d0 0x7fc93c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc93c073400 0x7fc93c13da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 --2- 172.21.15.39:0/3066003643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc93c072e50 0x7fc93c13eb60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 >> 172.21.15.39:0/3066003643 conn(0x7fc93c06c7d0 msgr2=0x7fc93c06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 shutdown_connections 2024-04-26T23:36:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.617+0000 7fc941800640 1 -- 172.21.15.39:0/3066003643 wait complete. 2024-04-26T23:36:01.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:36:01.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 Processor -- start 2024-04-26T23:36:01.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 -- start start 2024-04-26T23:36:01.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45c80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45c80cdbf0 0x7f45c806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c80d0550 con 0x7f45c80cfe00 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f45c80d0b10 con 0x7f45c80cdbf0 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45cce00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f45c806e970 con 0x7f45c80cd810 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45bd400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f45c80cfe00 0x7f45c8144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36378/0 (socket says 172.21.15.39:36378) 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45bd400640 1 -- 172.21.15.39:0/2662570565 learned_addr learned my addr 172.21.15.39:0/2662570565 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5e00640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45c80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> v2:172.21.15.71:3300/0 conn(0x7f45c80cdbf0 0x7f45c806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397989644 0 0) 0x7f45c80d0550 con 0x7f45c80cfe00 2024-04-26T23:36:01.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ac003530 con 0x7f45c80cfe00 2024-04-26T23:36:01.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2576516783 0 0) 0x7f45ac003530 con 0x7f45c80cfe00 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 msgr2=0x7f45c80742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45c80742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 >> v2:172.21.15.71:3300/0 conn(0x7f45c80cdbf0 msgr2=0x7f45c806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 --2- 172.21.15.39:0/2662570565 >> v2:172.21.15.71:3300/0 conn(0x7f45c80cdbf0 0x7f45c806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c80d0830 con 0x7f45c80cfe00 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f45b0001680 con 0x7f45c80cfe00 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 >> v1:172.21.15.39:6789/0 conn(0x7f45c80cfe00 legacy=0x7f45c8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0039c0 0x7f45ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45ac004d50 0x7f45ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f45c80d0b10 con 0x7f45ac004d50 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45c806e970 con 0x7f45ac0039c0 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f45ac00fde0 con 0x7f45c80cd810 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> v2:172.21.15.71:3300/0 conn(0x7f45c80cdbf0 0x7f45c806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45bd400640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c5e00640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0039c0 0x7f45ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.777+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45ac004d50 0x7f45ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 -- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 msgr2=0x7f45ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45c80cd810 0x7f45ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 -- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0039c0 msgr2=0x7f45ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0039c0 0x7f45ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 -- 172.21.15.39:0/2662570565 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ac003530 con 0x7f45ac004d50 2024-04-26T23:36:01.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45ac004d50 0x7f45ac0051d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009c90 tx=0x7f45c001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115f992270ff3ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009860 con 0x7f45ac004d50 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c0004020 con 0x7f45ac004d50 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c5400640 1 -- 172.21.15.39:0/2662570565 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0004410 con 0x7f45ac004d50 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45cce00640 1 -- 172.21.15.39:0/2662570565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45ac004d50 msgr2=0x7f45ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45cce00640 1 --2- 172.21.15.39:0/2662570565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45ac004d50 0x7f45ac0051d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009c90 tx=0x7f45c001c920 comp rx=0 tx=0).stop 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45c6800640 1 -- 172.21.15.39:0/2662570565 reap_dead start 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45cce00640 1 -- 172.21.15.39:0/2662570565 shutdown_connections 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45cce00640 1 -- 172.21.15.39:0/2662570565 >> 172.21.15.39:0/2662570565 conn(0x7f45c80b2af0 msgr2=0x7f45c80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.781+0000 7f45cce00640 1 -- 172.21.15.39:0/2662570565 shutdown_connections 2024-04-26T23:36:01.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 -- 172.21.15.39:0/2662570565 wait complete. 2024-04-26T23:36:01.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 Processor -- start 2024-04-26T23:36:01.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 -- start start 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45ac004d50 0x7f45c81f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 0x7f45c8140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f45c80ce180 con 0x7f45c8141930 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45c80ce000 con 0x7f45c8154fc0 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45cce00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f45c8143bb0 con 0x7f45ac004d50 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60056/0 (socket says 172.21.15.39:60056) 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45bd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 0x7f45c8140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 -- 172.21.15.39:0/788170939 learned_addr learned my addr 172.21.15.39:0/788170939 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c5e00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45ac004d50 0x7f45c81f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 -- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45ac004d50 msgr2=0x7f45c81f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45ac004d50 0x7f45c81f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 -- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 msgr2=0x7f45c8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 0x7f45c8140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 -- 172.21.15.39:0/788170939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c81f5370 con 0x7f45c8141930 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45bd400640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 0x7f45c8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.785+0000 7f45c6800640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f45c001d1c0 tx=0x7f45ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00bc070 con 0x7f45c8141930 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c0000e50 con 0x7f45c8141930 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009860 con 0x7f45c8141930 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c81f5650 con 0x7f45c8141930 2024-04-26T23:36:01.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c8155440 con 0x7f45c8141930 2024-04-26T23:36:01.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c8050740 con 0x7f45c8141930 2024-04-26T23:36:01.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f45c00b4040 con 0x7f45c8141930 2024-04-26T23:36:01.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 0x7f45a406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:01.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.789+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f45c011fa40 con 0x7f45c8141930 2024-04-26T23:36:01.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.793+0000 7f45c5e00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 0x7f45a406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:01.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.793+0000 7f45c5e00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 0x7f45a406a960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45c815eb10 tx=0x7f45b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:01.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.793+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45c0016980 con 0x7f45c8141930 2024-04-26T23:36:01.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.993+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45c80cf720 con 0x7f45c8141930 2024-04-26T23:36:01.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.993+0000 7f45bea00640 1 -- 172.21.15.39:0/788170939 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5183 (secure 0 0 0) 0x7f45c00ef6b0 con 0x7f45c8141930 2024-04-26T23:36:01.996 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:01.996 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:36:01.997 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-04-26T23:36:01.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 msgr2=0x7f45a406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 0x7f45a406a960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45c815eb10 tx=0x7f45b800b040 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 msgr2=0x7f45c8141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f45c001d1c0 tx=0x7f45ac005840 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 shutdown_connections 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f45a40684a0 0x7f45a406a960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45c8141930 0x7f45c8141db0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c8154fc0 0x7f45c8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 --2- 172.21.15.39:0/788170939 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45ac004d50 0x7f45c81f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 >> 172.21.15.39:0/788170939 conn(0x7f45c80b2af0 msgr2=0x7f45c815cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 shutdown_connections 2024-04-26T23:36:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:01.997+0000 7f45cce00640 1 -- 172.21.15.39:0/788170939 wait complete. 2024-04-26T23:36:02.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:36:02.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 Processor -- start 2024-04-26T23:36:02.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 -- start start 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5df4146600 0x7f5df4160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 0x7f5df415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df40d1d40 con 0x7f5df40ce9a0 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5df4161bc0 con 0x7f5df4146600 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df9000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5df4161320 con 0x7f5df41469e0 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5df4146600 0x7f5df4160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5df4146600 0x7f5df4160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60070/0 (socket says 172.21.15.39:60070) 2024-04-26T23:36:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 -- 172.21.15.39:0/3908515032 learned_addr learned my addr 172.21.15.39:0/3908515032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5debe00640 1 --2- 172.21.15.39:0/3908515032 >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 0x7f5df415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 -- 172.21.15.39:0/3908515032 >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 msgr2=0x7f5df415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 --2- 172.21.15.39:0/3908515032 >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 0x7f5df415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 -- 172.21.15.39:0/3908515032 >> v1:172.21.15.71:6789/0 conn(0x7f5df40ce9a0 legacy=0x7f5df406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5df1e00640 1 -- 172.21.15.39:0/3908515032 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4161600 con 0x7f5df4146600 2024-04-26T23:36:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.157+0000 7f5debe00640 1 --2- 172.21.15.39:0/3908515032 >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 0x7f5df415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df1e00640 1 --2- 172.21.15.39:0/3908515032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df4146600 0x7f5df4160c90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5df406d020 tx=0x7f5de401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162de77466b5dd94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df1400640 1 -- 172.21.15.39:0/3908515032 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40aa610 con 0x7f5df4146600 2024-04-26T23:36:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df1400640 1 -- 172.21.15.39:0/3908515032 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40af070 con 0x7f5df4146600 2024-04-26T23:36:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df1400640 1 -- 172.21.15.39:0/3908515032 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40aa9d0 con 0x7f5df4146600 2024-04-26T23:36:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 -- 172.21.15.39:0/3908515032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df4146600 msgr2=0x7f5df4160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 --2- 172.21.15.39:0/3908515032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df4146600 0x7f5df4160c90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5df406d020 tx=0x7f5de401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 -- 172.21.15.39:0/3908515032 shutdown_connections 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 --2- 172.21.15.39:0/3908515032 >> v2:172.21.15.71:3300/0 conn(0x7f5df41469e0 0x7f5df415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 --2- 172.21.15.39:0/3908515032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df4146600 0x7f5df4160c90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 -- 172.21.15.39:0/3908515032 >> 172.21.15.39:0/3908515032 conn(0x7f5df406f550 msgr2=0x7f5df406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 -- 172.21.15.39:0/3908515032 shutdown_connections 2024-04-26T23:36:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.161+0000 7f5df9000640 1 -- 172.21.15.39:0/3908515032 wait complete. 2024-04-26T23:36:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 Processor -- start 2024-04-26T23:36:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- start start 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5df40ce9a0 0x7f5df4166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 0x7f5df415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5df406cc60 con 0x7f5df41469e0 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5df406cae0 con 0x7f5df4146600 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5df4071a60 con 0x7f5df40ce9a0 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60076/0 (socket says 172.21.15.39:60076) 2024-04-26T23:36:02.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 -- 172.21.15.39:0/3751293295 learned_addr learned my addr 172.21.15.39:0/3751293295 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df1e00640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5df40ce9a0 0x7f5df4166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5debe00640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 0x7f5df415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 -- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5df40ce9a0 msgr2=0x7f5df4166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5df40ce9a0 0x7f5df4166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 -- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 msgr2=0x7f5df415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 0x7f5df415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 -- 172.21.15.39:0/3751293295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4160240 con 0x7f5df41469e0 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5debe00640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 0x7f5df415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df2800640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c780 tx=0x7f5dec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec004b70 con 0x7f5df41469e0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec004d10 con 0x7f5df41469e0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00aa90 con 0x7f5df41469e0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df4160520 con 0x7f5df41469e0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df4160ae0 con 0x7f5df41469e0 2024-04-26T23:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.165+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df4050740 con 0x7f5df41469e0 2024-04-26T23:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.169+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f5dec00ac30 con 0x7f5df41469e0 2024-04-26T23:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.169+0000 7f5dea000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 0x7f5dd006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.169+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f5dec086e60 con 0x7f5df41469e0 2024-04-26T23:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.169+0000 7f5df1e00640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 0x7f5dd006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.169+0000 7f5df1e00640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 0x7f5dd006a960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ae000 tx=0x7f5de40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.173+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5dec020070 con 0x7f5df41469e0 2024-04-26T23:36:02.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.337+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5df406fcf0 con 0x7f5df41469e0 2024-04-26T23:36:02.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5dea000640 1 -- 172.21.15.39:0/3751293295 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16705 (secure 0 0 0) 0x7f5dec057230 con 0x7f5df41469e0 2024-04-26T23:36:02.343 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:02.343 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:55.787466+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:36:02.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 msgr2=0x7f5dd006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 0x7f5dd006a960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ae000 tx=0x7f5de40a7000 comp rx=0 tx=0).stop 2024-04-26T23:36:02.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 msgr2=0x7f5df415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c780 tx=0x7f5dec00cc40 comp rx=0 tx=0).stop 2024-04-26T23:36:02.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 shutdown_connections 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f5dd00684a0 0x7f5dd006a960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5df41469e0 0x7f5df415a990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5df4146600 0x7f5df415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 --2- 172.21.15.39:0/3751293295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5df40ce9a0 0x7f5df4166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 >> 172.21.15.39:0/3751293295 conn(0x7f5df406f550 msgr2=0x7f5df4073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 shutdown_connections 2024-04-26T23:36:02.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.341+0000 7f5df9000640 1 -- 172.21.15.39:0/3751293295 wait complete. 2024-04-26T23:36:02.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:36:02.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:36:02.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 Processor -- start 2024-04-26T23:36:02.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 -- start start 2024-04-26T23:36:02.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdf600742f0 0x7fdf600cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cdbf0 0x7fdf6006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf60074750 con 0x7fdf600cd810 2024-04-26T23:36:02.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600d0b10 con 0x7fdf600742f0 2024-04-26T23:36:02.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf67a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6006e970 con 0x7fdf600cdbf0 2024-04-26T23:36:02.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.501+0000 7fdf57e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdf600742f0 0x7fdf600cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdf600742f0 0x7fdf600cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60088/0 (socket says 172.21.15.39:60088) 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 -- 172.21.15.39:0/3412515516 learned_addr learned my addr 172.21.15.39:0/3412515516 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf65a00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cdbf0 0x7fdf6006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 -- 172.21.15.39:0/3412515516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cdbf0 msgr2=0x7fdf6006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cdbf0 0x7fdf6006ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 -- 172.21.15.39:0/3412515516 >> v1:172.21.15.71:6789/0 conn(0x7fdf600cd810 legacy=0x7fdf60144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 -- 172.21.15.39:0/3412515516 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600d0550 con 0x7fdf600742f0 2024-04-26T23:36:02.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf57e00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600742f0 0x7fdf600cfe00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009870 tx=0x7fdf4801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e796b14b0e4c605e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf5fe00640 1 -- 172.21.15.39:0/3412515516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480b0070 con 0x7fdf600742f0 2024-04-26T23:36:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf5fe00640 1 -- 172.21.15.39:0/3412515516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf480ab600 con 0x7fdf600742f0 2024-04-26T23:36:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.505+0000 7fdf5fe00640 1 -- 172.21.15.39:0/3412515516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480ab9d0 con 0x7fdf600742f0 2024-04-26T23:36:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- 172.21.15.39:0/3412515516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600742f0 msgr2=0x7fdf600cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600742f0 0x7fdf600cfe00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009870 tx=0x7fdf4801c410 comp rx=0 tx=0).stop 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- 172.21.15.39:0/3412515516 shutdown_connections 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cdbf0 0x7fdf6006ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- 172.21.15.39:0/3412515516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600742f0 0x7fdf600cfe00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- 172.21.15.39:0/3412515516 >> 172.21.15.39:0/3412515516 conn(0x7fdf600b2af0 msgr2=0x7fdf600b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- 172.21.15.39:0/3412515516 shutdown_connections 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- 172.21.15.39:0/3412515516 wait complete. 2024-04-26T23:36:02.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 Processor -- start 2024-04-26T23:36:02.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- start start 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf600742f0 0x7fdf6013e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cd810 0x7fdf6015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60143d30 con 0x7fdf600cdbf0 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60143bb0 con 0x7fdf600742f0 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf67a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdf60169ef0 con 0x7fdf600cd810 2024-04-26T23:36:02.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60102/0 (socket says 172.21.15.39:60102) 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 -- 172.21.15.39:0/1350016104 learned_addr learned my addr 172.21.15.39:0/1350016104 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65000640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf600742f0 0x7fdf6013e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf57e00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cd810 0x7fdf6015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 -- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cd810 msgr2=0x7fdf6015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cd810 0x7fdf6015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 -- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf600742f0 msgr2=0x7fdf6013e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf600742f0 0x7fdf6013e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 -- 172.21.15.39:0/1350016104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6015fe30 con 0x7fdf600cdbf0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.509+0000 7fdf65a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009d30 tx=0x7fdf5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58018020 con 0x7fdf600cdbf0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf58014480 con 0x7fdf600cdbf0 2024-04-26T23:36:02.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58014870 con 0x7fdf600cdbf0 2024-04-26T23:36:02.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6015b450 con 0x7fdf600cdbf0 2024-04-26T23:36:02.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6015f0f0 con 0x7fdf600cdbf0 2024-04-26T23:36:02.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60050740 con 0x7fdf600cdbf0 2024-04-26T23:36:02.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fdf5801b020 con 0x7fdf600cdbf0 2024-04-26T23:36:02.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 0x7fdf3c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7fdf58087610 con 0x7fdf600cdbf0 2024-04-26T23:36:02.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.513+0000 7fdf65000640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 0x7fdf3c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.517+0000 7fdf65000640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 0x7fdf3c06a960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdf6015d140 tx=0x7fdf50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.517+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdf58022070 con 0x7fdf600cdbf0 2024-04-26T23:36:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.717+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf6015b970 con 0x7fdf600cdbf0 2024-04-26T23:36:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.717+0000 7fdf5d600640 1 -- 172.21.15.39:0/1350016104 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5183 (secure 0 0 0) 0x7fdf58010040 con 0x7fdf600cdbf0 2024-04-26T23:36:02.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:02.721 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:36:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 msgr2=0x7fdf3c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 0x7fdf3c06a960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdf6015d140 tx=0x7fdf50009040 comp rx=0 tx=0).stop 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 msgr2=0x7fdf6015aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009d30 tx=0x7fdf5800c490 comp rx=0 tx=0).stop 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 shutdown_connections 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fdf3c0684a0 0x7fdf3c06a960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf600cdbf0 0x7fdf6015aa70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdf600cd810 0x7fdf6015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 --2- 172.21.15.39:0/1350016104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf600742f0 0x7fdf6013e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 >> 172.21.15.39:0/1350016104 conn(0x7fdf600b2af0 msgr2=0x7fdf60141c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 shutdown_connections 2024-04-26T23:36:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.721+0000 7fdf67a00640 1 -- 172.21.15.39:0/1350016104 wait complete. 2024-04-26T23:36:02.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:36:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.877+0000 7f4c0b400640 1 Processor -- start 2024-04-26T23:36:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.877+0000 7f4c0b400640 1 -- start start 2024-04-26T23:36:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c0b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c04160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c0b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c041469e0 0x7f4c0415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c0b400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c040d1d40 con 0x7f4c040ce9a0 2024-04-26T23:36:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c0b400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4c04161bc0 con 0x7f4c041469e0 2024-04-26T23:36:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c0b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c04161320 con 0x7f4c04146600 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c08a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c04160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c041469e0 0x7f4c0415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c041469e0 0x7f4c0415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:46882/0 (socket says 172.21.15.39:46882) 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 -- 172.21.15.39:0/3985454435 learned_addr learned my addr 172.21.15.39:0/3985454435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4c09400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4c040ce9a0 0x7f4c0406c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:52706/0 (socket says 172.21.15.39:52706) 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 -- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 msgr2=0x7f4c04160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 --2- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c04160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 -- 172.21.15.39:0/3985454435 >> v1:172.21.15.71:6789/0 conn(0x7f4c040ce9a0 legacy=0x7f4c0406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.881+0000 7f4bfbe00640 1 -- 172.21.15.39:0/3985454435 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04161600 con 0x7f4c041469e0 2024-04-26T23:36:02.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4bfbe00640 1 --2- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0415d6a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009870 tx=0x7f4bec01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f20c2280ad2d850f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c03e00640 1 -- 172.21.15.39:0/3985454435 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a95f0 con 0x7f4c041469e0 2024-04-26T23:36:02.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c03e00640 1 -- 172.21.15.39:0/3985454435 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a9790 con 0x7f4c041469e0 2024-04-26T23:36:02.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c03e00640 1 -- 172.21.15.39:0/3985454435 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a9b60 con 0x7f4c041469e0 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 msgr2=0x7f4c0415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 --2- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0415d6a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009870 tx=0x7f4bec01c530 comp rx=0 tx=0).stop 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- 172.21.15.39:0/3985454435 shutdown_connections 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 --2- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0415d6a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 --2- 172.21.15.39:0/3985454435 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c04160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- 172.21.15.39:0/3985454435 >> 172.21.15.39:0/3985454435 conn(0x7f4c0406f550 msgr2=0x7f4c0406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:02.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- 172.21.15.39:0/3985454435 shutdown_connections 2024-04-26T23:36:02.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- 172.21.15.39:0/3985454435 wait complete. 2024-04-26T23:36:02.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 Processor -- start 2024-04-26T23:36:02.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.885+0000 7f4c0b400640 1 -- start start 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c0413f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0406cc60 con 0x7f4c040ce9a0 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0406cae0 con 0x7f4c041469e0 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c04071a60 con 0x7f4c04146600 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60118/0 (socket says 172.21.15.39:60118) 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 -- 172.21.15.39:0/922081853 learned_addr learned my addr 172.21.15.39:0/922081853 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:02.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c09400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4bfbe00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c0413f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 -- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 msgr2=0x7f4c0413f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c0413f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 -- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 msgr2=0x7f4c0413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 -- 172.21.15.39:0/922081853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04161d40 con 0x7f4c040ce9a0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c08a00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e960 tx=0x7f4bf400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c040ce9a0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf400ca00 con 0x7f4c040ce9a0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c04162020 con 0x7f4c040ce9a0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400cdb0 con 0x7f4c040ce9a0 2024-04-26T23:36:02.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041625e0 con 0x7f4c040ce9a0 2024-04-26T23:36:02.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c04050740 con 0x7f4c040ce9a0 2024-04-26T23:36:02.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.889+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f4bf401a070 con 0x7f4c040ce9a0 2024-04-26T23:36:02.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.893+0000 7f4c01600640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 0x7f4be006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:02.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.893+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f4bf4086fe0 con 0x7f4c040ce9a0 2024-04-26T23:36:02.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.893+0000 7f4bfbe00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 0x7f4be006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:02.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.893+0000 7f4bfbe00640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 0x7f4be006a960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0ae000 tx=0x7f4bec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:02.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:02.897+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4bf40573d0 con 0x7f4c040ce9a0 2024-04-26T23:36:03.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.097+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c040703a0 con 0x7f4c040ce9a0 2024-04-26T23:36:03.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.097+0000 7f4c01600640 1 -- 172.21.15.39:0/922081853 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5183 (secure 0 0 0) 0x7f4bf4056cd0 con 0x7f4c040ce9a0 2024-04-26T23:36:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:03.102 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:28:23.404620+0000","modified":"2024-04-26T23:28:26.439107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/1889655166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":1889655166},{"type":"v1","addr":"172.21.15.39:6835","nonce":1889655166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5907,"qdb_cluster":[5907]},"id":5}]} 2024-04-26T23:36:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 msgr2=0x7f4be006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 0x7f4be006a960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0ae000 tx=0x7f4bec009040 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 msgr2=0x7f4c04144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e960 tx=0x7f4bf400ee20 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 shutdown_connections 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4be00684a0 0x7f4be006a960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c041469e0 0x7f4c0413f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c04146600 0x7f4c0413f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 --2- 172.21.15.39:0/922081853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c040ce9a0 0x7f4c04144790 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 >> 172.21.15.39:0/922081853 conn(0x7f4c0406f550 msgr2=0x7f4c040b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 shutdown_connections 2024-04-26T23:36:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.101+0000 7f4c0b400640 1 -- 172.21.15.39:0/922081853 wait complete. 2024-04-26T23:36:03.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:36:03.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.261+0000 7f4f0c800640 1 Processor -- start 2024-04-26T23:36:03.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.261+0000 7f4f0c800640 1 -- start start 2024-04-26T23:36:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0c800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 0x7f4f040d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0c800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f040d1b10 0x7f4f040c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0c800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f040c6be0 con 0x7f4f0415d3f0 2024-04-26T23:36:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0c800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0415d7d0 con 0x7f4f040d1b10 2024-04-26T23:36:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0c800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040d0610 con 0x7f4f040d0030 2024-04-26T23:36:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f09e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4f0415d3f0 0x7f4f040d0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36394/0 (socket says 172.21.15.39:36394) 2024-04-26T23:36:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f09e00640 1 -- 172.21.15.39:0/1096288086 learned_addr learned my addr 172.21.15.39:0/1096288086 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1096288086 >> v2:172.21.15.39:3300/0 conn(0x7f4f040d1b10 0x7f4f040c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 -- 172.21.15.39:0/1096288086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 msgr2=0x7f4f040d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f09400640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 0x7f4f040d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 0x7f4f040d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 -- 172.21.15.39:0/1096288086 >> v1:172.21.15.39:6789/0 conn(0x7f4f0415d3f0 legacy=0x7f4f040d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 -- 172.21.15.39:0/1096288086 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f040c6e50 con 0x7f4f040d1b10 2024-04-26T23:36:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f08a00640 1 -- 172.21.15.39:0/1096288086 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752529928 0 0) 0x7f4f040c6be0 con 0x7f4f0415d3f0 2024-04-26T23:36:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f09400640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 0x7f4f040d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.265+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f040d1b10 0x7f4f040c7650 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009d90 tx=0x7f4f0001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409b3fbd9e7fae25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f08a00640 1 -- 172.21.15.39:0/1096288086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000b2070 con 0x7f4f040d1b10 2024-04-26T23:36:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f08a00640 1 -- 172.21.15.39:0/1096288086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000a5830 con 0x7f4f040d1b10 2024-04-26T23:36:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f08a00640 1 -- 172.21.15.39:0/1096288086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000a5c00 con 0x7f4f040d1b10 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- 172.21.15.39:0/1096288086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f040d1b10 msgr2=0x7f4f040c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f040d1b10 0x7f4f040c7650 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009d90 tx=0x7f4f0001c970 comp rx=0 tx=0).stop 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- 172.21.15.39:0/1096288086 shutdown_connections 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f040d1b10 0x7f4f040c7650 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1096288086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d0030 0x7f4f040d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- 172.21.15.39:0/1096288086 >> 172.21.15.39:0/1096288086 conn(0x7f4f040d2ff0 msgr2=0x7f4f040d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- 172.21.15.39:0/1096288086 shutdown_connections 2024-04-26T23:36:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- 172.21.15.39:0/1096288086 wait complete. 2024-04-26T23:36:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 Processor -- start 2024-04-26T23:36:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- start start 2024-04-26T23:36:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f040d0030 0x7f4f041534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d1b10 0x7f4f040713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4f040c87b0 con 0x7f4f0415d3f0 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f040c8630 con 0x7f4f040d0030 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0c800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040c8930 con 0x7f4f040d1b10 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60140/0 (socket says 172.21.15.39:60140) 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f0a800640 1 -- 172.21.15.39:0/1132482522 learned_addr learned my addr 172.21.15.39:0/1132482522 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f09400640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d1b10 0x7f4f040713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.269+0000 7f4f09e00640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f040d0030 0x7f4f041534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 -- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d1b10 msgr2=0x7f4f040713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d1b10 0x7f4f040713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 -- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f040d0030 msgr2=0x7f4f041534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f040d0030 0x7f4f041534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 -- 172.21.15.39:0/1132482522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f040cc800 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0a800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4f000b0040 tx=0x7f4f00019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000bd020 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000b8670 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f040ccae0 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000b2040 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f04154390 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f040cd000 con 0x7f4f0415d3f0 2024-04-26T23:36:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f4f000c0020 con 0x7f4f0415d3f0 2024-04-26T23:36:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 0x7f4ee806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.273+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f4f00121a80 con 0x7f4f0415d3f0 2024-04-26T23:36:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.277+0000 7f4f09e00640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 0x7f4ee806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.277+0000 7f4f09e00640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 0x7f4ee806a960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f70 tx=0x7f4ef8007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.277+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f040cd000 con 0x7f4f0415d3f0 2024-04-26T23:36:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.445+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f04050740 con 0x7f4f0415d3f0 2024-04-26T23:36:03.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4efe000640 1 -- 172.21.15.39:0/1132482522 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16705 (secure 0 0 0) 0x7f4f00123e20 con 0x7f4f0415d3f0 2024-04-26T23:36:03.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:03.450 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:28:55.787466+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:28:21.185178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T23:28:22.371317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 msgr2=0x7f4ee806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 0x7f4ee806a960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f70 tx=0x7f4ef8007df0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 msgr2=0x7f4f040718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4f000b0040 tx=0x7f4f00019710 comp rx=0 tx=0).stop 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 shutdown_connections 2024-04-26T23:36:03.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f4ee80684a0 0x7f4ee806a960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f0415d3f0 0x7f4f040718f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4f040d1b10 0x7f4f040713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 --2- 172.21.15.39:0/1132482522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f040d0030 0x7f4f041534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 >> 172.21.15.39:0/1132482522 conn(0x7f4f040d2ff0 msgr2=0x7f4f0415c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 shutdown_connections 2024-04-26T23:36:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.449+0000 7f4f0c800640 1 -- 172.21.15.39:0/1132482522 wait complete. 2024-04-26T23:36:03.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:36:03.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.609+0000 7f191f200640 1 Processor -- start 2024-04-26T23:36:03.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.609+0000 7f191f200640 1 -- start start 2024-04-26T23:36:03.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 0x7f192015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191f200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19200d06b0 con 0x7f19200cfd30 2024-04-26T23:36:03.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191f200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19200b2430 con 0x7f19200d1110 2024-04-26T23:36:03.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f19200d2490 con 0x7f19200b2050 2024-04-26T23:36:03.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191e800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f19200cfd30 0x7f19200ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36410/0 (socket says 172.21.15.39:36410) 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191e800640 1 -- 172.21.15.39:0/345375594 learned_addr learned my addr 172.21.15.39:0/345375594 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191de00640 1 --2- 172.21.15.39:0/345375594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 0x7f192015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604443130 0 0) 0x7f19200d06b0 con 0x7f19200cfd30 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1904003530 con 0x7f19200cfd30 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789211625 0 0) 0x7f19200b2430 con 0x7f19200d1110 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19200d06b0 con 0x7f19200d1110 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191de00640 1 -- 172.21.15.39:0/345375594 >> v1:172.21.15.71:6789/0 conn(0x7f19200d1110 legacy=0x7f19200cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191de00640 1 -- 172.21.15.39:0/345375594 >> v1:172.21.15.39:6789/0 conn(0x7f19200cfd30 legacy=0x7f19200ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.613+0000 7f191de00640 1 -- 172.21.15.39:0/345375594 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19200d1880 con 0x7f19200b2050 2024-04-26T23:36:03.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191de00640 1 --2- 172.21.15.39:0/345375594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 0x7f192015f770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1910009dc0 tx=0x7f191001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e95e9490db7735e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b2070 con 0x7f19200b2050 2024-04-26T23:36:03.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19100a5a20 con 0x7f19200b2050 2024-04-26T23:36:03.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191d400640 1 -- 172.21.15.39:0/345375594 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100a5dd0 con 0x7f19200b2050 2024-04-26T23:36:03.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- 172.21.15.39:0/345375594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 msgr2=0x7f192015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 --2- 172.21.15.39:0/345375594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 0x7f192015f770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1910009dc0 tx=0x7f191001c960 comp rx=0 tx=0).stop 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- 172.21.15.39:0/345375594 shutdown_connections 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 --2- 172.21.15.39:0/345375594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200b2050 0x7f192015f770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- 172.21.15.39:0/345375594 >> 172.21.15.39:0/345375594 conn(0x7f19200d2da0 msgr2=0x7f19200d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- 172.21.15.39:0/345375594 shutdown_connections 2024-04-26T23:36:03.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- 172.21.15.39:0/345375594 wait complete. 2024-04-26T23:36:03.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 Processor -- start 2024-04-26T23:36:03.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.617+0000 7f191f200640 1 -- start start 2024-04-26T23:36:03.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19200cfd30 0x7f19200b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200d1110 0x7f1920159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f192016d140 con 0x7f19200b2050 2024-04-26T23:36:03.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19200d14f0 con 0x7f19200cfd30 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f192016d2c0 con 0x7f19200d1110 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60154/0 (socket says 172.21.15.39:60154) 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 -- 172.21.15.39:0/3015488967 learned_addr learned my addr 172.21.15.39:0/3015488967 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f1915400640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19200cfd30 0x7f19200b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191e800640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200d1110 0x7f1920159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 -- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200d1110 msgr2=0x7f1920159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200d1110 0x7f1920159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 -- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19200cfd30 msgr2=0x7f19200b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19200cfd30 0x7f19200b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 -- 172.21.15.39:0/3015488967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19200ca570 con 0x7f19200b2050 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191de00640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f19100b0040 tx=0x7f1910019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b2040 con 0x7f19200b2050 2024-04-26T23:36:03.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19100bf070 con 0x7f19200b2050 2024-04-26T23:36:03.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b8870 con 0x7f19200b2050 2024-04-26T23:36:03.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19200c7970 con 0x7f19200b2050 2024-04-26T23:36:03.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19200c7f30 con 0x7f19200b2050 2024-04-26T23:36:03.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19200506d0 con 0x7f19200b2050 2024-04-26T23:36:03.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.621+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f19100b8a10 con 0x7f19200b2050 2024-04-26T23:36:03.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.625+0000 7f1916a00640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 0x7f18fc06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:03.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.625+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5767+0+0 (secure 0 0 0) 0x7f1910121e00 con 0x7f19200b2050 2024-04-26T23:36:03.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.625+0000 7f1915400640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 0x7f18fc06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:03.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.625+0000 7f1915400640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 0x7f18fc06a960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1908007fd0 tx=0x7f1908009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:03.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.629+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1910016580 con 0x7f19200b2050 2024-04-26T23:36:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.829+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f192016af10 con 0x7f19200b2050 2024-04-26T23:36:03.832 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-04-26T23:36:03.829+0000 7f6c56400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:36:03.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.833+0000 7f1916a00640 1 -- 172.21.15.39:0/3015488967 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f19100b8d00 con 0x7f19200b2050 2024-04-26T23:36:03.836 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 msgr2=0x7f18fc06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 0x7f18fc06a960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1908007fd0 tx=0x7f1908009040 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 msgr2=0x7f19200c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f19100b0040 tx=0x7f1910019700 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 shutdown_connections 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18fc0684a0 0x7f18fc06a960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f19200d1110 0x7f1920159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19200cfd30 0x7f19200b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 --2- 172.21.15.39:0/3015488967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19200b2050 0x7f19200c72b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 >> 172.21.15.39:0/3015488967 conn(0x7f19200d2da0 msgr2=0x7f19200cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 shutdown_connections 2024-04-26T23:36:03.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:03.837+0000 7f191f200640 1 -- 172.21.15.39:0/3015488967 wait complete. 2024-04-26T23:36:03.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:36:03.907 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-04-26T23:36:04.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.001+0000 7f0c87800640 1 Processor -- start 2024-04-26T23:36:04.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.001+0000 7f0c87800640 1 -- start start 2024-04-26T23:36:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.001+0000 7f0c87800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c801488f0 0x7f0c800cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c87800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c8006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c87800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c801492a0 con 0x7f0c800cf770 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c87800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0c800cfbd0 con 0x7f0c801488f0 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c87800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0c80070840 con 0x7f0c8006d4c0 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c801488f0 0x7f0c800cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c801488f0 0x7f0c800cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60176/0 (socket says 172.21.15.39:60176) 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 -- 172.21.15.39:0/3021601581 learned_addr learned my addr 172.21.15.39:0/3021601581 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c85800640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c8006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 -- 172.21.15.39:0/3021601581 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 msgr2=0x7f0c8006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c8006f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 -- 172.21.15.39:0/3021601581 >> v1:172.21.15.71:6789/0 conn(0x7f0c800cf770 legacy=0x7f0c8006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 -- 172.21.15.39:0/3021601581 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8006d9c0 con 0x7f0c801488f0 2024-04-26T23:36:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c84e00640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800cf230 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009870 tx=0x7f0c7401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd795d145fba3b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c7f400640 1 -- 172.21.15.39:0/3021601581 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740a95f0 con 0x7f0c801488f0 2024-04-26T23:36:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c7f400640 1 -- 172.21.15.39:0/3021601581 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c740a9790 con 0x7f0c801488f0 2024-04-26T23:36:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.005+0000 7f0c7f400640 1 -- 172.21.15.39:0/3021601581 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740a9b60 con 0x7f0c801488f0 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- 172.21.15.39:0/3021601581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 msgr2=0x7f0c800cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800cf230 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009870 tx=0x7f0c7401c530 comp rx=0 tx=0).stop 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- 172.21.15.39:0/3021601581 shutdown_connections 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c8006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- 172.21.15.39:0/3021601581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800cf230 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- 172.21.15.39:0/3021601581 >> 172.21.15.39:0/3021601581 conn(0x7f0c800ce0e0 msgr2=0x7f0c800ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- 172.21.15.39:0/3021601581 shutdown_connections 2024-04-26T23:36:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- 172.21.15.39:0/3021601581 wait complete. 2024-04-26T23:36:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 Processor -- start 2024-04-26T23:36:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- start start 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c800c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c800cf770 0x7f0c80146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80148cd0 con 0x7f0c801488f0 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8006f070 con 0x7f0c800cf770 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c87800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0c800702e0 con 0x7f0c8006d4c0 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60186/0 (socket says 172.21.15.39:60186) 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 -- 172.21.15.39:0/3961824391 learned_addr learned my addr 172.21.15.39:0/3961824391 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c7fe00640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c800cf770 0x7f0c80146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c84e00640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c800c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 -- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 msgr2=0x7f0c800c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c800c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 -- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c800cf770 msgr2=0x7f0c80146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c800cf770 0x7f0c80146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.009+0000 7f0c85800640 1 -- 172.21.15.39:0/3961824391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c801478b0 con 0x7f0c801488f0 2024-04-26T23:36:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c85800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c78007d70 tx=0x7f0c7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78014420 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c78019070 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c80147b90 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78014820 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c80157a00 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8006a720 con 0x7f0c801488f0 2024-04-26T23:36:04.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f0c780149c0 con 0x7f0c801488f0 2024-04-26T23:36:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 0x7f0c6006a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5853+0+0 (secure 0 0 0) 0x7f0c78087140 con 0x7f0c801488f0 2024-04-26T23:36:04.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.013+0000 7f0c84e00640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 0x7f0c6006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:04.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.017+0000 7f0c84e00640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 0x7f0c6006a990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0c740ae000 tx=0x7f0c740b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:04.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.017+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c78056fa0 con 0x7f0c801488f0 2024-04-26T23:36:04.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.217+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0c800cd5a0 con 0x7f0c801488f0 2024-04-26T23:36:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.833+0000 7f0c7cc00640 1 -- 172.21.15.39:0/3961824391 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f0c7805b2a0 con 0x7f0c801488f0 2024-04-26T23:36:04.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 msgr2=0x7f0c6006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 0x7f0c6006a990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0c740ae000 tx=0x7f0c740b3040 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 msgr2=0x7f0c800ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c78007d70 tx=0x7f0c7800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 shutdown_connections 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c600684d0 0x7f0c6006a990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c801488f0 0x7f0c800ca9c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c800cf770 0x7f0c80146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 --2- 172.21.15.39:0/3961824391 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c8006d4c0 0x7f0c800c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 >> 172.21.15.39:0/3961824391 conn(0x7f0c800ce0e0 msgr2=0x7f0c80169960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 shutdown_connections 2024-04-26T23:36:04.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:04.837+0000 7f0c87800640 1 -- 172.21.15.39:0/3961824391 wait complete. 2024-04-26T23:36:04.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:36:05.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 Processor -- start 2024-04-26T23:36:05.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 -- start start 2024-04-26T23:36:05.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c145870 0x7fa83c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa83c06f4d0 0x7fa83c06f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa83c15fa90 0x7fa83c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa83c06fe70 con 0x7fa83c06f4d0 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa83c0cfd30 con 0x7fa83c15fa90 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa842800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c0d0010 con 0x7fa83c145870 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa832a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa83c06f4d0 0x7fa83c06f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa832a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa83c06f4d0 0x7fa83c06f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60188/0 (socket says 172.21.15.39:60188) 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa832a00640 1 -- 172.21.15.39:0/1524510610 learned_addr learned my addr 172.21.15.39:0/1524510610 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa83be00640 1 --2- 172.21.15.39:0/1524510610 >> v2:172.21.15.71:3300/0 conn(0x7fa83c15fa90 0x7fa83c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.053+0000 7fa83b400640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c145870 0x7fa83c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 -- 172.21.15.39:0/1524510610 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c145870 msgr2=0x7fa83c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c145870 0x7fa83c0cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 -- 172.21.15.39:0/1524510610 >> v2:172.21.15.71:3300/0 conn(0x7fa83c15fa90 msgr2=0x7fa83c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 --2- 172.21.15.39:0/1524510610 >> v2:172.21.15.71:3300/0 conn(0x7fa83c15fa90 0x7fa83c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 -- 172.21.15.39:0/1524510610 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c0d02f0 con 0x7fa83c06f4d0 2024-04-26T23:36:05.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa832a00640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c06f4d0 0x7fa83c06f930 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa83c153570 tx=0x7fa82401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a9e722f67cfe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:05.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa83aa00640 1 -- 172.21.15.39:0/1524510610 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240aa620 con 0x7fa83c06f4d0 2024-04-26T23:36:05.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa83aa00640 1 -- 172.21.15.39:0/1524510610 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8240af070 con 0x7fa83c06f4d0 2024-04-26T23:36:05.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa83aa00640 1 -- 172.21.15.39:0/1524510610 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240aa9e0 con 0x7fa83c06f4d0 2024-04-26T23:36:05.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 -- 172.21.15.39:0/1524510610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c06f4d0 msgr2=0x7fa83c06f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:05.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c06f4d0 0x7fa83c06f930 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa83c153570 tx=0x7fa82401c520 comp rx=0 tx=0).stop 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 -- 172.21.15.39:0/1524510610 shutdown_connections 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 --2- 172.21.15.39:0/1524510610 >> v2:172.21.15.71:3300/0 conn(0x7fa83c15fa90 0x7fa83c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c06f4d0 0x7fa83c06f930 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 --2- 172.21.15.39:0/1524510610 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c145870 0x7fa83c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.057+0000 7fa842800640 1 -- 172.21.15.39:0/1524510610 >> 172.21.15.39:0/1524510610 conn(0x7fa83c0b2cc0 msgr2=0x7fa83c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:05.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- 172.21.15.39:0/1524510610 shutdown_connections 2024-04-26T23:36:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- 172.21.15.39:0/1524510610 wait complete. 2024-04-26T23:36:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 Processor -- start 2024-04-26T23:36:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- start start 2024-04-26T23:36:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c06f4d0 0x7fa83c143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 0x7fa83c166570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0cf9c0 con 0x7fa83c145870 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0cf840 con 0x7fa83c15fa90 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa842800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c15d590 con 0x7fa83c06f4d0 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60204/0 (socket says 172.21.15.39:60204) 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 -- 172.21.15.39:0/220639828 learned_addr learned my addr 172.21.15.39:0/220639828 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa83b400640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c06f4d0 0x7fa83c143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa83be00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 0x7fa83c166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 -- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c06f4d0 msgr2=0x7fa83c143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c06f4d0 0x7fa83c143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 -- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 msgr2=0x7fa83c166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:05.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 0x7fa83c166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:05.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 -- 172.21.15.39:0/220639828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c1549e0 con 0x7fa83c145870 2024-04-26T23:36:05.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa83be00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 0x7fa83c166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:05.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.061+0000 7fa832a00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa82401abd0 tx=0x7fa82401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.065+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240aac70 con 0x7fa83c145870 2024-04-26T23:36:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.065+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8240aae10 con 0x7fa83c145870 2024-04-26T23:36:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.065+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240bd630 con 0x7fa83c145870 2024-04-26T23:36:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.065+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c154cc0 con 0x7fa83c145870 2024-04-26T23:36:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.065+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c143dd0 con 0x7fa83c145870 2024-04-26T23:36:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c050740 con 0x7fa83c145870 2024-04-26T23:36:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fa8240b33f0 con 0x7fa83c145870 2024-04-26T23:36:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa833e00640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 0x7fa81806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5853+0+0 (secure 0 0 0) 0x7fa824120a30 con 0x7fa83c145870 2024-04-26T23:36:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa83b400640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 0x7fa81806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:05.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.069+0000 7fa83b400640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 0x7fa81806a990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa83c15d030 tx=0x7fa82c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.073+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8240c3060 con 0x7fa83c145870 2024-04-26T23:36:05.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:05.241+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa83c15d180 con 0x7fa83c145870 2024-04-26T23:36:06.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.072+0000 7fa833e00640 1 -- 172.21.15.39:0/220639828 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) ==== 181+0+0 (secure 0 0 0) 0x7fa824016110 con 0x7fa83c145870 2024-04-26T23:36:06.075 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 msgr2=0x7fa81806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 0x7fa81806a990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa83c15d030 tx=0x7fa82c009190 comp rx=0 tx=0).stop 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 msgr2=0x7fa83c166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa82401abd0 tx=0x7fa82401ad60 comp rx=0 tx=0).stop 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 shutdown_connections 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fa8180684d0 0x7fa81806a990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa83c15fa90 0x7fa83c166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa83c145870 0x7fa83c166030 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 --2- 172.21.15.39:0/220639828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa83c06f4d0 0x7fa83c143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 >> 172.21.15.39:0/220639828 conn(0x7fa83c0b2cc0 msgr2=0x7fa83c0b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:06.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 shutdown_connections 2024-04-26T23:36:06.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.076+0000 7fa842800640 1 -- 172.21.15.39:0/220639828 wait complete. 2024-04-26T23:36:06.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:36:06.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 Processor -- start 2024-04-26T23:36:06.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 -- start start 2024-04-26T23:36:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa01c06f4d0 0x7fa01c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa01c072cf0 0x7fa01c073160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa01c0cfd30 con 0x7fa01c145870 2024-04-26T23:36:06.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa01c0cfa10 con 0x7fa01c072cf0 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa023000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa01c0d0010 con 0x7fa01c06f4d0 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa01c072cf0 0x7fa01c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa01c072cf0 0x7fa01c073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60218/0 (socket says 172.21.15.39:60218) 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 -- 172.21.15.39:0/2441057449 learned_addr learned my addr 172.21.15.39:0/2441057449 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa013400640 1 --2- 172.21.15.39:0/2441057449 >> v2:172.21.15.71:3300/0 conn(0x7fa01c06f4d0 0x7fa01c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 -- 172.21.15.39:0/2441057449 >> v2:172.21.15.71:3300/0 conn(0x7fa01c06f4d0 msgr2=0x7fa01c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:06.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 --2- 172.21.15.39:0/2441057449 >> v2:172.21.15.71:3300/0 conn(0x7fa01c06f4d0 0x7fa01c06f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 -- 172.21.15.39:0/2441057449 >> v1:172.21.15.71:6789/0 conn(0x7fa01c145870 legacy=0x7fa01c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.252+0000 7fa021000640 1 -- 172.21.15.39:0/2441057449 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c0d02f0 con 0x7fa01c072cf0 2024-04-26T23:36:06.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa021000640 1 --2- 172.21.15.39:0/2441057449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c072cf0 0x7fa01c073160 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0b6e40 tx=0x7fa01401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27c468f700b3c60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:06.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa01b400640 1 -- 172.21.15.39:0/2441057449 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140a57d0 con 0x7fa01c072cf0 2024-04-26T23:36:06.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa01b400640 1 -- 172.21.15.39:0/2441057449 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0140a5970 con 0x7fa01c072cf0 2024-04-26T23:36:06.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa01b400640 1 -- 172.21.15.39:0/2441057449 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140a5d40 con 0x7fa01c072cf0 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 -- 172.21.15.39:0/2441057449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c072cf0 msgr2=0x7fa01c073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 --2- 172.21.15.39:0/2441057449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c072cf0 0x7fa01c073160 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0b6e40 tx=0x7fa01401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 -- 172.21.15.39:0/2441057449 shutdown_connections 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 --2- 172.21.15.39:0/2441057449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c072cf0 0x7fa01c073160 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 --2- 172.21.15.39:0/2441057449 >> v2:172.21.15.71:3300/0 conn(0x7fa01c06f4d0 0x7fa01c06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 -- 172.21.15.39:0/2441057449 >> 172.21.15.39:0/2441057449 conn(0x7fa01c0b2cc0 msgr2=0x7fa01c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 -- 172.21.15.39:0/2441057449 shutdown_connections 2024-04-26T23:36:06.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.256+0000 7fa023000640 1 -- 172.21.15.39:0/2441057449 wait complete. 2024-04-26T23:36:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 Processor -- start 2024-04-26T23:36:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- start start 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa01c06f4d0 0x7fa01c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 0x7fa01c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c072420 con 0x7fa01c145870 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c0722a0 con 0x7fa01c072cf0 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa01c073ab0 con 0x7fa01c06f4d0 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60234/0 (socket says 172.21.15.39:60234) 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 -- 172.21.15.39:0/3452482733 learned_addr learned my addr 172.21.15.39:0/3452482733 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:06.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa013400640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 0x7fa01c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa01be00640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa01c06f4d0 0x7fa01c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 -- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa01c06f4d0 msgr2=0x7fa01c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa01c06f4d0 0x7fa01c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 -- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 msgr2=0x7fa01c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 0x7fa01c0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 -- 172.21.15.39:0/3452482733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c166a40 con 0x7fa01c145870 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa013400640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 0x7fa01c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa021000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af040 tx=0x7fa014019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140b8670 con 0x7fa01c145870 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0140be070 con 0x7fa01c145870 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140b8a50 con 0x7fa01c145870 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01c153e00 con 0x7fa01c145870 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01c157250 con 0x7fa01c145870 2024-04-26T23:36:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.260+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01c050740 con 0x7fa01c145870 2024-04-26T23:36:06.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.264+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fa0140b8bf0 con 0x7fa01c145870 2024-04-26T23:36:06.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.264+0000 7fa018c00640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 0x7f9ff806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:06.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.264+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5415+0+0 (secure 0 0 0) 0x7fa014121b20 con 0x7fa01c145870 2024-04-26T23:36:06.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.264+0000 7fa01be00640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 0x7f9ff806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:06.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.264+0000 7fa01be00640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 0x7f9ff806a9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa00c000f70 tx=0x7fa00c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:06.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.268+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa0140165e0 con 0x7fa01c145870 2024-04-26T23:36:06.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:06.432+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa01c0730d0 con 0x7fa01c145870 2024-04-26T23:36:07.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.072+0000 7fa018c00640 1 -- 172.21.15.39:0/3452482733 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) ==== 169+0+0 (secure 0 0 0) 0x7fa0140f2080 con 0x7fa01c145870 2024-04-26T23:36:07.076 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 msgr2=0x7f9ff806a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 0x7f9ff806a9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa00c000f70 tx=0x7fa00c009040 comp rx=0 tx=0).stop 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 msgr2=0x7fa01c0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af040 tx=0x7fa014019790 comp rx=0 tx=0).stop 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 shutdown_connections 2024-04-26T23:36:07.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9ff8068500 0x7f9ff806a9c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa01c145870 0x7fa01c0b11f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa01c072cf0 0x7fa01c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 --2- 172.21.15.39:0/3452482733 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa01c06f4d0 0x7fa01c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 >> 172.21.15.39:0/3452482733 conn(0x7fa01c0b2cc0 msgr2=0x7fa01c0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 shutdown_connections 2024-04-26T23:36:07.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.076+0000 7fa023000640 1 -- 172.21.15.39:0/3452482733 wait complete. 2024-04-26T23:36:07.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:36:07.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 Processor -- start 2024-04-26T23:36:07.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 -- start start 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe3d8161850 0x7fe3d80d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3d80d1720 0x7fe3d80cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d806e500 con 0x7fe3d8140170 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d806f110 con 0x7fe3d8161850 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3dea00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d806e7e0 con 0x7fe3d80d1720 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.244+0000 7fe3cf400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe3d8161850 0x7fe3d80d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe3d8161850 0x7fe3d80d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60242/0 (socket says 172.21.15.39:60242) 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 -- 172.21.15.39:0/370576141 learned_addr learned my addr 172.21.15.39:0/370576141 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3dca00640 1 --2- 172.21.15.39:0/370576141 >> v2:172.21.15.71:3300/0 conn(0x7fe3d80d1720 0x7fe3d80cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 -- 172.21.15.39:0/370576141 >> v2:172.21.15.71:3300/0 conn(0x7fe3d80d1720 msgr2=0x7fe3d80cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 --2- 172.21.15.39:0/370576141 >> v2:172.21.15.71:3300/0 conn(0x7fe3d80d1720 0x7fe3d80cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 -- 172.21.15.39:0/370576141 >> v1:172.21.15.71:6789/0 conn(0x7fe3d8140170 legacy=0x7fe3d815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 -- 172.21.15.39:0/370576141 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d806eac0 con 0x7fe3d8161850 2024-04-26T23:36:07.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3cf400640 1 --2- 172.21.15.39:0/370576141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8161850 0x7fe3d80d11e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8074570 tx=0x7fe3c001ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad4837b60b88e26 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3d7400640 1 -- 172.21.15.39:0/370576141 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00b1070 con 0x7fe3d8161850 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3d7400640 1 -- 172.21.15.39:0/370576141 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c00ac600 con 0x7fe3d8161850 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.248+0000 7fe3d7400640 1 -- 172.21.15.39:0/370576141 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00ac9d0 con 0x7fe3d8161850 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- 172.21.15.39:0/370576141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8161850 msgr2=0x7fe3d80d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- 172.21.15.39:0/370576141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8161850 0x7fe3d80d11e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8074570 tx=0x7fe3c001ceb0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- 172.21.15.39:0/370576141 shutdown_connections 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- 172.21.15.39:0/370576141 >> v2:172.21.15.71:3300/0 conn(0x7fe3d80d1720 0x7fe3d80cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- 172.21.15.39:0/370576141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8161850 0x7fe3d80d11e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- 172.21.15.39:0/370576141 >> 172.21.15.39:0/370576141 conn(0x7fe3d806c7d0 msgr2=0x7fe3d806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- 172.21.15.39:0/370576141 shutdown_connections 2024-04-26T23:36:07.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- 172.21.15.39:0/370576141 wait complete. 2024-04-26T23:36:07.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 Processor -- start 2024-04-26T23:36:07.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- start start 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 0x7fe3d8153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3d8161850 0x7fe3d8152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d07d0 con 0x7fe3d80d1720 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d0650 con 0x7fe3d8161850 2024-04-26T23:36:07.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dea00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80d0950 con 0x7fe3d8140170 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60254/0 (socket says 172.21.15.39:60254) 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 -- 172.21.15.39:0/1422690182 learned_addr learned my addr 172.21.15.39:0/1422690182 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3cf400640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 0x7fe3d8153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3dca00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3d8161850 0x7fe3d8152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 -- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 msgr2=0x7fe3d8153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 0x7fe3d8153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 -- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3d8161850 msgr2=0x7fe3d8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3d8161850 0x7fe3d8152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 -- 172.21.15.39:0/1422690182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d813a040 con 0x7fe3d80d1720 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3cf400640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 0x7fe3d8153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:07.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d7e00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c7c0 tx=0x7fe3c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.252+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8016020 con 0x7fe3d80d1720 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8006d60 con 0x7fe3d80d1720 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d813a320 con 0x7fe3d80d1720 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8003bc0 con 0x7fe3d80d1720 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d813a8e0 con 0x7fe3d80d1720 2024-04-26T23:36:07.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d806a720 con 0x7fe3d80d1720 2024-04-26T23:36:07.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fe3c800a850 con 0x7fe3d80d1720 2024-04-26T23:36:07.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3d4c00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 0x7fe3b406a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7fe3c80865a0 con 0x7fe3d80d1720 2024-04-26T23:36:07.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.256+0000 7fe3cf400640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 0x7fe3b406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.260+0000 7fe3cf400640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 0x7fe3b406a990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00ae000 tx=0x7fe3c0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.260+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe3c8020020 con 0x7fe3d80d1720 2024-04-26T23:36:07.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.428+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe3d806fdc0 con 0x7fe3d80d1720 2024-04-26T23:36:07.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.432+0000 7fe3d4c00640 1 -- 172.21.15.39:0/1422690182 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fe3c8019310 con 0x7fe3d80d1720 2024-04-26T23:36:07.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 msgr2=0x7fe3b406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 0x7fe3b406a990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00ae000 tx=0x7fe3c0004740 comp rx=0 tx=0).stop 2024-04-26T23:36:07.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 msgr2=0x7fe3d8139a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c7c0 tx=0x7fe3c800cc80 comp rx=0 tx=0).stop 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 shutdown_connections 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe3b40684d0 0x7fe3b406a990 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3d8161850 0x7fe3d8152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3d8140170 0x7fe3d8153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 --2- 172.21.15.39:0/1422690182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d80d1720 0x7fe3d8139a60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 >> 172.21.15.39:0/1422690182 conn(0x7fe3d806c7d0 msgr2=0x7fe3d80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 shutdown_connections 2024-04-26T23:36:07.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.436+0000 7fe3dea00640 1 -- 172.21.15.39:0/1422690182 wait complete. 2024-04-26T23:36:07.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2024-04-26T23:36:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.596+0000 7ff7bc000640 1 Processor -- start 2024-04-26T23:36:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.596+0000 7ff7bc000640 1 -- start start 2024-04-26T23:36:07.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7bc000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7b40cd810 0x7ff7b40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7bc000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cfe00 0x7ff7b4144050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7bc000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b4144590 con 0x7ff7b40cdbf0 2024-04-26T23:36:07.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7bc000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b40d0b10 con 0x7ff7b40cd810 2024-04-26T23:36:07.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7bc000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b406e970 con 0x7ff7b40cfe00 2024-04-26T23:36:07.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7b40cd810 0x7ff7b40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7b40cd810 0x7ff7b40742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:46976/0 (socket says 172.21.15.39:46976) 2024-04-26T23:36:07.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 -- 172.21.15.39:0/3911340264 learned_addr learned my addr 172.21.15.39:0/3911340264 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:07.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b8c00640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cfe00 0x7ff7b4144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 -- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cfe00 msgr2=0x7ff7b4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:07.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cfe00 0x7ff7b4144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 -- 172.21.15.39:0/3911340264 >> v1:172.21.15.71:6789/0 conn(0x7ff7b40cdbf0 legacy=0x7ff7b406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.600+0000 7ff7b9600640 1 -- 172.21.15.39:0/3911340264 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40d0550 con 0x7ff7b40cd810 2024-04-26T23:36:07.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7b9600640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cd810 0x7ff7b40742f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6f2da45c7f2057 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7b3e00640 1 -- 172.21.15.39:0/3911340264 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80aa430 con 0x7ff7b40cd810 2024-04-26T23:36:07.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7b3e00640 1 -- 172.21.15.39:0/3911340264 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80af070 con 0x7ff7b40cd810 2024-04-26T23:36:07.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7b3e00640 1 -- 172.21.15.39:0/3911340264 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80aa7f0 con 0x7ff7b40cd810 2024-04-26T23:36:07.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cd810 msgr2=0x7ff7b40742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cd810 0x7ff7b40742f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a801c4d0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- 172.21.15.39:0/3911340264 shutdown_connections 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cfe00 0x7ff7b4144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 --2- 172.21.15.39:0/3911340264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cd810 0x7ff7b40742f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- 172.21.15.39:0/3911340264 >> 172.21.15.39:0/3911340264 conn(0x7ff7b40b2af0 msgr2=0x7ff7b40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- 172.21.15.39:0/3911340264 shutdown_connections 2024-04-26T23:36:07.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- 172.21.15.39:0/3911340264 wait complete. 2024-04-26T23:36:07.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 Processor -- start 2024-04-26T23:36:07.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.608+0000 7ff7bc000640 1 -- start start 2024-04-26T23:36:07.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 0x7ff7b40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cdbf0 0x7ff7b415b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 0x7ff7b4140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40ce000 con 0x7ff7b40cfe00 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b406f920 con 0x7ff7b40cdbf0 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b40ce180 con 0x7ff7b40cd810 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b9600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 0x7ff7b40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 0x7ff7b4140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b9600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 0x7ff7b40b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:54400/0 (socket says 172.21.15.39:54400) 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b9600640 1 -- 172.21.15.39:0/2420880560 learned_addr learned my addr 172.21.15.39:0/2420880560 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:07.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b8c00640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cdbf0 0x7ff7b415b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 -- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 msgr2=0x7ff7b40b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 0x7ff7b40b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 -- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cdbf0 msgr2=0x7ff7b415b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:07.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cdbf0 0x7ff7b415b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 -- 172.21.15.39:0/2420880560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40726a0 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7ba000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 0x7ff7b4140460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c730 tx=0x7ff7ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac016020 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac006d60 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b40b5810 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac003bc0 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b40ae8f0 con 0x7ff7b40cfe00 2024-04-26T23:36:07.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.612+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b4050740 con 0x7ff7b40cfe00 2024-04-26T23:36:07.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.616+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7ff7ac0050d0 con 0x7ff7b40cfe00 2024-04-26T23:36:07.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.616+0000 7ff7b1600640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 0x7ff79406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:07.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.616+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7ff7ac086430 con 0x7ff7b40cfe00 2024-04-26T23:36:07.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.616+0000 7ff7b9600640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 0x7ff79406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:07.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.616+0000 7ff7b9600640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 0x7ff79406a960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:07.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.620+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff7ac020020 con 0x7ff7b40cfe00 2024-04-26T23:36:07.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:07.844+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) -- 0x7ff7b40d1920 con 0x7ff7b40cfe00 2024-04-26T23:36:08.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7b1600640 1 -- 172.21.15.39:0/2420880560 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v398) ==== 158+0+0 (secure 0 0 0) 0x7ff7ac056620 con 0x7ff7b40cfe00 2024-04-26T23:36:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 msgr2=0x7ff79406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 0x7ff79406a960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a80a7000 comp rx=0 tx=0).stop 2024-04-26T23:36:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 msgr2=0x7ff7b4140460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 0x7ff7b4140460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c730 tx=0x7ff7ac00cbf0 comp rx=0 tx=0).stop 2024-04-26T23:36:08.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 shutdown_connections 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff7940684a0 0x7ff79406a960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7b40cfe00 0x7ff7b4140460 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b40cdbf0 0x7ff7b415b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 --2- 172.21.15.39:0/2420880560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7b40cd810 0x7ff7b40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 >> 172.21.15.39:0/2420880560 conn(0x7ff7b40b2af0 msgr2=0x7ff7b40b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 shutdown_connections 2024-04-26T23:36:08.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:08.084+0000 7ff7bc000640 1 -- 172.21.15.39:0/2420880560 wait complete. 2024-04-26T23:36:08.114 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ERROR 2024-04-26T23:36:08.114 INFO:tasks.cephfs_test_runner: 2024-04-26T23:36:08.114 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner:ERROR: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 572, in test_volume_info_pending_subvol_deletions 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "rm", self.volname, subvolname) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue().strip() 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T23:36:08.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi039 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol62860' 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:Ran 3 tests in 563.759s 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner: 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:ERROR: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:36:08.116 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 572, in test_volume_info_pending_subvol_deletions 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "rm", self.volname, subvolname) 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue().strip() 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T23:36:08.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:36:08.118 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:36:08.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:36:08.118 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:36:08.118 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi039 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol62860' 2024-04-26T23:36:08.118 INFO:tasks.cephfs_test_runner: 2024-04-26T23:36:08.118 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:36:08.367 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=78d817db466b4aaf9bd88d4857557e08 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2024-04-26T23:36:08.369 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T23:36:08.384 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T23:36:08.405 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T23:36:08.405 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:36:08.405 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:36:08.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:36:08.419 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-04-26T23:36:08.419 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:36:08.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:36:08.471 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:36:08.471 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:36:08.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:36:08.480 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T23:36:08.480 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:36:08.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:36:08.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.533 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:36:08.542 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:36:08.542 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:36:08.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:36:08.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.609 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:36:08.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-04-26T23:36:08.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.829 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-04-26T23:36:08.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-04-26T23:36:08.905 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-04-26T23:36:08.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:36:08.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.907 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:36:08.916 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:36:08.916 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:36:08.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:36:08.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:08.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:36:09.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:09.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-04-26T23:36:09.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:09.223 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-26T23:36:09.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:36:09.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-04-26T23:36:09.298 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-04-26T23:36:09.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:36:09.300 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T23:36:09.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:36:09.313 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:36:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 Processor -- start 2024-04-26T23:36:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 -- start start 2024-04-26T23:36:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f33180cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318160060 con 0x7f33180cf2a0 2024-04-26T23:36:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318160340 con 0x7f3318145820 2024-04-26T23:36:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f331dc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f33180cd5c0 con 0x7f331806fc80 2024-04-26T23:36:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f330e000640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f33180cf2a0 0x7f331806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36432/0 (socket says 172.21.15.39:36432) 2024-04-26T23:36:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f330e000640 1 -- 172.21.15.39:0/1339586544 learned_addr learned my addr 172.21.15.39:0/1339586544 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3317400640 1 --2- 172.21.15.39:0/1339586544 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f33180cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893113215 0 0) 0x7f3318160060 con 0x7f33180cf2a0 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32fc003530 con 0x7f33180cf2a0 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343412378 0 0) 0x7f3318160340 con 0x7f3318145820 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3317400640 1 -- 172.21.15.39:0/1339586544 >> v1:172.21.15.71:6789/0 conn(0x7f3318145820 legacy=0x7f33180b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3317400640 1 -- 172.21.15.39:0/1339586544 >> v1:172.21.15.39:6789/0 conn(0x7f33180cf2a0 legacy=0x7f331806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.452+0000 7f3317400640 1 -- 172.21.15.39:0/1339586544 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318160620 con 0x7f331806fc80 2024-04-26T23:36:09.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f3317400640 1 --2- 172.21.15.39:0/1339586544 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f33180cda50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33100097f0 tx=0x7f331001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf4f6cd6f1aa4c93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33100b0070 con 0x7f331806fc80 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33100ab600 con 0x7f331806fc80 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f3316000640 1 -- 172.21.15.39:0/1339586544 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33100ab9d0 con 0x7f331806fc80 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 -- 172.21.15.39:0/1339586544 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 msgr2=0x7f33180cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 --2- 172.21.15.39:0/1339586544 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f33180cda50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33100097f0 tx=0x7f331001c4e0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 -- 172.21.15.39:0/1339586544 shutdown_connections 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 --2- 172.21.15.39:0/1339586544 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f33180cda50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 -- 172.21.15.39:0/1339586544 >> 172.21.15.39:0/1339586544 conn(0x7f33180b2af0 msgr2=0x7f33180b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 -- 172.21.15.39:0/1339586544 shutdown_connections 2024-04-26T23:36:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.456+0000 7f331dc00640 1 -- 172.21.15.39:0/1339586544 wait complete. 2024-04-26T23:36:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 Processor -- start 2024-04-26T23:36:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- start start 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f3318143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3318145820 0x7f3318072e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f331815fdb0 con 0x7f33180cf2a0 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f331815fc30 con 0x7f3318145820 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3318169dd0 con 0x7f331806fc80 2024-04-26T23:36:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60266/0 (socket says 172.21.15.39:60266) 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 -- 172.21.15.39:0/782504101 learned_addr learned my addr 172.21.15.39:0/782504101 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f3316a00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f3318143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f3317400640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3318145820 0x7f3318072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 -- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 msgr2=0x7f3318143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f3318143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 -- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3318145820 msgr2=0x7f3318072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3318145820 0x7f3318072e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 -- 172.21.15.39:0/782504101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318143750 con 0x7f33180cf2a0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330e000640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f330000cbb0 tx=0x7f330000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300017070 con 0x7f33180cf2a0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330000ad00 con 0x7f33180cf2a0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3318143a30 con 0x7f33180cf2a0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300012640 con 0x7f33180cf2a0 2024-04-26T23:36:09.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.460+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3318143ff0 con 0x7f33180cf2a0 2024-04-26T23:36:09.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318050740 con 0x7f33180cf2a0 2024-04-26T23:36:09.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f330001a070 con 0x7f33180cf2a0 2024-04-26T23:36:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f330f400640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 0x7f32f406a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f33000865d0 con 0x7f33180cf2a0 2024-04-26T23:36:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f3316a00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 0x7f32f406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.464+0000 7f3316a00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 0x7f32f406a990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.468+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f33000566b0 con 0x7f33180cf2a0 2024-04-26T23:36:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.632+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3318155b80 con 0x7f32f40684d0 2024-04-26T23:36:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.632+0000 7f330f400640 1 -- 172.21.15.39:0/782504101 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13505 (secure 0 0 0) 0x7f3318155b80 con 0x7f32f40684d0 2024-04-26T23:36:09.636 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:09.637 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:36:09.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 msgr2=0x7f32f406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 0x7f32f406a990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).stop 2024-04-26T23:36:09.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 msgr2=0x7f331813b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f330000cbb0 tx=0x7f330000a430 comp rx=0 tx=0).stop 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 shutdown_connections 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f32f40684d0 0x7f32f406a990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3318145820 0x7f3318072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33180cf2a0 0x7f331813b4e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 --2- 172.21.15.39:0/782504101 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f331806fc80 0x7f3318143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 >> 172.21.15.39:0/782504101 conn(0x7f33180b2af0 msgr2=0x7f331806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 shutdown_connections 2024-04-26T23:36:09.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.636+0000 7f331dc00640 1 -- 172.21.15.39:0/782504101 wait complete. 2024-04-26T23:36:09.658 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-04-26T23:36:07.812531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261556,"kb_used_data":16264,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754713164,"statfs":{"total":773094113280,"available":772826279936,"internally_reserved":0,"allocated":16654336,"data_stored":12917274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13140342,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1056,"num_write_kb":-13511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001443"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T23:36:06.680890+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:36:06.680890+0000","last_peered":"2024-04-26T23:36:06.680890+0000","last_clean":"2024-04-26T23:36:06.680890+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:36:06.680890+0000","last_undegraded":"2024-04-26T23:36:06.680890+0000","last_fullsized":"2024-04-26T23:36:06.680890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1492791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":5005312,"data_stored":4540243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":352038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":5005312,"data_stored":4540263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:36:09.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:36:09.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 Processor -- start 2024-04-26T23:36:09.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 -- start start 2024-04-26T23:36:09.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5640b5710 0x7fb56409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb56415f720 0x7fb56409bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5640cd810 con 0x7fb56415f340 2024-04-26T23:36:09.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb5640d26a0 con 0x7fb5640b5710 2024-04-26T23:36:09.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb56b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640ce140 con 0x7fb56415f720 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5640b5710 0x7fb56409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5640b5710 0x7fb56409b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60272/0 (socket says 172.21.15.39:60272) 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 -- 172.21.15.39:0/1525820219 learned_addr learned my addr 172.21.15.39:0/1525820219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb568a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb56415f340 0x7fb5640d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:52782/0 (socket says 172.21.15.39:52782) 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb569400640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb56415f720 0x7fb56409bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 -- 172.21.15.39:0/1525820219 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb56415f720 msgr2=0x7fb56409bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb56415f720 0x7fb56409bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 -- 172.21.15.39:0/1525820219 >> v1:172.21.15.71:6789/0 conn(0x7fb56415f340 legacy=0x7fb5640d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.796+0000 7fb55be00640 1 -- 172.21.15.39:0/1525820219 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5640cdaf0 con 0x7fb5640b5710 2024-04-26T23:36:09.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb55be00640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5640b5710 0x7fb56409b9e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009870 tx=0x7fb54c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e590b2cf687650 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb563e00640 1 -- 172.21.15.39:0/1525820219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0b1070 con 0x7fb5640b5710 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb563e00640 1 -- 172.21.15.39:0/1525820219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c0a8050 con 0x7fb5640b5710 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb563e00640 1 -- 172.21.15.39:0/1525820219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0ac860 con 0x7fb5640b5710 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 -- 172.21.15.39:0/1525820219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5640b5710 msgr2=0x7fb56409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5640b5710 0x7fb56409b9e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009870 tx=0x7fb54c01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 -- 172.21.15.39:0/1525820219 shutdown_connections 2024-04-26T23:36:09.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb56415f720 0x7fb56409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 --2- 172.21.15.39:0/1525820219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5640b5710 0x7fb56409b9e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 -- 172.21.15.39:0/1525820219 >> 172.21.15.39:0/1525820219 conn(0x7fb5640b4b80 msgr2=0x7fb5640b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:09.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 -- 172.21.15.39:0/1525820219 shutdown_connections 2024-04-26T23:36:09.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.800+0000 7fb56b400640 1 -- 172.21.15.39:0/1525820219 wait complete. 2024-04-26T23:36:09.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 Processor -- start 2024-04-26T23:36:09.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- start start 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 0x7fb564154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb56415f340 0x7fb5640c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b8ec0 con 0x7fb56415f720 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b8d40 con 0x7fb56415f340 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640ce5b0 con 0x7fb5640b5710 2024-04-26T23:36:09.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb569400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 0x7fb564154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb569400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60284/0 (socket says 172.21.15.39:60284) 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb569400640 1 -- 172.21.15.39:0/1407802732 learned_addr learned my addr 172.21.15.39:0/1407802732 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb55be00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb56415f340 0x7fb5640c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 -- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb56415f340 msgr2=0x7fb5640c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb56415f340 0x7fb5640c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 -- 172.21.15.39:0/1407802732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 msgr2=0x7fb564161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 -- 172.21.15.39:0/1407802732 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb564155240 con 0x7fb5640b5710 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb569400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb568a00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 0x7fb564154400 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c390 tx=0x7fb55400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5540074e0 con 0x7fb5640b5710 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb554007680 con 0x7fb5640b5710 2024-04-26T23:36:09.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554004a10 con 0x7fb5640b5710 2024-04-26T23:36:09.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb564155520 con 0x7fb5640b5710 2024-04-26T23:36:09.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.804+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564155ae0 con 0x7fb5640b5710 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb564050740 con 0x7fb5640b5710 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fb55401a020 con 0x7fb5640b5710 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb561600640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 0x7fb54006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7fb554085ee0 con 0x7fb5640b5710 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb55be00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 0x7fb54006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:09.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.808+0000 7fb55be00640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 0x7fb54006a960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0ae000 tx=0x7fb54c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:09.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.812+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb554055fa0 con 0x7fb5640b5710 2024-04-26T23:36:09.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.980+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb56415a0f0 con 0x7fb5400684a0 2024-04-26T23:36:09.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.980+0000 7fb561600640 1 -- 172.21.15.39:0/1407802732 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13505 (secure 0 0 0) 0x7fb56415a0f0 con 0x7fb5400684a0 2024-04-26T23:36:09.984 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:09.985 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:36:09.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 msgr2=0x7fb54006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 0x7fb54006a960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0ae000 tx=0x7fb54c008040 comp rx=0 tx=0).stop 2024-04-26T23:36:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 msgr2=0x7fb564154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 0x7fb564154400 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c390 tx=0x7fb55400c850 comp rx=0 tx=0).stop 2024-04-26T23:36:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 shutdown_connections 2024-04-26T23:36:09.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fb5400684a0 0x7fb54006a960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb56415f720 0x7fb564161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb56415f340 0x7fb5640c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 --2- 172.21.15.39:0/1407802732 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5640b5710 0x7fb564154400 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 >> 172.21.15.39:0/1407802732 conn(0x7fb5640b4b80 msgr2=0x7fb5640b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 shutdown_connections 2024-04-26T23:36:09.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:09.984+0000 7fb56b400640 1 -- 172.21.15.39:0/1407802732 wait complete. 2024-04-26T23:36:10.005 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-04-26T23:36:09.812902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261556,"kb_used_data":16264,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754713164,"statfs":{"total":773094113280,"available":772826279936,"internally_reserved":0,"allocated":16654336,"data_stored":12917274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13140342,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1056,"num_write_kb":-13511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001189"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T23:36:06.680890+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:36:06.680890+0000","last_peered":"2024-04-26T23:36:06.680890+0000","last_clean":"2024-04-26T23:36:06.680890+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:36:06.680890+0000","last_undegraded":"2024-04-26T23:36:06.680890+0000","last_fullsized":"2024-04-26T23:36:06.680890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1492791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":5005312,"data_stored":4540243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":352038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":5005312,"data_stored":4540263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:36:10.006 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:36:10.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:36:10.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:10.062 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:10.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.144+0000 7f1f91c00640 1 Processor -- start 2024-04-26T23:36:10.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.144+0000 7f1f91c00640 1 -- start start 2024-04-26T23:36:10.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91c00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c0d3ce0 con 0x7f1f8c1608e0 2024-04-26T23:36:10.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c0cede0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0ce540 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91200640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1f8c1608e0 0x7f1f8c0b5e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53680/0 (socket says 172.21.15.39:53680) 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f91200640 1 -- 172.21.15.39:0/3581056670 learned_addr learned my addr 172.21.15.39:0/3581056670 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8be00640 1 --2- 172.21.15.39:0/3581056670 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228467353 0 0) 0x7f1f8c0cede0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f70003530 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758666760 0 0) 0x7f1f8c0d3ce0 con 0x7f1f8c1608e0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f8c0cede0 con 0x7f1f8c1608e0 2024-04-26T23:36:10.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8be00640 1 -- 172.21.15.39:0/3581056670 >> v1:172.21.15.71:6789/0 conn(0x7f1f8c0d02f0 legacy=0x7f1f8c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8be00640 1 -- 172.21.15.39:0/3581056670 >> v1:172.21.15.39:6789/0 conn(0x7f1f8c1608e0 legacy=0x7f1f8c0b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.148+0000 7f1f8be00640 1 -- 172.21.15.39:0/3581056670 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c0ce820 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f8be00640 1 --2- 172.21.15.39:0/3581056670 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c0cfdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009dc0 tx=0x7f1f7c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a5303e41725eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0b2070 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0a5960 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f8b400640 1 -- 172.21.15.39:0/3581056670 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0a5d30 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- 172.21.15.39:0/3581056670 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 msgr2=0x7f1f8c0cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 --2- 172.21.15.39:0/3581056670 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c0cfdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009dc0 tx=0x7f1f7c01c990 comp rx=0 tx=0).stop 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- 172.21.15.39:0/3581056670 shutdown_connections 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 --2- 172.21.15.39:0/3581056670 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c0cfdb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- 172.21.15.39:0/3581056670 >> 172.21.15.39:0/3581056670 conn(0x7f1f8c0d2d80 msgr2=0x7f1f8c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:10.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- 172.21.15.39:0/3581056670 shutdown_connections 2024-04-26T23:36:10.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- 172.21.15.39:0/3581056670 wait complete. 2024-04-26T23:36:10.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 Processor -- start 2024-04-26T23:36:10.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 -- start start 2024-04-26T23:36:10.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.152+0000 7f1f91c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 0x7f1f8c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0b6ef0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0b6d70 con 0x7f1f8c1608e0 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0b7070 con 0x7f1f8c0cf9d0 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f8be00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 0x7f1f8c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33344/0 (socket says 172.21.15.39:33344) 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 -- 172.21.15.39:0/1336517027 learned_addr learned my addr 172.21.15.39:0/1336517027 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 -- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 msgr2=0x7f1f8c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 -- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 msgr2=0x7f1f8c159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 0x7f1f8c159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 -- 172.21.15.39:0/1336517027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c06df80 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f8be00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91200640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 0x7f1f8c159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f83400640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c3c0 tx=0x7f1f7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74017070 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740052d0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f740054c0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c158ee0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c1594a0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8c0506d0 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.156+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f1f7401a070 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.160+0000 7f1f88c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 0x7f1f6806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.160+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f1f74085b70 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.160+0000 7f1f8be00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 0x7f1f6806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.160+0000 7f1f8be00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 0x7f1f6806a990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0af000 tx=0x7f1f7c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.164+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f74055c30 con 0x7f1f8c0d02f0 2024-04-26T23:36:10.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f8c0c99b0 con 0x7f1f680684d0 2024-04-26T23:36:10.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f88c00640 1 -- 172.21.15.39:0/1336517027 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13505 (secure 0 0 0) 0x7f1f8c0c99b0 con 0x7f1f680684d0 2024-04-26T23:36:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:10.328 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:36:10.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 msgr2=0x7f1f6806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 0x7f1f6806a990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0af000 tx=0x7f1f7c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:36:10.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 msgr2=0x7f1f8c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c3c0 tx=0x7f1f7400c880 comp rx=0 tx=0).stop 2024-04-26T23:36:10.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 shutdown_connections 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1f680684d0 0x7f1f6806a990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f8c1608e0 0x7f1f8c159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f8c0d02f0 0x7f1f8c06d4e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 --2- 172.21.15.39:0/1336517027 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f8c0cf9d0 0x7f1f8c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.324+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 >> 172.21.15.39:0/1336517027 conn(0x7f1f8c0d2d80 msgr2=0x7f1f8c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.328+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 shutdown_connections 2024-04-26T23:36:10.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.328+0000 7f1f91c00640 1 -- 172.21.15.39:0/1336517027 wait complete. 2024-04-26T23:36:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-04-26T23:36:09.812902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261556,"kb_used_data":16264,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754713164,"statfs":{"total":773094113280,"available":772826279936,"internally_reserved":0,"allocated":16654336,"data_stored":12917274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13140342,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1056,"num_write_kb":-13511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001189"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T23:36:06.680890+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:36:06.680890+0000","last_peered":"2024-04-26T23:36:06.680890+0000","last_clean":"2024-04-26T23:36:06.680890+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:36:06.680890+0000","last_undegraded":"2024-04-26T23:36:06.680890+0000","last_fullsized":"2024-04-26T23:36:06.680890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1492791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":5005312,"data_stored":4540243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":352038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":5005312,"data_stored":4540263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":351908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:36:10.350 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:36:10.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.528+0000 7f9ca3800640 1 Processor -- start 2024-04-26T23:36:10.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.528+0000 7f9ca3800640 1 -- start start 2024-04-26T23:36:10.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca3800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 0x7f9c9c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca3800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9c9c0ae850 0x7f9c9c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca3800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9c06eab0 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca3800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9c0b4d70 con 0x7f9c9c0ae850 2024-04-26T23:36:10.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca3800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9c0aedf0 con 0x7f9c9c15f5d0 2024-04-26T23:36:10.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca0e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9c9c15f1f0 0x7f9c9c073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53694/0 (socket says 172.21.15.39:53694) 2024-04-26T23:36:10.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca0e00640 1 -- 172.21.15.39:0/1175275709 learned_addr learned my addr 172.21.15.39:0/1175275709 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:10.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9c9be00640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 0x7f9c9c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca1800640 1 --2- 172.21.15.39:0/1175275709 >> v2:172.21.15.71:3300/0 conn(0x7f9c9c0ae850 0x7f9c9c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9c9b400640 1 -- 172.21.15.39:0/1175275709 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101636773 0 0) 0x7f9c90001120 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9c9b400640 1 -- 172.21.15.39:0/1175275709 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c84003530 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca1800640 1 -- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 msgr2=0x7f9c9c06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca1800640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 0x7f9c9c06d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca1800640 1 -- 172.21.15.39:0/1175275709 >> v1:172.21.15.39:6789/0 conn(0x7f9c9c15f1f0 legacy=0x7f9c9c073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9ca1800640 1 -- 172.21.15.39:0/1175275709 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c0b4720 con 0x7f9c9c0ae850 2024-04-26T23:36:10.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.532+0000 7f9c9be00640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 0x7f9c9c06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:10.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca1800640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c0ae850 0x7f9c9c06d920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009d90 tx=0x7f9c9401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e06279bd43a8ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9c9b400640 1 -- 172.21.15.39:0/1175275709 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c940b4070 con 0x7f9c9c0ae850 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9c9b400640 1 -- 172.21.15.39:0/1175275709 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c940af600 con 0x7f9c9c0ae850 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9c9b400640 1 -- 172.21.15.39:0/1175275709 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c940af9d0 con 0x7f9c9c0ae850 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c0ae850 msgr2=0x7f9c9c06d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c0ae850 0x7f9c9c06d920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009d90 tx=0x7f9c9401f150 comp rx=0 tx=0).stop 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- 172.21.15.39:0/1175275709 shutdown_connections 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c0ae850 0x7f9c9c06d920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 --2- 172.21.15.39:0/1175275709 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c15f5d0 0x7f9c9c06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- 172.21.15.39:0/1175275709 >> 172.21.15.39:0/1175275709 conn(0x7f9c9c0729d0 msgr2=0x7f9c9c072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- 172.21.15.39:0/1175275709 shutdown_connections 2024-04-26T23:36:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- 172.21.15.39:0/1175275709 wait complete. 2024-04-26T23:36:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 Processor -- start 2024-04-26T23:36:10.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.536+0000 7f9ca3800640 1 -- start start 2024-04-26T23:36:10.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c0ae850 0x7f9c9c162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c15f5d0 0x7f9c9c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c0b5380 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c0b5200 con 0x7f9c9c15f5d0 2024-04-26T23:36:10.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9c0b5500 con 0x7f9c9c0ae850 2024-04-26T23:36:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33352/0 (socket says 172.21.15.39:33352) 2024-04-26T23:36:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 -- 172.21.15.39:0/549177008 learned_addr learned my addr 172.21.15.39:0/549177008 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca0e00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c0ae850 0x7f9c9c162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca1800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c15f5d0 0x7f9c9c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 -- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c0ae850 msgr2=0x7f9c9c162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c0ae850 0x7f9c9c162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 -- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c15f5d0 msgr2=0x7f9c9c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c15f5d0 0x7f9c9c150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 -- 172.21.15.39:0/549177008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c1519d0 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c9be00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e980 tx=0x7f9c8800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88017070 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8800ca00 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800cdd0 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c0ce0e0 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c0ce690 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9c050740 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.540+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f9c8801a070 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.544+0000 7f9c98c00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 0x7f9c7c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.544+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f9c880866d0 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.544+0000 7f9ca0e00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 0x7f9c7c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:10.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.544+0000 7f9ca0e00640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 0x7f9c7c06a960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005890 tx=0x7f9c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:10.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.548+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9c88056820 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.712+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c9c068890 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9c98c00640 1 -- 172.21.15.39:0/549177008 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+12961 (secure 0 0 0) 0x7f9c8805ab20 con 0x7f9c9c15f1f0 2024-04-26T23:36:10.719 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:10.719 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":68,"fsid":"65ff9fdb-1208-4558-966c-a36e641138f0","created":"2024-04-26T23:25:48.657759+0000","modified":"2024-04-26T23:36:07.075890+0000","last_up_change":"2024-04-26T23:26:00.989420+0000","last_in_change":"2024-04-26T23:25:51.275396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:26:01.681858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39e9400e-09e1-4013-a3c2-38057b71c364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6801","nonce":3002752600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6803","nonce":3002752600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6807","nonce":3002752600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3002752600},{"type":"v1","addr":"172.21.15.39:6805","nonce":3002752600}]},"public_addr":"172.21.15.39:6801/3002752600","cluster_addr":"172.21.15.39:6803/3002752600","heartbeat_back_addr":"172.21.15.39:6807/3002752600","heartbeat_front_addr":"172.21.15.39:6805/3002752600","state":["exists","up"]},{"osd":1,"uuid":"12cdd206-8fac-4f71-b1a9-cf5078d7a3e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6809","nonce":4093290330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6811","nonce":4093290330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6815","nonce":4093290330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":4093290330},{"type":"v1","addr":"172.21.15.39:6813","nonce":4093290330}]},"public_addr":"172.21.15.39:6809/4093290330","cluster_addr":"172.21.15.39:6811/4093290330","heartbeat_back_addr":"172.21.15.39:6815/4093290330","heartbeat_front_addr":"172.21.15.39:6813/4093290330","state":["exists","up"]},{"osd":2,"uuid":"0246a346-6249-463b-b4f5-2ceb40813ba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6817","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6819","nonce":2063945159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6821","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6823","nonce":2063945159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6829","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6831","nonce":2063945159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6825","nonce":2063945159},{"type":"v1","addr":"172.21.15.39:6827","nonce":2063945159}]},"public_addr":"172.21.15.39:6819/2063945159","cluster_addr":"172.21.15.39:6823/2063945159","heartbeat_back_addr":"172.21.15.39:6831/2063945159","heartbeat_front_addr":"172.21.15.39:6827/2063945159","state":["exists","up"]},{"osd":3,"uuid":"b99b627c-64b0-4e1f-be52-e93eccd0d394","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6818","nonce":2544189874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6822","nonce":2544189874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6830","nonce":2544189874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2544189874},{"type":"v1","addr":"172.21.15.39:6826","nonce":2544189874}]},"public_addr":"172.21.15.39:6818/2544189874","cluster_addr":"172.21.15.39:6822/2544189874","heartbeat_back_addr":"172.21.15.39:6830/2544189874","heartbeat_front_addr":"172.21.15.39:6826/2544189874","state":["exists","up"]},{"osd":4,"uuid":"63566f33-5a5d-48b5-b184-8d3d9a3bcd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6801","nonce":299609171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6803","nonce":299609171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6807","nonce":299609171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":299609171},{"type":"v1","addr":"172.21.15.71:6805","nonce":299609171}]},"public_addr":"172.21.15.71:6801/299609171","cluster_addr":"172.21.15.71:6803/299609171","heartbeat_back_addr":"172.21.15.71:6807/299609171","heartbeat_front_addr":"172.21.15.71:6805/299609171","state":["exists","up"]},{"osd":5,"uuid":"dbe149e3-9a5c-4e70-b241-5d71142ab381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6817","nonce":821690898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6819","nonce":821690898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6823","nonce":821690898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":821690898},{"type":"v1","addr":"172.21.15.71:6821","nonce":821690898}]},"public_addr":"172.21.15.71:6817/821690898","cluster_addr":"172.21.15.71:6819/821690898","heartbeat_back_addr":"172.21.15.71:6823/821690898","heartbeat_front_addr":"172.21.15.71:6821/821690898","state":["exists","up"]},{"osd":6,"uuid":"8fa758eb-40db-4bff-9ff9-ba4c19112208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6825","nonce":3577500951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6827","nonce":3577500951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6831","nonce":3577500951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3577500951},{"type":"v1","addr":"172.21.15.71:6829","nonce":3577500951}]},"public_addr":"172.21.15.71:6825/3577500951","cluster_addr":"172.21.15.71:6827/3577500951","heartbeat_back_addr":"172.21.15.71:6831/3577500951","heartbeat_front_addr":"172.21.15.71:6829/3577500951","state":["exists","up"]},{"osd":7,"uuid":"184cc56f-ebf8-4c18-bbac-b550582b5720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6809","nonce":2492781367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6811","nonce":2492781367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6815","nonce":2492781367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2492781367},{"type":"v1","addr":"172.21.15.71:6813","nonce":2492781367}]},"public_addr":"172.21.15.71:6809/2492781367","cluster_addr":"172.21.15.71:6811/2492781367","heartbeat_back_addr":"172.21.15.71:6815/2492781367","heartbeat_front_addr":"172.21.15.71:6813/2492781367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.104012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.941455+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.112415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.059934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.816855+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.022326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:57.048314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:25:56.960947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6835/1889655166":"2024-04-27T23:36:03.833883+0000","172.21.15.39:6833/1889655166":"2024-04-27T23:36:03.833883+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:36:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 msgr2=0x7f9c7c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 0x7f9c7c06a960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005890 tx=0x7f9c90009040 comp rx=0 tx=0).stop 2024-04-26T23:36:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 msgr2=0x7f9c9c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e980 tx=0x7f9c8800ee40 comp rx=0 tx=0).stop 2024-04-26T23:36:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 shutdown_connections 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9c7c0684a0 0x7f9c7c06a960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c9c15f5d0 0x7f9c9c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c9c15f1f0 0x7f9c9c0cdba0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 --2- 172.21.15.39:0/549177008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9c9c0ae850 0x7f9c9c162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 >> 172.21.15.39:0/549177008 conn(0x7f9c9c0729d0 msgr2=0x7f9c9c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 shutdown_connections 2024-04-26T23:36:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:10.716+0000 7f9ca3800640 1 -- 172.21.15.39:0/549177008 wait complete. 2024-04-26T23:36:11.741 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T23:36:11.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:11.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.892+0000 7f0af4000640 1 Processor -- start 2024-04-26T23:36:11.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.892+0000 7f0af4000640 1 -- start start 2024-04-26T23:36:11.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af4000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0aec1468a0 0x7f0aec074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af4000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aec0b4280 con 0x7f0aec0b3df0 2024-04-26T23:36:11.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af4000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aec06f020 con 0x7f0aec1613d0 2024-04-26T23:36:11.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af4000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0aec06edd0 con 0x7f0aec1468a0 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af1600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0aec1468a0 0x7f0aec074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af0c00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0aec0b3df0 0x7f0aec160cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53708/0 (socket says 172.21.15.39:53708) 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af0c00640 1 -- 172.21.15.39:0/3036145669 learned_addr learned my addr 172.21.15.39:0/3036145669 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af1600640 1 -- 172.21.15.39:0/3036145669 >> v1:172.21.15.71:6789/0 conn(0x7f0aec1613d0 legacy=0x7f0aec072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af1600640 1 -- 172.21.15.39:0/3036145669 >> v1:172.21.15.39:6789/0 conn(0x7f0aec0b3df0 legacy=0x7f0aec160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0af1600640 1 -- 172.21.15.39:0/3036145669 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec06f300 con 0x7f0aec1468a0 2024-04-26T23:36:11.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.896+0000 7f0aebe00640 1 -- 172.21.15.39:0/3036145669 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605361207 0 0) 0x7f0aec0b4280 con 0x7f0aec0b3df0 2024-04-26T23:36:11.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af1600640 1 --2- 172.21.15.39:0/3036145669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec1468a0 0x7f0aec074180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0aec06ef50 tx=0x7f0ae001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de24412443d3f667 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:11.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0aebe00640 1 -- 172.21.15.39:0/3036145669 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00b0070 con 0x7f0aec1468a0 2024-04-26T23:36:11.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0aebe00640 1 -- 172.21.15.39:0/3036145669 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae00ab600 con 0x7f0aec1468a0 2024-04-26T23:36:11.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0aebe00640 1 -- 172.21.15.39:0/3036145669 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00ab9d0 con 0x7f0aec1468a0 2024-04-26T23:36:11.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- 172.21.15.39:0/3036145669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec1468a0 msgr2=0x7f0aec074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 --2- 172.21.15.39:0/3036145669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec1468a0 0x7f0aec074180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0aec06ef50 tx=0x7f0ae001c360 comp rx=0 tx=0).stop 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- 172.21.15.39:0/3036145669 shutdown_connections 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 --2- 172.21.15.39:0/3036145669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec1468a0 0x7f0aec074180 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- 172.21.15.39:0/3036145669 >> 172.21.15.39:0/3036145669 conn(0x7f0aec0b2cc0 msgr2=0x7f0aec0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- 172.21.15.39:0/3036145669 shutdown_connections 2024-04-26T23:36:11.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- 172.21.15.39:0/3036145669 wait complete. 2024-04-26T23:36:11.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 Processor -- start 2024-04-26T23:36:11.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- start start 2024-04-26T23:36:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0aec1468a0 0x7f0aec14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aec1613d0 0x7f0aec15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 0x7f0aec15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec073750 con 0x7f0aec13c9b0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec0735d0 con 0x7f0aec1613d0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.900+0000 7f0af4000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec16b880 con 0x7f0aec1468a0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 0x7f0aec15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 0x7f0aec15a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33368/0 (socket says 172.21.15.39:33368) 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 -- 172.21.15.39:0/882523726 learned_addr learned my addr 172.21.15.39:0/882523726 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af1600640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0aec1468a0 0x7f0aec14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af0c00640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aec1613d0 0x7f0aec15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 -- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0aec1468a0 msgr2=0x7f0aec14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0aec1468a0 0x7f0aec14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 -- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aec1613d0 msgr2=0x7f0aec15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aec1613d0 0x7f0aec15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec159650 con 0x7f0aec13c9b0 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af0c00640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aec1613d0 0x7f0aec15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af2000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 0x7f0aec15a950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c770 tx=0x7f0ae400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4003b80 con 0x7f0aec13c9b0 2024-04-26T23:36:11.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae4003d20 con 0x7f0aec13c9b0 2024-04-26T23:36:11.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400aa90 con 0x7f0aec13c9b0 2024-04-26T23:36:11.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec159930 con 0x7f0aec13c9b0 2024-04-26T23:36:11.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1504f0 con 0x7f0aec13c9b0 2024-04-26T23:36:11.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0aec159400 con 0x7f0aec13c9b0 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.904+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f0ae400ac30 con 0x7f0aec13c9b0 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0acc0684d0 0x7f0acc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f0ae4086670 con 0x7f0aec13c9b0 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f0acc06e390 0x7f0acc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ae400ee50 con 0x7f0acc06e390 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f0ae408d050 con 0x7f0aec13c9b0 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0af1600640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0acc0684d0 0x7f0acc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0af0c00640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f0acc06e390 0x7f0acc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:11.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0af0c00640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f0acc06e390 0x7f0acc0707b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:11.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0af1600640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0acc0684d0 0x7f0acc06a990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00ad000 tx=0x7f0ae00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:11.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.908+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== osd.0 v2:172.21.15.39:6800/3002752600 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ae400ee50 con 0x7f0acc06e390 2024-04-26T23:36:11.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.920+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 --> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0aec050740 con 0x7f0acc06e390 2024-04-26T23:36:11.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.920+0000 7f0ae9600640 1 -- 172.21.15.39:0/882523726 <== osd.0 v2:172.21.15.39:6800/3002752600 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0aec050740 con 0x7f0acc06e390 2024-04-26T23:36:11.926 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:11.926 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:11.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.920+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f0acc06e390 msgr2=0x7f0acc0707b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.920+0000 7f0af4000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:6800/3002752600,v1:172.21.15.39:6801/3002752600] conn(0x7f0acc06e390 0x7f0acc0707b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:11.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0acc0684d0 msgr2=0x7f0acc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0acc0684d0 0x7f0acc06a990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00ad000 tx=0x7f0ae00a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 msgr2=0x7f0aec15a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 --2- 172.21.15.39:0/882523726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0aec13c9b0 0x7f0aec15a950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c770 tx=0x7f0ae400cc30 comp rx=0 tx=0).stop 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af2000640 1 -- 172.21.15.39:0/882523726 reap_dead start 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 shutdown_connections 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 >> 172.21.15.39:0/882523726 conn(0x7f0aec0b2cc0 msgr2=0x7f0aec0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 shutdown_connections 2024-04-26T23:36:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:11.924+0000 7f0af4000640 1 -- 172.21.15.39:0/882523726 wait complete. 2024-04-26T23:36:11.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T23:36:12.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 Processor -- start 2024-04-26T23:36:12.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 -- start start 2024-04-26T23:36:12.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c781458d0 0x7f0c780b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c78073400 0x7f0c78072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0c78072180 con 0x7f0c781458d0 2024-04-26T23:36:12.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0c780739a0 con 0x7f0c78073400 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0c78073c80 con 0x7f0c78072e50 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c781458d0 0x7f0c780b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0c781458d0 0x7f0c780b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33370/0 (socket says 172.21.15.39:33370) 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 -- 172.21.15.39:0/3013278862 learned_addr learned my addr 172.21.15.39:0/3013278862 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c6f400640 1 --2- 172.21.15.39:0/3013278862 >> v2:172.21.15.71:3300/0 conn(0x7f0c78073400 0x7f0c78072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c7cc00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 -- 172.21.15.39:0/3013278862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 msgr2=0x7f0c780ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:12.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 -- 172.21.15.39:0/3013278862 >> v2:172.21.15.71:3300/0 conn(0x7f0c78073400 msgr2=0x7f0c78072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:12.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3013278862 >> v2:172.21.15.71:3300/0 conn(0x7f0c78073400 0x7f0c78072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.084+0000 7f0c77e00640 1 -- 172.21.15.39:0/3013278862 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c78145cb0 con 0x7f0c781458d0 2024-04-26T23:36:12.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c781458d0 0x7f0c780b4890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c78070370 tx=0x7f0c6801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2a287834e6d4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c77400640 1 -- 172.21.15.39:0/3013278862 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a56f0 con 0x7f0c781458d0 2024-04-26T23:36:12.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c77400640 1 -- 172.21.15.39:0/3013278862 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c680a5890 con 0x7f0c781458d0 2024-04-26T23:36:12.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c77400640 1 -- 172.21.15.39:0/3013278862 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a5c60 con 0x7f0c781458d0 2024-04-26T23:36:12.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3013278862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c781458d0 msgr2=0x7f0c780b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c781458d0 0x7f0c780b4890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c78070370 tx=0x7f0c6801c960 comp rx=0 tx=0).stop 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3013278862 shutdown_connections 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3013278862 >> v2:172.21.15.71:3300/0 conn(0x7f0c78073400 0x7f0c78072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3013278862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c781458d0 0x7f0c780b4890 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3013278862 >> 172.21.15.39:0/3013278862 conn(0x7f0c7806c7d0 msgr2=0x7f0c7806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3013278862 shutdown_connections 2024-04-26T23:36:12.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3013278862 wait complete. 2024-04-26T23:36:12.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.088+0000 7f0c7ec00640 1 Processor -- start 2024-04-26T23:36:12.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- start start 2024-04-26T23:36:12.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c781458d0 0x7f0c78160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7815fe10 con 0x7f0c78073400 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78073260 con 0x7f0c781458d0 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7815ff90 con 0x7f0c78072e50 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33374/0 (socket says 172.21.15.39:33374) 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 -- 172.21.15.39:0/3879469060 learned_addr learned my addr 172.21.15.39:0/3879469060 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7cc00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c781458d0 0x7f0c78160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 -- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 msgr2=0x7f0c780af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 -- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c781458d0 msgr2=0x7f0c78160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c781458d0 0x7f0c78160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 -- 172.21.15.39:0/3879469060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c780b2910 con 0x7f0c78073400 2024-04-26T23:36:12.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c6f400640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000e960 tx=0x7f0c6000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60017070 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6000ca00 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c78164210 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000cdb0 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c78141ff0 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.092+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7806a720 con 0x7f0c78073400 2024-04-26T23:36:12.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.096+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f0c6001a070 con 0x7f0c78073400 2024-04-26T23:36:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.096+0000 7f0c74c00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 0x7f0c5406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.096+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f0c60086790 con 0x7f0c78073400 2024-04-26T23:36:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.096+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 0x7f0c5406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.096+0000 7f0c77e00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 0x7f0c5406a960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0c680ae000 tx=0x7f0c680a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.100+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c600568e0 con 0x7f0c78073400 2024-04-26T23:36:12.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.264+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0c780cfb50 con 0x7f0c540684a0 2024-04-26T23:36:12.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c74c00640 1 -- 172.21.15.39:0/3879469060 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0c780cfb50 con 0x7f0c540684a0 2024-04-26T23:36:12.270 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T23:36:12.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 msgr2=0x7f0c5406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 0x7f0c5406a960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0c680ae000 tx=0x7f0c680a7070 comp rx=0 tx=0).stop 2024-04-26T23:36:12.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 msgr2=0x7f0c781427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000e960 tx=0x7f0c6000ee20 comp rx=0 tx=0).stop 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 shutdown_connections 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f0c540684a0 0x7f0c5406a960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c781458d0 0x7f0c78160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c78073400 0x7f0c781427f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 --2- 172.21.15.39:0/3879469060 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0c78072e50 0x7f0c780af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 >> 172.21.15.39:0/3879469060 conn(0x7f0c7806c7d0 msgr2=0x7f0c780cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 shutdown_connections 2024-04-26T23:36:12.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.268+0000 7f0c7ec00640 1 -- 172.21.15.39:0/3879469060 wait complete. 2024-04-26T23:36:12.292 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T23:36:12.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:12.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.432+0000 7f07d8800640 1 Processor -- start 2024-04-26T23:36:12.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.432+0000 7f07d8800640 1 -- start start 2024-04-26T23:36:12.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d8800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07d0148be0 0x7f07d00c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d8800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d006df90 con 0x7f07d00b5290 2024-04-26T23:36:12.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d8800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d006e270 con 0x7f07d00c9c90 2024-04-26T23:36:12.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d8800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f07d00d0ce0 con 0x7f07d0148be0 2024-04-26T23:36:12.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d6800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f07d00b5290 0x7f07d00d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53720/0 (socket says 172.21.15.39:53720) 2024-04-26T23:36:12.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d6800640 1 -- 172.21.15.39:0/4239430824 learned_addr learned my addr 172.21.15.39:0/4239430824 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:12.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d5e00640 1 --2- 172.21.15.39:0/4239430824 >> v2:172.21.15.71:3300/0 conn(0x7f07d0148be0 0x7f07d00c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551634509 0 0) 0x7f07d006df90 con 0x7f07d00b5290 2024-04-26T23:36:12.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b8003530 con 0x7f07d00b5290 2024-04-26T23:36:12.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716438732 0 0) 0x7f07d006e270 con 0x7f07d00c9c90 2024-04-26T23:36:12.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07d006df90 con 0x7f07d00c9c90 2024-04-26T23:36:12.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4151573002 0 0) 0x7f07b8003530 con 0x7f07d00b5290 2024-04-26T23:36:12.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d5e00640 1 -- 172.21.15.39:0/4239430824 >> v1:172.21.15.71:6789/0 conn(0x7f07d00c9c90 legacy=0x7f07d00b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d5e00640 1 -- 172.21.15.39:0/4239430824 >> v1:172.21.15.39:6789/0 conn(0x7f07d00b5290 legacy=0x7f07d00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.436+0000 7f07d5e00640 1 -- 172.21.15.39:0/4239430824 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d006e550 con 0x7f07d0148be0 2024-04-26T23:36:12.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d5e00640 1 --2- 172.21.15.39:0/4239430824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d0148be0 0x7f07d00c7e60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07c40097c0 tx=0x7f07c401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da33d4a798e2d45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c40b0070 con 0x7f07d0148be0 2024-04-26T23:36:12.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c40ab400 con 0x7f07d0148be0 2024-04-26T23:36:12.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d4a00640 1 -- 172.21.15.39:0/4239430824 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc001a00 con 0x7f07d0148be0 2024-04-26T23:36:12.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- 172.21.15.39:0/4239430824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d0148be0 msgr2=0x7f07d00c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 --2- 172.21.15.39:0/4239430824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d0148be0 0x7f07d00c7e60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07c40097c0 tx=0x7f07c401c330 comp rx=0 tx=0).stop 2024-04-26T23:36:12.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- 172.21.15.39:0/4239430824 shutdown_connections 2024-04-26T23:36:12.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 --2- 172.21.15.39:0/4239430824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d0148be0 0x7f07d00c7e60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- 172.21.15.39:0/4239430824 >> 172.21.15.39:0/4239430824 conn(0x7f07d006c9d0 msgr2=0x7f07d0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- 172.21.15.39:0/4239430824 shutdown_connections 2024-04-26T23:36:12.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- 172.21.15.39:0/4239430824 wait complete. 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 Processor -- start 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- start start 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07d00b5290 0x7f07d00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d00c9c90 0x7f07d015f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 0x7f07d0145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f07d016d2a0 con 0x7f07d0148be0 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07d00d2360 con 0x7f07d00c9c90 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.440+0000 7f07d8800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f07d016d420 con 0x7f07d00b5290 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 0x7f07d0145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 0x7f07d0145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33382/0 (socket says 172.21.15.39:33382) 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 -- 172.21.15.39:0/1341772134 learned_addr learned my addr 172.21.15.39:0/1341772134 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d5e00640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07d00b5290 0x7f07d00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d5400640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d00c9c90 0x7f07d015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 -- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07d00b5290 msgr2=0x7f07d00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f07d00b5290 0x7f07d00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 -- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d00c9c90 msgr2=0x7f07d015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07d00c9c90 0x7f07d015f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d0144b60 con 0x7f07d0148be0 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d6800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 0x7f07d0145c00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00cc90 tx=0x7f07cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc012400 con 0x7f07d0148be0 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc0125a0 con 0x7f07d0148be0 2024-04-26T23:36:12.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0129d0 con 0x7f07d0148be0 2024-04-26T23:36:12.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d0144e40 con 0x7f07d0148be0 2024-04-26T23:36:12.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d01456e0 con 0x7f07d0148be0 2024-04-26T23:36:12.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07d0050740 con 0x7f07d0148be0 2024-04-26T23:36:12.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.444+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f07cc012b70 con 0x7f07d0148be0 2024-04-26T23:36:12.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f07b40684a0 0x7f07b406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f07cc086fb0 con 0x7f07d0148be0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7f07b406e360 0x7f07b4070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07cc01fec0 con 0x7f07b406e360 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f07cc0895d0 con 0x7f07d0148be0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07d5e00640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f07b40684a0 0x7f07b406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07d5400640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7f07b406e360 0x7f07b4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07d5e00640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f07b40684a0 0x7f07b406a960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f07c40ad000 tx=0x7f07c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07d5400640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7f07b406e360 0x7f07b4070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.448+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== osd.1 v2:172.21.15.39:6808/4093290330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07cc01fec0 con 0x7f07b406e360 2024-04-26T23:36:12.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 --> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07d0070f90 con 0x7f07b406e360 2024-04-26T23:36:12.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07ca000640 1 -- 172.21.15.39:0/1341772134 <== osd.1 v2:172.21.15.39:6808/4093290330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07d0070f90 con 0x7f07b406e360 2024-04-26T23:36:12.465 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:12.466 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:12.466 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:12.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7f07b406e360 msgr2=0x7f07b4070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:6808/4093290330,v1:172.21.15.39:6809/4093290330] conn(0x7f07b406e360 0x7f07b4070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f07b40684a0 msgr2=0x7f07b406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f07b40684a0 0x7f07b406a960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f07c40ad000 tx=0x7f07c40a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 msgr2=0x7f07d0145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d8800640 1 --2- 172.21.15.39:0/1341772134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07d0148be0 0x7f07d0145c00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00cc90 tx=0x7f07cc00a430 comp rx=0 tx=0).stop 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.460+0000 7f07d6800640 1 -- 172.21.15.39:0/1341772134 reap_dead start 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.464+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 shutdown_connections 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.464+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 >> 172.21.15.39:0/1341772134 conn(0x7f07d006c9d0 msgr2=0x7f07d00b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.464+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 shutdown_connections 2024-04-26T23:36:12.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.464+0000 7f07d8800640 1 -- 172.21.15.39:0/1341772134 wait complete. 2024-04-26T23:36:12.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T23:36:12.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 Processor -- start 2024-04-26T23:36:12.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 -- start start 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb801488f0 0x7fbb800cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbb800cf770 0x7fbb8006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb801492a0 con 0x7fbb8006d2f0 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800cfbd0 con 0x7fbb800cf770 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb87600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8006d720 con 0x7fbb801488f0 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbb800cf770 0x7fbb8006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb85600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb8006d2f0 0x7fbb80163270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53726/0 (socket says 172.21.15.39:53726) 2024-04-26T23:36:12.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb85600640 1 -- 172.21.15.39:0/2066867132 learned_addr learned my addr 172.21.15.39:0/2066867132 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb84c00640 1 --2- 172.21.15.39:0/2066867132 >> v2:172.21.15.71:3300/0 conn(0x7fbb801488f0 0x7fbb800cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7fe00640 1 -- 172.21.15.39:0/2066867132 >> v2:172.21.15.71:3300/0 conn(0x7fbb801488f0 msgr2=0x7fbb800cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7fe00640 1 --2- 172.21.15.39:0/2066867132 >> v2:172.21.15.71:3300/0 conn(0x7fbb801488f0 0x7fbb800cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7fe00640 1 -- 172.21.15.39:0/2066867132 >> v1:172.21.15.39:6789/0 conn(0x7fbb8006d2f0 legacy=0x7fbb80163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7fe00640 1 -- 172.21.15.39:0/2066867132 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800705a0 con 0x7fbb800cf770 2024-04-26T23:36:12.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.624+0000 7fbb7f400640 1 -- 172.21.15.39:0/2066867132 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824610196 0 0) 0x7fbb801492a0 con 0x7fbb8006d2f0 2024-04-26T23:36:12.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb7fe00640 1 --2- 172.21.15.39:0/2066867132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb8006cdb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb80070770 tx=0x7fbb6c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5661ca3802c07b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb7f400640 1 -- 172.21.15.39:0/2066867132 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0b2070 con 0x7fbb800cf770 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb7f400640 1 -- 172.21.15.39:0/2066867132 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6c0ad680 con 0x7fbb800cf770 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb7f400640 1 -- 172.21.15.39:0/2066867132 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0ada50 con 0x7fbb800cf770 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 -- 172.21.15.39:0/2066867132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 msgr2=0x7fbb8006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 --2- 172.21.15.39:0/2066867132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb8006cdb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb80070770 tx=0x7fbb6c01c460 comp rx=0 tx=0).stop 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 -- 172.21.15.39:0/2066867132 shutdown_connections 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 --2- 172.21.15.39:0/2066867132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb8006cdb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 --2- 172.21.15.39:0/2066867132 >> v2:172.21.15.71:3300/0 conn(0x7fbb801488f0 0x7fbb800cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 -- 172.21.15.39:0/2066867132 >> 172.21.15.39:0/2066867132 conn(0x7fbb800ce0e0 msgr2=0x7fbb800ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 -- 172.21.15.39:0/2066867132 shutdown_connections 2024-04-26T23:36:12.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.628+0000 7fbb87600640 1 -- 172.21.15.39:0/2066867132 wait complete. 2024-04-26T23:36:12.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 Processor -- start 2024-04-26T23:36:12.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- start start 2024-04-26T23:36:12.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb8006d2f0 0x7fbb80157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb801488f0 0x7fbb80158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8006ed90 con 0x7fbb800cf770 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8006eab0 con 0x7fbb801488f0 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8006f070 con 0x7fbb8006d2f0 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33400/0 (socket says 172.21.15.39:33400) 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 -- 172.21.15.39:0/3646370600 learned_addr learned my addr 172.21.15.39:0/3646370600 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb84c00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb8006d2f0 0x7fbb80157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb85600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb801488f0 0x7fbb80158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 -- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb8006d2f0 msgr2=0x7fbb80157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb8006d2f0 0x7fbb80157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 -- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb801488f0 msgr2=0x7fbb80158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb801488f0 0x7fbb80158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 -- 172.21.15.39:0/3646370600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80149290 con 0x7fbb800cf770 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7fe00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c019070 tx=0x7fbb6c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0b2040 con 0x7fbb800cf770 2024-04-26T23:36:12.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6c0bd070 con 0x7fbb800cf770 2024-04-26T23:36:12.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0ade60 con 0x7fbb800cf770 2024-04-26T23:36:12.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb80157e60 con 0x7fbb800cf770 2024-04-26T23:36:12.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb80158420 con 0x7fbb800cf770 2024-04-26T23:36:12.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.632+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8006a720 con 0x7fbb800cf770 2024-04-26T23:36:12.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.636+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fbb6c0b8650 con 0x7fbb800cf770 2024-04-26T23:36:12.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.636+0000 7fbb7cc00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 0x7fbb6006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.636+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7fbb6c120e80 con 0x7fbb800cf770 2024-04-26T23:36:12.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.636+0000 7fbb84c00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 0x7fbb6006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.636+0000 7fbb84c00640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 0x7fbb6006a960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009af0 tx=0x7fbb74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.640+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbb6c016050 con 0x7fbb800cf770 2024-04-26T23:36:12.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbb800b0f70 con 0x7fbb600684a0 2024-04-26T23:36:12.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb7cc00640 1 -- 172.21.15.39:0/3646370600 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbb800b0f70 con 0x7fbb600684a0 2024-04-26T23:36:12.808 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T23:36:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 msgr2=0x7fbb6006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 0x7fbb6006a960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009af0 tx=0x7fbb74008040 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 msgr2=0x7fbb80148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c019070 tx=0x7fbb6c01aca0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 shutdown_connections 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fbb600684a0 0x7fbb6006a960 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb801488f0 0x7fbb80158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb800cf770 0x7fbb80148230 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 --2- 172.21.15.39:0/3646370600 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb8006d2f0 0x7fbb80157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.804+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 >> 172.21.15.39:0/3646370600 conn(0x7fbb800ce0e0 msgr2=0x7fbb8015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.808+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 shutdown_connections 2024-04-26T23:36:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.808+0000 7fbb87600640 1 -- 172.21.15.39:0/3646370600 wait complete. 2024-04-26T23:36:12.829 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T23:36:12.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:12.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 Processor -- start 2024-04-26T23:36:12.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 -- start start 2024-04-26T23:36:12.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8e5815b510 0x7f8e580d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e580b68c0 0x7f8e580728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e5815f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580d0380 con 0x7f8e580b68c0 2024-04-26T23:36:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580cfb70 con 0x7f8e5815b510 2024-04-26T23:36:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e60200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5806e560 con 0x7f8e58072e10 2024-04-26T23:36:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e580b68c0 0x7f8e580728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e580b68c0 0x7f8e580728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33402/0 (socket says 172.21.15.39:33402) 2024-04-26T23:36:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 -- 172.21.15.39:0/1818995208 learned_addr learned my addr 172.21.15.39:0/1818995208 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5d800640 1 --2- 172.21.15.39:0/1818995208 >> v2:172.21.15.71:3300/0 conn(0x7f8e5815b510 0x7f8e580d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5e200640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e5815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 -- 172.21.15.39:0/1818995208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 msgr2=0x7f8e5815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e5815f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 -- 172.21.15.39:0/1818995208 >> v2:172.21.15.71:3300/0 conn(0x7f8e5815b510 msgr2=0x7f8e580d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1818995208 >> v2:172.21.15.71:3300/0 conn(0x7f8e5815b510 0x7f8e580d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.972+0000 7f8e5ce00640 1 -- 172.21.15.39:0/1818995208 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580d0a60 con 0x7f8e580b68c0 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e580b68c0 0x7f8e580728d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e5806ffe0 tx=0x7f8e4401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fd689b87ca34d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e57e00640 1 -- 172.21.15.39:0/1818995208 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e440b0070 con 0x7f8e580b68c0 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e57e00640 1 -- 172.21.15.39:0/1818995208 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e440ab600 con 0x7f8e580b68c0 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e57e00640 1 -- 172.21.15.39:0/1818995208 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e440ab9d0 con 0x7f8e580b68c0 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 -- 172.21.15.39:0/1818995208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e580b68c0 msgr2=0x7f8e580728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e580b68c0 0x7f8e580728d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e5806ffe0 tx=0x7f8e4401c1d0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 -- 172.21.15.39:0/1818995208 shutdown_connections 2024-04-26T23:36:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e5815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 --2- 172.21.15.39:0/1818995208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e580b68c0 0x7f8e580728d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 --2- 172.21.15.39:0/1818995208 >> v2:172.21.15.71:3300/0 conn(0x7f8e5815b510 0x7f8e580d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 -- 172.21.15.39:0/1818995208 >> 172.21.15.39:0/1818995208 conn(0x7f8e580b2cc0 msgr2=0x7f8e580b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:12.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 -- 172.21.15.39:0/1818995208 shutdown_connections 2024-04-26T23:36:12.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 -- 172.21.15.39:0/1818995208 wait complete. 2024-04-26T23:36:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.976+0000 7f8e60200640 1 Processor -- start 2024-04-26T23:36:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- start start 2024-04-26T23:36:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e58161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e580b68c0 0x7f8e58160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 0x7f8e58162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5806ebc0 con 0x7f8e5815b510 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5806ea40 con 0x7f8e580b68c0 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5806ed40 con 0x7f8e58072e10 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 0x7f8e58162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 0x7f8e58162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33410/0 (socket says 172.21.15.39:33410) 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 -- 172.21.15.39:0/1456916364 learned_addr learned my addr 172.21.15.39:0/1456916364 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e580b68c0 0x7f8e58160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5d800640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e58161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 -- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 msgr2=0x7f8e58161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8e58072e10 0x7f8e58161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 -- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e580b68c0 msgr2=0x7f8e58160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e580b68c0 0x7f8e58160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58160c80 con 0x7f8e5815b510 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e5e200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 0x7f8e58162d30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000cd70 tx=0x7f8e5000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50003ba0 con 0x7f8e5815b510 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50003d40 con 0x7f8e5815b510 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50004240 con 0x7f8e5815b510 2024-04-26T23:36:12.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e58160f60 con 0x7f8e5815b510 2024-04-26T23:36:12.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e58161520 con 0x7f8e5815b510 2024-04-26T23:36:12.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.980+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e58050740 con 0x7f8e5815b510 2024-04-26T23:36:12.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f8e500043e0 con 0x7f8e5815b510 2024-04-26T23:36:12.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e380684a0 0x7f8e3806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f8e50087940 con 0x7f8e5815b510 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f8e3806e360 0x7f8e38070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e50022ec0 con 0x7f8e3806e360 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f8e50087cf0 con 0x7f8e5815b510 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e5d800640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e380684a0 0x7f8e3806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f8e3806e360 0x7f8e38070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e5ce00640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f8e3806e360 0x7f8e38070780 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e5d800640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e380684a0 0x7f8e3806a960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007940 tx=0x7f8e4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:12.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:12.984+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== osd.2 v2:172.21.15.39:6817/2063945159 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e50022ec0 con 0x7f8e3806e360 2024-04-26T23:36:13.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 --> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8e580b30a0 con 0x7f8e3806e360 2024-04-26T23:36:13.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e55600640 1 -- 172.21.15.39:0/1456916364 <== osd.2 v2:172.21.15.39:6817/2063945159 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8e580b30a0 con 0x7f8e3806e360 2024-04-26T23:36:13.003 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:13.003 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:13.004 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f8e3806e360 msgr2=0x7f8e38070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:6817/2063945159,v1:172.21.15.39:6819/2063945159] conn(0x7f8e3806e360 0x7f8e38070780 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e380684a0 msgr2=0x7f8e3806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f8e380684a0 0x7f8e3806a960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007940 tx=0x7f8e4c008040 comp rx=0 tx=0).stop 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 msgr2=0x7f8e58162d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 --2- 172.21.15.39:0/1456916364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5815b510 0x7f8e58162d30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000cd70 tx=0x7f8e5000a660 comp rx=0 tx=0).stop 2024-04-26T23:36:13.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e5e200640 1 -- 172.21.15.39:0/1456916364 reap_dead start 2024-04-26T23:36:13.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 shutdown_connections 2024-04-26T23:36:13.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 >> 172.21.15.39:0/1456916364 conn(0x7f8e580b2cc0 msgr2=0x7f8e58073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 shutdown_connections 2024-04-26T23:36:13.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.000+0000 7f8e60200640 1 -- 172.21.15.39:0/1456916364 wait complete. 2024-04-26T23:36:13.022 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T23:36:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 Processor -- start 2024-04-26T23:36:13.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 -- start start 2024-04-26T23:36:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b74140170 0x7f9b7415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b740cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7406e500 con 0x7f9b7415e340 2024-04-26T23:36:13.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7406f110 con 0x7f9b74140170 2024-04-26T23:36:13.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b7a800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7406e7e0 con 0x7f9b740d18f0 2024-04-26T23:36:13.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b6aa00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9b7415e340 0x7f9b740d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53738/0 (socket says 172.21.15.39:53738) 2024-04-26T23:36:13.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.160+0000 7f9b6aa00640 1 -- 172.21.15.39:0/2642645540 learned_addr learned my addr 172.21.15.39:0/2642645540 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:13.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b73400640 1 --2- 172.21.15.39:0/2642645540 >> v2:172.21.15.71:3300/0 conn(0x7f9b74140170 0x7f9b7415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b73e00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b740cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928535593 0 0) 0x7f9b7406e500 con 0x7f9b7415e340 2024-04-26T23:36:13.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b58003530 con 0x7f9b7415e340 2024-04-26T23:36:13.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 625988578 0 0) 0x7f9b58003530 con 0x7f9b7415e340 2024-04-26T23:36:13.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 msgr2=0x7f9b740cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b740cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 >> v2:172.21.15.71:3300/0 conn(0x7f9b74140170 msgr2=0x7f9b7415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 --2- 172.21.15.39:0/2642645540 >> v2:172.21.15.71:3300/0 conn(0x7f9b74140170 0x7f9b7415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7406eac0 con 0x7f9b7415e340 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7f9b5c001a00 con 0x7f9b7415e340 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b73400640 1 --2- 172.21.15.39:0/2642645540 >> v2:172.21.15.71:3300/0 conn(0x7f9b74140170 0x7f9b7415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 >> v1:172.21.15.39:6789/0 conn(0x7f9b7415e340 legacy=0x7f9b740d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b580039c0 0x7f9b58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7406f110 con 0x7f9b58004810 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7406e7e0 con 0x7f9b580039c0 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5800ba00 con 0x7f9b740d18f0 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b73400640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b580039c0 0x7f9b58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b73e00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 -- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 msgr2=0x7f9b580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b740d18f0 0x7f9b580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 -- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b580039c0 msgr2=0x7f9b58003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b580039c0 0x7f9b58003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.164+0000 7f9b6aa00640 1 -- 172.21.15.39:0/2642645540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58003530 con 0x7f9b58004810 2024-04-26T23:36:13.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b58004c90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a8a0 tx=0x7f9b5c01d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88489350888825e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00a4c0 con 0x7f9b58004810 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5c0ad650 con 0x7f9b58004810 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b72a00640 1 -- 172.21.15.39:0/2642645540 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0ada40 con 0x7f9b58004810 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- 172.21.15.39:0/2642645540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 msgr2=0x7f9b58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 --2- 172.21.15.39:0/2642645540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b58004c90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a8a0 tx=0x7f9b5c01d330 comp rx=0 tx=0).stop 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b73e00640 1 -- 172.21.15.39:0/2642645540 reap_dead start 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- 172.21.15.39:0/2642645540 shutdown_connections 2024-04-26T23:36:13.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- 172.21.15.39:0/2642645540 >> 172.21.15.39:0/2642645540 conn(0x7f9b7406c7d0 msgr2=0x7f9b7406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- 172.21.15.39:0/2642645540 shutdown_connections 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- 172.21.15.39:0/2642645540 wait complete. 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 Processor -- start 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 -- start start 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b74140a20 0x7f9b740b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.168+0000 7f9b7a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 0x7f9b741590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740d0290 con 0x7f9b58004810 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740d0110 con 0x7f9b740b1ef0 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b740d0410 con 0x7f9b74140a20 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33424/0 (socket says 172.21.15.39:33424) 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 -- 172.21.15.39:0/879889153 learned_addr learned my addr 172.21.15.39:0/879889153 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b74140a20 0x7f9b740b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73e00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 0x7f9b741590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 -- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b74140a20 msgr2=0x7f9b740b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b74140a20 0x7f9b740b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 -- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 msgr2=0x7f9b741590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 0x7f9b741590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 -- 172.21.15.39:0/879889153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b74150c50 con 0x7f9b58004810 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73e00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 0x7f9b741590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:13.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b73400640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9b64011cd0 tx=0x7f9b6400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400fd20 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b64004030 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64004420 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b74150f30 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b741514f0 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b740b2300 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f9b64012040 con 0x7f9b58004810 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 0x7f9b5006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.172+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f9b64086de0 con 0x7f9b58004810 2024-04-26T23:36:13.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.176+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 0x7f9b5006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.176+0000 7f9b6aa00640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 0x7f9b5006a960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0ad000 tx=0x7f9b5c001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.176+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b740b2300 con 0x7f9b58004810 2024-04-26T23:36:13.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.340+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9b74140800 con 0x7f9b500684a0 2024-04-26T23:36:13.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.340+0000 7f9b6be00640 1 -- 172.21.15.39:0/879889153 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9b74140800 con 0x7f9b500684a0 2024-04-26T23:36:13.345 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T23:36:13.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 msgr2=0x7f9b5006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 0x7f9b5006a960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0ad000 tx=0x7f9b5c001e40 comp rx=0 tx=0).stop 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 msgr2=0x7f9b74150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9b64011cd0 tx=0x7f9b6400f610 comp rx=0 tx=0).stop 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 shutdown_connections 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9b500684a0 0x7f9b5006a960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b740b1ef0 0x7f9b741590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b74140a20 0x7f9b740b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 --2- 172.21.15.39:0/879889153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b58004810 0x7f9b74150300 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 >> 172.21.15.39:0/879889153 conn(0x7f9b7406c7d0 msgr2=0x7f9b74158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 shutdown_connections 2024-04-26T23:36:13.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.344+0000 7f9b7a800640 1 -- 172.21.15.39:0/879889153 wait complete. 2024-04-26T23:36:13.367 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T23:36:13.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:13.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 Processor -- start 2024-04-26T23:36:13.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 -- start start 2024-04-26T23:36:13.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a80cf680 0x7f23a80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f23a80d29d0 0x7f23a8162de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80cffa0 con 0x7f23a806d6f0 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80cf2f0 con 0x7f23a80d29d0 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23ad400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f23a806def0 con 0x7f23a80cf680 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f239fe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f23a80d29d0 0x7f23a8162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23aca00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f23a806d6f0 0x7f23a8163320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53748/0 (socket says 172.21.15.39:53748) 2024-04-26T23:36:13.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23aca00640 1 -- 172.21.15.39:0/2029879629 learned_addr learned my addr 172.21.15.39:0/2029879629 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:13.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.508+0000 7f23a7e00640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a80cf680 0x7f23a80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f239fe00640 1 -- 172.21.15.39:0/2029879629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a80cf680 msgr2=0x7f23a80cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f239fe00640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a80cf680 0x7f23a80cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f239fe00640 1 -- 172.21.15.39:0/2029879629 >> v1:172.21.15.39:6789/0 conn(0x7f23a806d6f0 legacy=0x7f23a8163320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f239fe00640 1 -- 172.21.15.39:0/2029879629 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80d0710 con 0x7f23a80d29d0 2024-04-26T23:36:13.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23a7400640 1 -- 172.21.15.39:0/2029879629 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150574488 0 0) 0x7f23a80cffa0 con 0x7f23a806d6f0 2024-04-26T23:36:13.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f239fe00640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a8162de0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f239001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd7dd420aa11a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23a7400640 1 -- 172.21.15.39:0/2029879629 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900b0070 con 0x7f23a80d29d0 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23a7400640 1 -- 172.21.15.39:0/2029879629 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23900ab600 con 0x7f23a80d29d0 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23a7400640 1 -- 172.21.15.39:0/2029879629 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900ab9d0 con 0x7f23a80d29d0 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 -- 172.21.15.39:0/2029879629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 msgr2=0x7f23a8162de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a8162de0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f239001c410 comp rx=0 tx=0).stop 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 -- 172.21.15.39:0/2029879629 shutdown_connections 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a8162de0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 --2- 172.21.15.39:0/2029879629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a80cf680 0x7f23a80cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 -- 172.21.15.39:0/2029879629 >> 172.21.15.39:0/2029879629 conn(0x7f23a80d2e00 msgr2=0x7f23a80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 -- 172.21.15.39:0/2029879629 shutdown_connections 2024-04-26T23:36:13.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.512+0000 7f23ad400640 1 -- 172.21.15.39:0/2029879629 wait complete. 2024-04-26T23:36:13.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 Processor -- start 2024-04-26T23:36:13.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- start start 2024-04-26T23:36:13.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a806d6f0 0x7f23a80c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a80cf680 0x7f23a815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23a806e700 con 0x7f23a80d29d0 2024-04-26T23:36:13.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80d20d0 con 0x7f23a80cf680 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f23a80ce460 con 0x7f23a806d6f0 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33442/0 (socket says 172.21.15.39:33442) 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 -- 172.21.15.39:0/1189808118 learned_addr learned my addr 172.21.15.39:0/1189808118 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23a7e00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a806d6f0 0x7f23a80c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f239fe00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a80cf680 0x7f23a815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 -- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a806d6f0 msgr2=0x7f23a80c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a806d6f0 0x7f23a80c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 -- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a80cf680 msgr2=0x7f23a815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a80cf680 0x7f23a815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a815d500 con 0x7f23a80d29d0 2024-04-26T23:36:13.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23aca00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a815a6c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c730 tx=0x7f23a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0018070 con 0x7f23a80d29d0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a000ce40 con 0x7f23a80d29d0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a815d7e0 con 0x7f23a80d29d0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a000a860 con 0x7f23a80d29d0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.516+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a815ac00 con 0x7f23a80d29d0 2024-04-26T23:36:13.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23a80506d0 con 0x7f23a80d29d0 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f23a001b070 con 0x7f23a80d29d0 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f23840684a0 0x7f238406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f23a0085cc0 con 0x7f23a80d29d0 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7f238406e360 0x7f2384070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23a000de50 con 0x7f238406e360 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f23a008a2a0 con 0x7f23a80d29d0 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a7e00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f23840684a0 0x7f238406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f239fe00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7f238406e360 0x7f2384070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f23a7e00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f23840684a0 0x7f238406a960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f23a80c91d0 tx=0x7f2398009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.520+0000 7f239fe00640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7f238406e360 0x7f2384070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.524+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== osd.3 v2:172.21.15.39:6816/2544189874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23a000de50 con 0x7f238406e360 2024-04-26T23:36:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 --> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23a8068f30 con 0x7f238406e360 2024-04-26T23:36:13.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23a4c00640 1 -- 172.21.15.39:0/1189808118 <== osd.3 v2:172.21.15.39:6816/2544189874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23a8068f30 con 0x7f238406e360 2024-04-26T23:36:13.540 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:13.540 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:13.540 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:13.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7f238406e360 msgr2=0x7f2384070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:6816/2544189874,v1:172.21.15.39:6818/2544189874] conn(0x7f238406e360 0x7f2384070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f23840684a0 msgr2=0x7f238406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f23840684a0 0x7f238406a960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f23a80c91d0 tx=0x7f2398009190 comp rx=0 tx=0).stop 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 msgr2=0x7f23a815a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 --2- 172.21.15.39:0/1189808118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23a80d29d0 0x7f23a815a6c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c730 tx=0x7f23a000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23aca00640 1 -- 172.21.15.39:0/1189808118 reap_dead start 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 shutdown_connections 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 >> 172.21.15.39:0/1189808118 conn(0x7f23a80d2e00 msgr2=0x7f23a80c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 shutdown_connections 2024-04-26T23:36:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.536+0000 7f23ad400640 1 -- 172.21.15.39:0/1189808118 wait complete. 2024-04-26T23:36:13.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T23:36:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 Processor -- start 2024-04-26T23:36:13.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 -- start start 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d55e0 0x7f85fc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85fc0d0300 0x7f85fc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85fc0d1140 con 0x7f85fc15f490 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f85fc0d0b80 con 0x7f85fc0d0300 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f8601400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85fc0d0e60 con 0x7f85fc0d55e0 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.696+0000 7f85fa800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f85fc15f490 0x7f85fc0d4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53756/0 (socket says 172.21.15.39:53756) 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fa800640 1 -- 172.21.15.39:0/1503365845 learned_addr learned my addr 172.21.15.39:0/1503365845 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:13.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 --2- 172.21.15.39:0/1503365845 >> v2:172.21.15.71:3300/0 conn(0x7f85fc0d0300 0x7f85fc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f3e00640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d55e0 0x7f85fc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f9e00640 1 -- 172.21.15.39:0/1503365845 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689935482 0 0) 0x7f85fc0d1140 con 0x7f85fc15f490 2024-04-26T23:36:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f9e00640 1 -- 172.21.15.39:0/1503365845 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85e0003530 con 0x7f85fc15f490 2024-04-26T23:36:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 -- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d55e0 msgr2=0x7f85fc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d55e0 0x7f85fc0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 -- 172.21.15.39:0/1503365845 >> v1:172.21.15.39:6789/0 conn(0x7f85fc15f490 legacy=0x7f85fc0d4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 -- 172.21.15.39:0/1503365845 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc0c8ea0 con 0x7f85fc0d0300 2024-04-26T23:36:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85fb200640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc0d0300 0x7f85fc0c96a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009d90 tx=0x7f85f401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dcdee6e7e89d7aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f9e00640 1 -- 172.21.15.39:0/1503365845 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40b2070 con 0x7f85fc0d0300 2024-04-26T23:36:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f9e00640 1 -- 172.21.15.39:0/1503365845 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f40a5990 con 0x7f85fc0d0300 2024-04-26T23:36:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.700+0000 7f85f9e00640 1 -- 172.21.15.39:0/1503365845 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40a5d60 con 0x7f85fc0d0300 2024-04-26T23:36:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc0d0300 msgr2=0x7f85fc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc0d0300 0x7f85fc0c96a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009d90 tx=0x7f85f401c8b0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- 172.21.15.39:0/1503365845 shutdown_connections 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc0d0300 0x7f85fc0c96a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- 172.21.15.39:0/1503365845 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d55e0 0x7f85fc0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- 172.21.15.39:0/1503365845 >> 172.21.15.39:0/1503365845 conn(0x7f85fc08ebf0 msgr2=0x7f85fc09e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- 172.21.15.39:0/1503365845 shutdown_connections 2024-04-26T23:36:13.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- 172.21.15.39:0/1503365845 wait complete. 2024-04-26T23:36:13.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 Processor -- start 2024-04-26T23:36:13.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- start start 2024-04-26T23:36:13.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d0300 0x7f85fc153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc15f490 0x7f85fc161f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc0ca3f0 con 0x7f85fc0d55e0 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc15fa80 con 0x7f85fc15f490 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f8601400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85fc0ca570 con 0x7f85fc0d0300 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33446/0 (socket says 172.21.15.39:33446) 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 -- 172.21.15.39:0/2431338382 learned_addr learned my addr 172.21.15.39:0/2431338382 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:13.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85fa800640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d0300 0x7f85fc153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85fb200640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc15f490 0x7f85fc161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 -- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d0300 msgr2=0x7f85fc153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d0300 0x7f85fc153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 -- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc15f490 msgr2=0x7f85fc161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc15f490 0x7f85fc161f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 -- 172.21.15.39:0/2431338382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc1544d0 con 0x7f85fc0d55e0 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.704+0000 7f85f3e00640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f85e400e930 tx=0x7f85e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4017070 con 0x7f85fc0d55e0 2024-04-26T23:36:13.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e400ca00 con 0x7f85fc0d55e0 2024-04-26T23:36:13.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85fc0ce440 con 0x7f85fc0d55e0 2024-04-26T23:36:13.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e400cdb0 con 0x7f85fc0d55e0 2024-04-26T23:36:13.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85fc0cea00 con 0x7f85fc0d55e0 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85fc06a720 con 0x7f85fc0d55e0 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f85e401a070 con 0x7f85fc0d55e0 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 0x7f85d806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f85e4086820 con 0x7f85fc0d55e0 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.708+0000 7f85fa800640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 0x7f85d806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:13.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.712+0000 7f85fa800640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 0x7f85d806a990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85ec005890 tx=0x7f85ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:13.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.712+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f85e4057080 con 0x7f85fc0d55e0 2024-04-26T23:36:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.876+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f85fc09e7f0 con 0x7f85d80684d0 2024-04-26T23:36:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f85f2a00640 1 -- 172.21.15.39:0/2431338382 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f85fc09e7f0 con 0x7f85d80684d0 2024-04-26T23:36:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T23:36:13.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 msgr2=0x7f85d806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 0x7f85d806a990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85ec005890 tx=0x7f85ec009040 comp rx=0 tx=0).stop 2024-04-26T23:36:13.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 msgr2=0x7f85fc0cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f85e400e930 tx=0x7f85e400edf0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 shutdown_connections 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f85d80684d0 0x7f85d806a990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85fc15f490 0x7f85fc161f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85fc0d55e0 0x7f85fc0cd980 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 --2- 172.21.15.39:0/2431338382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85fc0d0300 0x7f85fc153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 >> 172.21.15.39:0/2431338382 conn(0x7f85fc08ebf0 msgr2=0x7f85fc0cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:13.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 shutdown_connections 2024-04-26T23:36:13.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:13.880+0000 7f8601400640 1 -- 172.21.15.39:0/2431338382 wait complete. 2024-04-26T23:36:13.904 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T23:36:13.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 Processor -- start 2024-04-26T23:36:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 -- start start 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f349806f960 0x7f3498073400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349806fdd0 con 0x7f349806f4d0 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34980cfd30 con 0x7f3498145870 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.044+0000 7f349ca00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f34980cfa10 con 0x7f349806f960 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f348d400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f349806f4d0 0x7f3498072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53772/0 (socket says 172.21.15.39:53772) 2024-04-26T23:36:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f348d400640 1 -- 172.21.15.39:0/138854244 learned_addr learned my addr 172.21.15.39:0/138854244 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3496800640 1 --2- 172.21.15.39:0/138854244 >> v2:172.21.15.71:3300/0 conn(0x7f349806f960 0x7f3498073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400456581 0 0) 0x7f349806fdd0 con 0x7f349806f4d0 2024-04-26T23:36:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f347c003530 con 0x7f349806f4d0 2024-04-26T23:36:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315451819 0 0) 0x7f34980cfd30 con 0x7f3498145870 2024-04-26T23:36:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349806fdd0 con 0x7f3498145870 2024-04-26T23:36:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3496800640 1 -- 172.21.15.39:0/138854244 >> v1:172.21.15.71:6789/0 conn(0x7f3498145870 legacy=0x7f34980cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3496800640 1 -- 172.21.15.39:0/138854244 >> v1:172.21.15.39:6789/0 conn(0x7f349806f4d0 legacy=0x7f3498072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3496800640 1 -- 172.21.15.39:0/138854244 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34980d0010 con 0x7f349806f960 2024-04-26T23:36:14.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3496800640 1 --2- 172.21.15.39:0/138854244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349806f960 0x7f3498073400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f34900097c0 tx=0x7f349001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=974a91fc6444cf38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900b1070 con 0x7f349806f960 2024-04-26T23:36:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34900ac410 con 0x7f349806f960 2024-04-26T23:36:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.048+0000 7f3495400640 1 -- 172.21.15.39:0/138854244 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900ac7e0 con 0x7f349806f960 2024-04-26T23:36:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- 172.21.15.39:0/138854244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349806f960 msgr2=0x7f3498073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 --2- 172.21.15.39:0/138854244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349806f960 0x7f3498073400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f34900097c0 tx=0x7f349001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- 172.21.15.39:0/138854244 shutdown_connections 2024-04-26T23:36:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 --2- 172.21.15.39:0/138854244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349806f960 0x7f3498073400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- 172.21.15.39:0/138854244 >> 172.21.15.39:0/138854244 conn(0x7f34980b2cc0 msgr2=0x7f34980b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- 172.21.15.39:0/138854244 shutdown_connections 2024-04-26T23:36:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- 172.21.15.39:0/138854244 wait complete. 2024-04-26T23:36:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 Processor -- start 2024-04-26T23:36:14.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- start start 2024-04-26T23:36:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 0x7f3498152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f349806f960 0x7f349813a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3498145870 0x7f349813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f349815d710 con 0x7f349806f4d0 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f349815d590 con 0x7f3498145870 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f349ca00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f34980722a0 con 0x7f349806f960 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 0x7f3498152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 0x7f3498152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33452/0 (socket says 172.21.15.39:33452) 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 -- 172.21.15.39:0/2190782162 learned_addr learned my addr 172.21.15.39:0/2190782162 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 -- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f349806f960 msgr2=0x7f349813a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f348d400640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f349806f960 0x7f349813a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3496800640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3498145870 0x7f349813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f349806f960 0x7f349813a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 -- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3498145870 msgr2=0x7f349813ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3498145870 0x7f349813ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.052+0000 7f3495e00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349815af50 con 0x7f349806f4d0 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f3496800640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3498145870 0x7f349813ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348d400640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f349806f960 0x7f349813a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f3495e00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 0x7f3498152c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f348800c7a0 tx=0x7f348800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488003b80 con 0x7f349806f4d0 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3488003d40 con 0x7f349806f4d0 2024-04-26T23:36:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348800aa90 con 0x7f349806f4d0 2024-04-26T23:36:14.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349815b230 con 0x7f349806f4d0 2024-04-26T23:36:14.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349815b7f0 con 0x7f349806f4d0 2024-04-26T23:36:14.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3498050740 con 0x7f349806f4d0 2024-04-26T23:36:14.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f348800ac30 con 0x7f349806f4d0 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34740684a0 0x7f347406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f3488087260 con 0x7f349806f4d0 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f347406e360 0x7f3474070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3474070e30 con 0x7f347406e360 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f3488087610 con 0x7f349806f4d0 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.056+0000 7f348d400640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34740684a0 0x7f347406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.060+0000 7f3496800640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f347406e360 0x7f3474070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.060+0000 7f348d400640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34740684a0 0x7f347406a960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f349815cd10 tx=0x7f3480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.060+0000 7f3496800640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f347406e360 0x7f3474070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.060+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== osd.4 v2:172.21.15.71:6800/299609171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3474070e30 con 0x7f347406e360 2024-04-26T23:36:14.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 --> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3498073720 con 0x7f347406e360 2024-04-26T23:36:14.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f348ea00640 1 -- 172.21.15.39:0/2190782162 <== osd.4 v2:172.21.15.71:6800/299609171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3498073720 con 0x7f347406e360 2024-04-26T23:36:14.078 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:14.078 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:14.078 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:14.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f347406e360 msgr2=0x7f3474070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6800/299609171,v1:172.21.15.71:6801/299609171] conn(0x7f347406e360 0x7f3474070780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34740684a0 msgr2=0x7f347406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f34740684a0 0x7f347406a960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f349815cd10 tx=0x7f3480009040 comp rx=0 tx=0).stop 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 msgr2=0x7f3498152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f349ca00640 1 --2- 172.21.15.39:0/2190782162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f349806f4d0 0x7f3498152c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f348800c7a0 tx=0x7f348800cc60 comp rx=0 tx=0).stop 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.072+0000 7f3496800640 1 -- 172.21.15.39:0/2190782162 reap_dead start 2024-04-26T23:36:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.076+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 shutdown_connections 2024-04-26T23:36:14.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.076+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 >> 172.21.15.39:0/2190782162 conn(0x7f34980b2cc0 msgr2=0x7f349815c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.076+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 shutdown_connections 2024-04-26T23:36:14.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.076+0000 7f349ca00640 1 -- 172.21.15.39:0/2190782162 wait complete. 2024-04-26T23:36:14.097 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T23:36:14.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 Processor -- start 2024-04-26T23:36:14.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 -- start start 2024-04-26T23:36:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37dc159a00 0x7f37dc0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc06f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37dc15c4c0 con 0x7f37dc0b0960 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc15c780 con 0x7f37dc159a00 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37dbe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0c6fa0 con 0x7f37dc0d0470 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37daa00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37dc159a00 0x7f37dc0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37d3e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f37dc0b0960 0x7f37dc0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53786/0 (socket says 172.21.15.39:53786) 2024-04-26T23:36:14.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37d3e00640 1 -- 172.21.15.39:0/1750675933 learned_addr learned my addr 172.21.15.39:0/1750675933 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37db400640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc06f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37daa00640 1 -- 172.21.15.39:0/1750675933 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 msgr2=0x7f37dc06f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37daa00640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc06f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37daa00640 1 -- 172.21.15.39:0/1750675933 >> v1:172.21.15.39:6789/0 conn(0x7f37dc0b0960 legacy=0x7f37dc0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37daa00640 1 -- 172.21.15.39:0/1750675933 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0c7280 con 0x7f37dc159a00 2024-04-26T23:36:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37db400640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc06f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.240+0000 7f37da000640 1 -- 172.21.15.39:0/1750675933 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852127880 0 0) 0x7f37dc15c4c0 con 0x7f37dc0b0960 2024-04-26T23:36:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37daa00640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc0c7d60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0097c0 tx=0x7f37dc06fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643d461654d592 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37da000640 1 -- 172.21.15.39:0/1750675933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0b2070 con 0x7f37dc159a00 2024-04-26T23:36:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37da000640 1 -- 172.21.15.39:0/1750675933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc0ad640 con 0x7f37dc159a00 2024-04-26T23:36:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37da000640 1 -- 172.21.15.39:0/1750675933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0ada10 con 0x7f37dc159a00 2024-04-26T23:36:14.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- 172.21.15.39:0/1750675933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 msgr2=0x7f37dc0c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc0c7d60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0097c0 tx=0x7f37dc06fd70 comp rx=0 tx=0).stop 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- 172.21.15.39:0/1750675933 shutdown_connections 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc06f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 --2- 172.21.15.39:0/1750675933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc0c7d60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- 172.21.15.39:0/1750675933 >> 172.21.15.39:0/1750675933 conn(0x7f37dc0d14e0 msgr2=0x7f37dc0d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- 172.21.15.39:0/1750675933 shutdown_connections 2024-04-26T23:36:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- 172.21.15.39:0/1750675933 wait complete. 2024-04-26T23:36:14.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 Processor -- start 2024-04-26T23:36:14.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.244+0000 7f37dbe00640 1 -- start start 2024-04-26T23:36:14.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc0b0960 0x7f37dc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc159f60 con 0x7f37dc159a00 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc159de0 con 0x7f37dc0b0960 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc168e50 con 0x7f37dc0d0470 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33470/0 (socket says 172.21.15.39:33470) 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 -- 172.21.15.39:0/3988955574 learned_addr learned my addr 172.21.15.39:0/3988955574 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37daa00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc0b0960 0x7f37dc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37d3e00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 -- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 msgr2=0x7f37dc152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 -- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc0b0960 msgr2=0x7f37dc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc0b0960 0x7f37dc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 -- 172.21.15.39:0/3988955574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc165540 con 0x7f37dc159a00 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37db400640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009fa0 tx=0x7f37d400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d401a070 con 0x7f37dc159a00 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4003bc0 con 0x7f37dc159a00 2024-04-26T23:36:14.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4004030 con 0x7f37dc159a00 2024-04-26T23:36:14.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc165820 con 0x7f37dc159a00 2024-04-26T23:36:14.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc1660c0 con 0x7f37dc159a00 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.248+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0506d0 con 0x7f37dc159a00 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.252+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f37d401d070 con 0x7f37dc159a00 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.252+0000 7f37d2a00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 0x7f37b806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.252+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f37d4086ca0 con 0x7f37dc159a00 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.252+0000 7f37daa00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 0x7f37b806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.252+0000 7f37daa00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 0x7f37b806a960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0af000 tx=0x7f37cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.256+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f37d4010070 con 0x7f37dc159a00 2024-04-26T23:36:14.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.420+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f37dc1659f0 con 0x7f37b80684a0 2024-04-26T23:36:14.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37d2a00640 1 -- 172.21.15.39:0/3988955574 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f37dc1659f0 con 0x7f37b80684a0 2024-04-26T23:36:14.427 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T23:36:14.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 msgr2=0x7f37b806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 0x7f37b806a960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0af000 tx=0x7f37cc008040 comp rx=0 tx=0).stop 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 msgr2=0x7f37dc158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009fa0 tx=0x7f37d400d560 comp rx=0 tx=0).stop 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 shutdown_connections 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f37b80684a0 0x7f37b806a960 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc159a00 0x7f37dc158240 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37dc0d0470 0x7f37dc152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 --2- 172.21.15.39:0/3988955574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc0b0960 0x7f37dc0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 >> 172.21.15.39:0/3988955574 conn(0x7f37dc0d14e0 msgr2=0x7f37dc157880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 shutdown_connections 2024-04-26T23:36:14.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.424+0000 7f37dbe00640 1 -- 172.21.15.39:0/3988955574 wait complete. 2024-04-26T23:36:14.447 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T23:36:14.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:14.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.588+0000 7f1cd0c00640 1 Processor -- start 2024-04-26T23:36:14.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.588+0000 7f1cd0c00640 1 -- start start 2024-04-26T23:36:14.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 0x7f1ccc0d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc0d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ccc09b9e0 0x7f1ccc09be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1ccc0cd6c0 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1ccc0cd910 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cd0c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc0cdbf0 con 0x7f1ccc0b5ec0 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cc9e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 0x7f1ccc0d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ccc09b9e0 0x7f1ccc09be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cc9e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 0x7f1ccc0d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.39:35098/0 (socket says 172.21.15.39:35098) 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1ccc09b9e0 0x7f1ccc09be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33478/0 (socket says 172.21.15.39:33478) 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cc9e00640 1 -- 172.21.15.39:0/3426429926 learned_addr learned my addr 172.21.15.39:0/3426429926 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:14.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cc1400640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc0d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 -- 172.21.15.39:0/3426429926 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 msgr2=0x7f1ccc0d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:14.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc0d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 -- 172.21.15.39:0/3426429926 >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 msgr2=0x7f1ccc0d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:14.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 --2- 172.21.15.39:0/3426429926 >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 0x7f1ccc0d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.592+0000 7f1cca800640 1 -- 172.21.15.39:0/3426429926 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc0cded0 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cca800640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc09be90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc072e10 tx=0x7f1cc401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a36858c1a57fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cc9400640 1 -- 172.21.15.39:0/3426429926 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40b0070 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cc9400640 1 -- 172.21.15.39:0/3426429926 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc40ab600 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cc9400640 1 -- 172.21.15.39:0/3426429926 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40ab9d0 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- 172.21.15.39:0/3426429926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc09b9e0 msgr2=0x7f1ccc09be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc09be90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc072e10 tx=0x7f1cc401c3f0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- 172.21.15.39:0/3426429926 shutdown_connections 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc09be90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/3426429926 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc0d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/3426429926 >> v2:172.21.15.71:3300/0 conn(0x7f1ccc0b44b0 0x7f1ccc0d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- 172.21.15.39:0/3426429926 >> 172.21.15.39:0/3426429926 conn(0x7f1ccc0b4b60 msgr2=0x7f1ccc0b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- 172.21.15.39:0/3426429926 shutdown_connections 2024-04-26T23:36:14.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- 172.21.15.39:0/3426429926 wait complete. 2024-04-26T23:36:14.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 Processor -- start 2024-04-26T23:36:14.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- start start 2024-04-26T23:36:14.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 0x7f1ccc1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc15f670 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc15f4f0 con 0x7f1ccc09b9e0 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.596+0000 7f1cd0c00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc15f7f0 con 0x7f1ccc0b5ec0 2024-04-26T23:36:14.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 0x7f1ccc1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 0x7f1ccc1623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33488/0 (socket says 172.21.15.39:33488) 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 -- 172.21.15.39:0/2033920199 learned_addr learned my addr 172.21.15.39:0/2033920199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cca800640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc9e00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 -- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 msgr2=0x7f1ccc14da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc14da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 -- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ccc09b9e0 msgr2=0x7f1ccc160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc159310 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cca800640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1ccc0b5ec0 0x7f1ccc14da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc9e00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ccc09b9e0 0x7f1ccc160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc1400640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 0x7f1ccc1623a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400e840 tx=0x7f1cb400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4017070 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb400ee90 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400cb80 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ccc1595f0 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ccc150ab0 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ccc159b10 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f1cb401a070 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.600+0000 7f1cc2a00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ca80684d0 0x7f1ca806a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f1cb40866f0 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc2a00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7f1ca806e390 0x7f1ca80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cb4022e50 con 0x7f1ca806e390 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f1cb408d050 con 0x7f1ccc0b44b0 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc9e00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ca80684d0 0x7f1ca806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cca800640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7f1ca806e390 0x7f1ca80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc9e00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ca80684d0 0x7f1ca806a990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009dc0 tx=0x7f1cbc00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cca800640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7f1ca806e390 0x7f1ca80707b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.604+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== osd.5 v2:172.21.15.71:6816/821690898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1cb4022e50 con 0x7f1ca806e390 2024-04-26T23:36:14.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.616+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 --> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ccc050740 con 0x7f1ca806e390 2024-04-26T23:36:14.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cc2a00640 1 -- 172.21.15.39:0/2033920199 <== osd.5 v2:172.21.15.71:6816/821690898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ccc050740 con 0x7f1ca806e390 2024-04-26T23:36:14.622 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:14.623 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7f1ca806e390 msgr2=0x7f1ca80707b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6816/821690898,v1:172.21.15.71:6817/821690898] conn(0x7f1ca806e390 0x7f1ca80707b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ca80684d0 msgr2=0x7f1ca806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f1ca80684d0 0x7f1ca806a990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009dc0 tx=0x7f1cbc00d040 comp rx=0 tx=0).stop 2024-04-26T23:36:14.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 msgr2=0x7f1ccc1623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 --2- 172.21.15.39:0/2033920199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ccc0b44b0 0x7f1ccc1623a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400e840 tx=0x7f1cb400ec40 comp rx=0 tx=0).stop 2024-04-26T23:36:14.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cca800640 1 -- 172.21.15.39:0/2033920199 reap_dead start 2024-04-26T23:36:14.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 shutdown_connections 2024-04-26T23:36:14.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 >> 172.21.15.39:0/2033920199 conn(0x7f1ccc0b4b60 msgr2=0x7f1ccc0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 shutdown_connections 2024-04-26T23:36:14.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.620+0000 7f1cd0c00640 1 -- 172.21.15.39:0/2033920199 wait complete. 2024-04-26T23:36:14.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T23:36:14.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 Processor -- start 2024-04-26T23:36:14.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 -- start start 2024-04-26T23:36:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a741458d0 0x7f9a740b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a74073400 0x7f9a74072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a74072180 con 0x7f9a74072e50 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9a740739a0 con 0x7f9a74073400 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a7b400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9a74073c80 con 0x7f9a741458d0 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a6be00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a74073400 0x7f9a74072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a79400640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9a74072e50 0x7f9a740ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53794/0 (socket says 172.21.15.39:53794) 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a79400640 1 -- 172.21.15.39:0/2248097201 learned_addr learned my addr 172.21.15.39:0/2248097201 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a78a00640 1 --2- 172.21.15.39:0/2248097201 >> v2:172.21.15.71:3300/0 conn(0x7f9a741458d0 0x7f9a740b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a6be00640 1 -- 172.21.15.39:0/2248097201 >> v2:172.21.15.71:3300/0 conn(0x7f9a741458d0 msgr2=0x7f9a740b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:14.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a6be00640 1 --2- 172.21.15.39:0/2248097201 >> v2:172.21.15.71:3300/0 conn(0x7f9a741458d0 0x7f9a740b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a6be00640 1 -- 172.21.15.39:0/2248097201 >> v1:172.21.15.39:6789/0 conn(0x7f9a74072e50 legacy=0x7f9a740ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a6be00640 1 -- 172.21.15.39:0/2248097201 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74145cb0 con 0x7f9a74073400 2024-04-26T23:36:14.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.780+0000 7f9a73e00640 1 -- 172.21.15.39:0/2248097201 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528333239 0 0) 0x7f9a74072180 con 0x7f9a74072e50 2024-04-26T23:36:14.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a6be00640 1 --2- 172.21.15.39:0/2248097201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74073400 0x7f9a74072910 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f01c8d4e076d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a73e00640 1 -- 172.21.15.39:0/2248097201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0b0070 con 0x7f9a74073400 2024-04-26T23:36:14.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a73e00640 1 -- 172.21.15.39:0/2248097201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0ab600 con 0x7f9a74073400 2024-04-26T23:36:14.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a73e00640 1 -- 172.21.15.39:0/2248097201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0ab9d0 con 0x7f9a74073400 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 -- 172.21.15.39:0/2248097201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74073400 msgr2=0x7f9a74072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 --2- 172.21.15.39:0/2248097201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74073400 0x7f9a74072910 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 -- 172.21.15.39:0/2248097201 shutdown_connections 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 --2- 172.21.15.39:0/2248097201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74073400 0x7f9a74072910 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 --2- 172.21.15.39:0/2248097201 >> v2:172.21.15.71:3300/0 conn(0x7f9a741458d0 0x7f9a740b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 -- 172.21.15.39:0/2248097201 >> 172.21.15.39:0/2248097201 conn(0x7f9a7406c7d0 msgr2=0x7f9a7406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 -- 172.21.15.39:0/2248097201 shutdown_connections 2024-04-26T23:36:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.784+0000 7f9a7b400640 1 -- 172.21.15.39:0/2248097201 wait complete. 2024-04-26T23:36:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 Processor -- start 2024-04-26T23:36:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- start start 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a74073400 0x7f9a740b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 0x7f9a74159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74167740 con 0x7f9a74072e50 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740cef00 con 0x7f9a741458d0 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9a741678c0 con 0x7f9a74073400 2024-04-26T23:36:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33502/0 (socket says 172.21.15.39:33502) 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 -- 172.21.15.39:0/3480086175 learned_addr learned my addr 172.21.15.39:0/3480086175 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a79400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 0x7f9a74159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a6be00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a74073400 0x7f9a740b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 -- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a74073400 msgr2=0x7f9a740b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a74073400 0x7f9a740b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 -- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 msgr2=0x7f9a74159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 0x7f9a74159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 -- 172.21.15.39:0/3480086175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740b1980 con 0x7f9a74072e50 2024-04-26T23:36:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a79400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 0x7f9a74159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a78a00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d5f0 tx=0x7f9a6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640125f0 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a64019070 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640129b0 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a740b0c00 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a740b1180 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.788+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7406a720 con 0x7f9a74072e50 2024-04-26T23:36:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.792+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f9a64012b50 con 0x7f9a74072e50 2024-04-26T23:36:14.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.792+0000 7f9a71600640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 0x7f9a5006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:14.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.792+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f9a64086c40 con 0x7f9a74072e50 2024-04-26T23:36:14.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.792+0000 7f9a6be00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 0x7f9a5006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:14.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.792+0000 7f9a6be00640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 0x7f9a5006a960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ad000 tx=0x7f9a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.796+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9a64057350 con 0x7f9a74072e50 2024-04-26T23:36:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.960+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9a740b50b0 con 0x7f9a500684a0 2024-04-26T23:36:14.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.960+0000 7f9a71600640 1 -- 172.21.15.39:0/3480086175 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9a740b50b0 con 0x7f9a500684a0 2024-04-26T23:36:14.966 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 msgr2=0x7f9a5006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 0x7f9a5006a960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ad000 tx=0x7f9a5c008040 comp rx=0 tx=0).stop 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 msgr2=0x7f9a74169480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d5f0 tx=0x7f9a6400dab0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 shutdown_connections 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f9a500684a0 0x7f9a5006a960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a741458d0 0x7f9a74159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a74073400 0x7f9a740b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 --2- 172.21.15.39:0/3480086175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a74072e50 0x7f9a74169480 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:14.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 >> 172.21.15.39:0/3480086175 conn(0x7f9a7406c7d0 msgr2=0x7f9a740753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:14.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 shutdown_connections 2024-04-26T23:36:14.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:14.964+0000 7f9a7b400640 1 -- 172.21.15.39:0/3480086175 wait complete. 2024-04-26T23:36:14.986 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T23:36:14.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:15.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 Processor -- start 2024-04-26T23:36:15.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 -- start start 2024-04-26T23:36:15.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd37c0cf680 0x7fd37c0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c163c00 con 0x7fd37c06d6f0 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c0cffa0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37b200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd37c0cf2f0 con 0x7fd37c0cf680 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37a800640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd37c06d6f0 0x7fd37c1634f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53796/0 (socket says 172.21.15.39:53796) 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd37a800640 1 -- 172.21.15.39:0/1104534768 learned_addr learned my addr 172.21.15.39:0/1104534768 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:15.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379e00640 1 --2- 172.21.15.39:0/1104534768 >> v2:172.21.15.71:3300/0 conn(0x7fd37c0cf680 0x7fd37c0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672238058 0 0) 0x7fd37c163c00 con 0x7fd37c06d6f0 2024-04-26T23:36:15.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd360003530 con 0x7fd37c06d6f0 2024-04-26T23:36:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750360731 0 0) 0x7fd37c0cffa0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd37c163c00 con 0x7fd37c0d29d0 2024-04-26T23:36:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379e00640 1 -- 172.21.15.39:0/1104534768 >> v1:172.21.15.71:6789/0 conn(0x7fd37c0d29d0 legacy=0x7fd37c162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379e00640 1 -- 172.21.15.39:0/1104534768 >> v1:172.21.15.39:6789/0 conn(0x7fd37c06d6f0 legacy=0x7fd37c1634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.128+0000 7fd379e00640 1 -- 172.21.15.39:0/1104534768 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c0d0710 con 0x7fd37c0cf680 2024-04-26T23:36:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd379e00640 1 --2- 172.21.15.39:0/1104534768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c0cfa60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0097c0 tx=0x7fd36c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac85820b3025f655 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b0070 con 0x7fd37c0cf680 2024-04-26T23:36:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c0ab600 con 0x7fd37c0cf680 2024-04-26T23:36:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd379400640 1 -- 172.21.15.39:0/1104534768 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0ab9b0 con 0x7fd37c0cf680 2024-04-26T23:36:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 -- 172.21.15.39:0/1104534768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 msgr2=0x7fd37c0cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 --2- 172.21.15.39:0/1104534768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c0cfa60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0097c0 tx=0x7fd36c01c410 comp rx=0 tx=0).stop 2024-04-26T23:36:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 -- 172.21.15.39:0/1104534768 shutdown_connections 2024-04-26T23:36:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 --2- 172.21.15.39:0/1104534768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c0cfa60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 -- 172.21.15.39:0/1104534768 >> 172.21.15.39:0/1104534768 conn(0x7fd37c0d2e00 msgr2=0x7fd37c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 -- 172.21.15.39:0/1104534768 shutdown_connections 2024-04-26T23:36:15.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.132+0000 7fd37b200640 1 -- 172.21.15.39:0/1104534768 wait complete. 2024-04-26T23:36:15.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 Processor -- start 2024-04-26T23:36:15.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- start start 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd37c06d6f0 0x7fd37c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 0x7fd37c15e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c0d20d0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c06def0 con 0x7fd37c0cf680 2024-04-26T23:36:15.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c06e700 con 0x7fd37c06d6f0 2024-04-26T23:36:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 0x7fd37c15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 0x7fd37c15e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33516/0 (socket says 172.21.15.39:33516) 2024-04-26T23:36:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 -- 172.21.15.39:0/3638273361 learned_addr learned my addr 172.21.15.39:0/3638273361 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd379e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd37c06d6f0 0x7fd37c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd373e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 -- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd37c06d6f0 msgr2=0x7fd37c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd37c06d6f0 0x7fd37c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 -- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 msgr2=0x7fd37c15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c15ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c15f240 con 0x7fd37c0d29d0 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd373e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c0cf680 0x7fd37c15ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37a800640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 0x7fd37c15e120 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd37400cb20 tx=0x7fd37400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374017070 con 0x7fd37c0d29d0 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37400aca0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374012600 con 0x7fd37c0d29d0 2024-04-26T23:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c15d310 con 0x7fd37c0d29d0 2024-04-26T23:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.136+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c1587d0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd37c0506d0 con 0x7fd37c0d29d0 2024-04-26T23:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fd37401a070 con 0x7fd37c0d29d0 2024-04-26T23:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd3580684a0 0x7fd35806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7fd374086460 con 0x7fd37c0d29d0 2024-04-26T23:36:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7fd35806e360 0x7fd358070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd37400ae50 con 0x7fd35806e360 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fd37408d050 con 0x7fd37c0d29d0 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd379e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd3580684a0 0x7fd35806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd373e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7fd35806e360 0x7fd358070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd379e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd3580684a0 0x7fd35806a960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0ad000 tx=0x7fd36c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.140+0000 7fd373e00640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7fd35806e360 0x7fd358070780 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.144+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== osd.6 v2:172.21.15.71:6824/3577500951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd37400ae50 con 0x7fd35806e360 2024-04-26T23:36:15.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 --> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd37c0d2770 con 0x7fd35806e360 2024-04-26T23:36:15.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd372000640 1 -- 172.21.15.39:0/3638273361 <== osd.6 v2:172.21.15.71:6824/3577500951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd37c0d2770 con 0x7fd35806e360 2024-04-26T23:36:15.160 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:15.161 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7fd35806e360 msgr2=0x7fd358070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6824/3577500951,v1:172.21.15.71:6825/3577500951] conn(0x7fd35806e360 0x7fd358070780 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd3580684a0 msgr2=0x7fd35806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fd3580684a0 0x7fd35806a960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0ad000 tx=0x7fd36c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 msgr2=0x7fd37c15e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 --2- 172.21.15.39:0/3638273361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd37c0d29d0 0x7fd37c15e120 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd37400cb20 tx=0x7fd37400a060 comp rx=0 tx=0).stop 2024-04-26T23:36:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37a800640 1 -- 172.21.15.39:0/3638273361 reap_dead start 2024-04-26T23:36:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 shutdown_connections 2024-04-26T23:36:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 >> 172.21.15.39:0/3638273361 conn(0x7fd37c0d2e00 msgr2=0x7fd37c0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 shutdown_connections 2024-04-26T23:36:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.156+0000 7fd37b200640 1 -- 172.21.15.39:0/3638273361 wait complete. 2024-04-26T23:36:15.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T23:36:15.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 Processor -- start 2024-04-26T23:36:15.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 -- start start 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39a40cf940 0x7f39a406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a406d2f0 0x7f39a406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a41492a0 con 0x7f39a41488f0 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f39a406d740 con 0x7f39a40cf940 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39ac000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f39a4070840 con 0x7f39a406d2f0 2024-04-26T23:36:15.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39a8c00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39a40cf940 0x7f39a406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39a9600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f39a41488f0 0x7f39a40cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53806/0 (socket says 172.21.15.39:53806) 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.316+0000 7f39a9600640 1 -- 172.21.15.39:0/1999930766 learned_addr learned my addr 172.21.15.39:0/1999930766 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39aa000640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a406d2f0 0x7f39a406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a8c00640 1 -- 172.21.15.39:0/1999930766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a406d2f0 msgr2=0x7f39a406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a8c00640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a406d2f0 0x7f39a406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a8c00640 1 -- 172.21.15.39:0/1999930766 >> v1:172.21.15.39:6789/0 conn(0x7f39a41488f0 legacy=0x7f39a40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a8c00640 1 -- 172.21.15.39:0/1999930766 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a406d9c0 con 0x7f39a40cf940 2024-04-26T23:36:15.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a8c00640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a40cf940 0x7f39a406cdb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39900097c0 tx=0x7f399001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d698d1f23b9f3436 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a3e00640 1 -- 172.21.15.39:0/1999930766 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39900a7070 con 0x7f39a40cf940 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a3e00640 1 -- 172.21.15.39:0/1999930766 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39900b0070 con 0x7f39a40cf940 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39a3e00640 1 -- 172.21.15.39:0/1999930766 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39900ab890 con 0x7f39a40cf940 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 -- 172.21.15.39:0/1999930766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a40cf940 msgr2=0x7f39a406cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a40cf940 0x7f39a406cdb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39900097c0 tx=0x7f399001c470 comp rx=0 tx=0).stop 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 -- 172.21.15.39:0/1999930766 shutdown_connections 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a406d2f0 0x7f39a406f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 --2- 172.21.15.39:0/1999930766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a40cf940 0x7f39a406cdb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.320+0000 7f39ac000640 1 -- 172.21.15.39:0/1999930766 >> 172.21.15.39:0/1999930766 conn(0x7f39a40ce0e0 msgr2=0x7f39a40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- 172.21.15.39:0/1999930766 shutdown_connections 2024-04-26T23:36:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- 172.21.15.39:0/1999930766 wait complete. 2024-04-26T23:36:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 Processor -- start 2024-04-26T23:36:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- start start 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 0x7f39a41fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 0x7f39a40c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4148cd0 con 0x7f39a41488f0 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39a406f070 con 0x7f39a406d2f0 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f39a40702e0 con 0x7f39a40cf940 2024-04-26T23:36:15.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33534/0 (socket says 172.21.15.39:33534) 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 -- 172.21.15.39:0/2218700633 learned_addr learned my addr 172.21.15.39:0/2218700633 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a9600640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 0x7f39a41fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a8c00640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 0x7f39a40c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 -- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 msgr2=0x7f39a40c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 0x7f39a40c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 -- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 msgr2=0x7f39a41fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 0x7f39a41fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 -- 172.21.15.39:0/2218700633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a415e500 con 0x7f39a41488f0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a9600640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 0x7f39a41fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a8c00640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 0x7f39a40c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39aa000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f399c007e60 tx=0x7f399c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c014420 con 0x7f39a41488f0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c019070 con 0x7f39a41488f0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a415e7e0 con 0x7f39a41488f0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c014820 con 0x7f39a41488f0 2024-04-26T23:36:15.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.324+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a415eda0 con 0x7f39a41488f0 2024-04-26T23:36:15.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a406a720 con 0x7f39a41488f0 2024-04-26T23:36:15.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f399c0149c0 con 0x7f39a41488f0 2024-04-26T23:36:15.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39a1600640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 0x7f398406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f399c087140 con 0x7f39a41488f0 2024-04-26T23:36:15.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39a9600640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 0x7f398406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.328+0000 7f39a9600640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 0x7f398406a960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3998007fd0 tx=0x7f3998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.332+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f399c057850 con 0x7f39a41488f0 2024-04-26T23:36:15.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.496+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f39a40b72c0 con 0x7f39840684a0 2024-04-26T23:36:15.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.496+0000 7f39a1600640 1 -- 172.21.15.39:0/2218700633 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39a40b72c0 con 0x7f39840684a0 2024-04-26T23:36:15.501 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T23:36:15.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 msgr2=0x7f398406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 0x7f398406a960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3998007fd0 tx=0x7f3998009040 comp rx=0 tx=0).stop 2024-04-26T23:36:15.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 msgr2=0x7f39a415d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f399c007e60 tx=0x7f399c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 shutdown_connections 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f39840684a0 0x7f398406a960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39a41488f0 0x7f39a415d730 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39a40cf940 0x7f39a40c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 --2- 172.21.15.39:0/2218700633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39a406d2f0 0x7f39a41fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 >> 172.21.15.39:0/2218700633 conn(0x7f39a40ce0e0 msgr2=0x7f39a40ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 shutdown_connections 2024-04-26T23:36:15.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.500+0000 7f39ac000640 1 -- 172.21.15.39:0/2218700633 wait complete. 2024-04-26T23:36:15.524 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T23:36:15.524 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:36:15.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.664+0000 7f921c000640 1 Processor -- start 2024-04-26T23:36:15.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.664+0000 7f921c000640 1 -- start start 2024-04-26T23:36:15.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f921c000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 0x7f92140728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f921c000640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f921406e560 con 0x7f921415b510 2024-04-26T23:36:15.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f921c000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140cfdc0 con 0x7f9214072e10 2024-04-26T23:36:15.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f921c000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f92140d0380 con 0x7f92140b68c0 2024-04-26T23:36:15.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9219600640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f921415b510 0x7f92140d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53808/0 (socket says 172.21.15.39:53808) 2024-04-26T23:36:15.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9219600640 1 -- 172.21.15.39:0/2770890971 learned_addr learned my addr 172.21.15.39:0/2770890971 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:15.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9218c00640 1 --2- 172.21.15.39:0/2770890971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 0x7f92140728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 <== mon.1 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066924972 0 0) 0x7f92140cfdc0 con 0x7f9214072e10 2024-04-26T23:36:15.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91fc003530 con 0x7f9214072e10 2024-04-26T23:36:15.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314060432 0 0) 0x7f921406e560 con 0x7f921415b510 2024-04-26T23:36:15.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92140cfdc0 con 0x7f921415b510 2024-04-26T23:36:15.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9218c00640 1 -- 172.21.15.39:0/2770890971 >> v1:172.21.15.71:6789/0 conn(0x7f9214072e10 legacy=0x7f921406ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9218c00640 1 -- 172.21.15.39:0/2770890971 >> v1:172.21.15.39:6789/0 conn(0x7f921415b510 legacy=0x7f92140d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.668+0000 7f9218c00640 1 -- 172.21.15.39:0/2770890971 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140d00a0 con 0x7f92140b68c0 2024-04-26T23:36:15.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f9218c00640 1 --2- 172.21.15.39:0/2770890971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 0x7f92140728d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92000097f0 tx=0x7f920001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781f98946437dbe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000b0070 con 0x7f92140b68c0 2024-04-26T23:36:15.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000ab600 con 0x7f92140b68c0 2024-04-26T23:36:15.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f9213e00640 1 -- 172.21.15.39:0/2770890971 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000a4e60 con 0x7f92140b68c0 2024-04-26T23:36:15.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- 172.21.15.39:0/2770890971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 msgr2=0x7f92140728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 --2- 172.21.15.39:0/2770890971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 0x7f92140728d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92000097f0 tx=0x7f920001c450 comp rx=0 tx=0).stop 2024-04-26T23:36:15.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- 172.21.15.39:0/2770890971 shutdown_connections 2024-04-26T23:36:15.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 --2- 172.21.15.39:0/2770890971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92140b68c0 0x7f92140728d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- 172.21.15.39:0/2770890971 >> 172.21.15.39:0/2770890971 conn(0x7f92140b2cc0 msgr2=0x7f92140b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- 172.21.15.39:0/2770890971 shutdown_connections 2024-04-26T23:36:15.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- 172.21.15.39:0/2770890971 wait complete. 2024-04-26T23:36:15.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 Processor -- start 2024-04-26T23:36:15.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 -- start start 2024-04-26T23:36:15.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.672+0000 7f921c000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9214072e10 0x7f9214150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 0x7f9214149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f921415b510 0x7f92140afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f921415bb00 con 0x7f92140b68c0 2024-04-26T23:36:15.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f921406fc30 con 0x7f921415b510 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f92140cfb70 con 0x7f9214072e10 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 0x7f9214149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 0x7f9214149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33546/0 (socket says 172.21.15.39:33546) 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 -- 172.21.15.39:0/3480053553 learned_addr learned my addr 172.21.15.39:0/3480053553 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9219600640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9214072e10 0x7f9214150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921a000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f921415b510 0x7f92140afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 -- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9214072e10 msgr2=0x7f9214150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9214072e10 0x7f9214150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 -- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f921415b510 msgr2=0x7f92140afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f921415b510 0x7f92140afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141556c0 con 0x7f92140b68c0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921a000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f921415b510 0x7f92140afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9218c00640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 0x7f9214149410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9200019060 tx=0x7f92000191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000b8020 con 0x7f92140b68c0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000b4410 con 0x7f92140b68c0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000b0040 con 0x7f92140b68c0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92141559a0 con 0x7f92140b68c0 2024-04-26T23:36:15.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141595c0 con 0x7f92140b68c0 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92141599a0 con 0x7f92140b68c0 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.676+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f92000bb020 con 0x7f92140b68c0 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91f40684a0 0x7f91f406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f92001203a0 con 0x7f92140b68c0 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f91f406e360 0x7f91f4070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92000b2ea0 con 0x7f91f406e360 2024-04-26T23:36:15.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f9200127050 con 0x7f92140b68c0 2024-04-26T23:36:15.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9219600640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91f40684a0 0x7f91f406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f921a000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f91f406e360 0x7f91f4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9219600640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91f40684a0 0x7f91f406a960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9208007fd0 tx=0x7f9208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f921a000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f91f406e360 0x7f91f4070780 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.680+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== osd.7 v2:172.21.15.71:6808/2492781367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92000b2ea0 con 0x7f91f406e360 2024-04-26T23:36:15.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.692+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 --> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9214153050 con 0x7f91f406e360 2024-04-26T23:36:15.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.692+0000 7f9211600640 1 -- 172.21.15.39:0/3480053553 <== osd.7 v2:172.21.15.71:6808/2492781367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9214153050 con 0x7f91f406e360 2024-04-26T23:36:15.698 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-04-26T23:36:15.698 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:36:15.698 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-04-26T23:36:15.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f91f406e360 msgr2=0x7f91f4070780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6808/2492781367,v1:172.21.15.71:6809/2492781367] conn(0x7f91f406e360 0x7f91f4070780 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91f40684a0 msgr2=0x7f91f406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f91f40684a0 0x7f91f406a960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9208007fd0 tx=0x7f9208009040 comp rx=0 tx=0).stop 2024-04-26T23:36:15.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 msgr2=0x7f9214149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 --2- 172.21.15.39:0/3480053553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92140b68c0 0x7f9214149410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9200019060 tx=0x7f92000191f0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921a000640 1 -- 172.21.15.39:0/3480053553 reap_dead start 2024-04-26T23:36:15.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 shutdown_connections 2024-04-26T23:36:15.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 >> 172.21.15.39:0/3480053553 conn(0x7f92140b2cc0 msgr2=0x7f9214075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 shutdown_connections 2024-04-26T23:36:15.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.696+0000 7f921c000640 1 -- 172.21.15.39:0/3480053553 wait complete. 2024-04-26T23:36:15.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T23:36:15.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 Processor -- start 2024-04-26T23:36:15.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 -- start start 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcd01466f0 0x7efcd0073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0074280 0x7efcd006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd015d8c0 con 0x7efcd0146ad0 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efcd015e610 con 0x7efcd01466f0 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcd015e440 con 0x7efcd0074280 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcd01466f0 0x7efcd0073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcd01466f0 0x7efcd0073d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33552/0 (socket says 172.21.15.39:33552) 2024-04-26T23:36:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 -- 172.21.15.39:0/994715010 learned_addr learned my addr 172.21.15.39:0/994715010 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efcd5000640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0074280 0x7efcd006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 -- 172.21.15.39:0/994715010 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0074280 msgr2=0x7efcd006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0074280 0x7efcd006f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 -- 172.21.15.39:0/994715010 >> v1:172.21.15.71:6789/0 conn(0x7efcd0146ad0 legacy=0x7efcd006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.856+0000 7efccfe00640 1 -- 172.21.15.39:0/994715010 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd015dba0 con 0x7efcd01466f0 2024-04-26T23:36:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efccfe00640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0073d40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098a0 tx=0x7efcc001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b31fa10ef73182 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efccf400640 1 -- 172.21.15.39:0/994715010 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc00ab620 con 0x7efcd01466f0 2024-04-26T23:36:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efccf400640 1 -- 172.21.15.39:0/994715010 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc00b0070 con 0x7efcd01466f0 2024-04-26T23:36:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efccf400640 1 -- 172.21.15.39:0/994715010 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc00ab9e0 con 0x7efcd01466f0 2024-04-26T23:36:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 -- 172.21.15.39:0/994715010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 msgr2=0x7efcd0073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0073d40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098a0 tx=0x7efcc001c420 comp rx=0 tx=0).stop 2024-04-26T23:36:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 -- 172.21.15.39:0/994715010 shutdown_connections 2024-04-26T23:36:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0074280 0x7efcd006f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 --2- 172.21.15.39:0/994715010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0073d40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 -- 172.21.15.39:0/994715010 >> 172.21.15.39:0/994715010 conn(0x7efcd006d4e0 msgr2=0x7efcd006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 -- 172.21.15.39:0/994715010 shutdown_connections 2024-04-26T23:36:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.860+0000 7efcd5a00640 1 -- 172.21.15.39:0/994715010 wait complete. 2024-04-26T23:36:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 Processor -- start 2024-04-26T23:36:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- start start 2024-04-26T23:36:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd0074280 0x7efcd0145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0146ad0 0x7efcd012acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcd015d400 con 0x7efcd01466f0 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcd006cd80 con 0x7efcd0074280 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcd015d580 con 0x7efcd0146ad0 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33554/0 (socket says 172.21.15.39:33554) 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efccfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd0074280 0x7efcd0145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 -- 172.21.15.39:0/2340013649 learned_addr learned my addr 172.21.15.39:0/2340013649 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5000640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0146ad0 0x7efcd012acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 -- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0146ad0 msgr2=0x7efcd012acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0146ad0 0x7efcd012acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 -- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd0074280 msgr2=0x7efcd0145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd0074280 0x7efcd0145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 -- 172.21.15.39:0/2340013649 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00b47f0 con 0x7efcd01466f0 2024-04-26T23:36:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcc7400640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c340 tx=0x7efcb800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb80052d0 con 0x7efcd01466f0 2024-04-26T23:36:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb8005470 con 0x7efcd01466f0 2024-04-26T23:36:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd00b4e90 con 0x7efcd01466f0 2024-04-26T23:36:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8007260 con 0x7efcd01466f0 2024-04-26T23:36:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd00b5450 con 0x7efcd01466f0 2024-04-26T23:36:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.864+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd00506d0 con 0x7efcd01466f0 2024-04-26T23:36:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.868+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7efcb8007400 con 0x7efcd01466f0 2024-04-26T23:36:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.868+0000 7efcccc00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 0x7efcac06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.868+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7efcb8085bc0 con 0x7efcd01466f0 2024-04-26T23:36:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.868+0000 7efccfe00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 0x7efcac06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.868+0000 7efccfe00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 0x7efcac06a960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efcc00af000 tx=0x7efcc00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:15.872+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efcb8055d10 con 0x7efcd01466f0 2024-04-26T23:36:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.036+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7efcd006dde0 con 0x7efcac0684a0 2024-04-26T23:36:16.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.036+0000 7efcccc00640 1 -- 172.21.15.39:0/2340013649 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efcd006dde0 con 0x7efcac0684a0 2024-04-26T23:36:16.042 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 msgr2=0x7efcac06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 0x7efcac06a960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efcc00af000 tx=0x7efcc00a7000 comp rx=0 tx=0).stop 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 msgr2=0x7efcd0153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c340 tx=0x7efcb800c800 comp rx=0 tx=0).stop 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 shutdown_connections 2024-04-26T23:36:16.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7efcac0684a0 0x7efcac06a960 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcd0146ad0 0x7efcd012acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcd01466f0 0x7efcd0153850 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 --2- 172.21.15.39:0/2340013649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd0074280 0x7efcd0145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 >> 172.21.15.39:0/2340013649 conn(0x7efcd006d4e0 msgr2=0x7efcd00d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 shutdown_connections 2024-04-26T23:36:16.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.040+0000 7efcd5a00640 1 -- 172.21.15.39:0/2340013649 wait complete. 2024-04-26T23:36:16.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:36:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 Processor -- start 2024-04-26T23:36:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 -- start start 2024-04-26T23:36:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50b80b7250 0x7f50b80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b8163ce0 con 0x7f50b80b4b10 2024-04-26T23:36:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f50b80b54b0 con 0x7f50b80b7250 2024-04-26T23:36:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50c0400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f50b80d1390 con 0x7f50b815f500 2024-04-26T23:36:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bda00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50be400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50b80b7250 0x7f50b80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bda00640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.39:44066/0 (socket says 172.21.15.39:44066) 2024-04-26T23:36:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bda00640 1 -- 172.21.15.39:0/2442313530 learned_addr learned my addr 172.21.15.39:0/2442313530 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:16.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bd000640 1 --1- 172.21.15.39:0/2442313530 >> v1:172.21.15.71:6789/0 conn(0x7f50b80b4b10 0x7f50b806d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.39:43306/0 (socket says 172.21.15.39:43306) 2024-04-26T23:36:16.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bda00640 1 -- 172.21.15.39:0/2442313530 >> v2:172.21.15.71:3300/0 conn(0x7f50b80b7250 msgr2=0x7f50b80b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:16.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.200+0000 7f50bda00640 1 --2- 172.21.15.39:0/2442313530 >> v2:172.21.15.71:3300/0 conn(0x7f50b80b7250 0x7f50b80b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50bda00640 1 -- 172.21.15.39:0/2442313530 >> v1:172.21.15.71:6789/0 conn(0x7f50b80b4b10 legacy=0x7f50b806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50bda00640 1 -- 172.21.15.39:0/2442313530 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b80d0dd0 con 0x7f50b815f500 2024-04-26T23:36:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50bda00640 1 --2- 172.21.15.39:0/2442313530 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009870 tx=0x7f50ac01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564ef427d9c46ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50b7e00640 1 -- 172.21.15.39:0/2442313530 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0b0070 con 0x7f50b815f500 2024-04-26T23:36:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50b7e00640 1 -- 172.21.15.39:0/2442313530 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac0ab600 con 0x7f50b815f500 2024-04-26T23:36:16.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.204+0000 7f50b7e00640 1 -- 172.21.15.39:0/2442313530 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0ab9d0 con 0x7f50b815f500 2024-04-26T23:36:16.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- 172.21.15.39:0/2442313530 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 msgr2=0x7f50b80d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- 172.21.15.39:0/2442313530 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009870 tx=0x7f50ac01c440 comp rx=0 tx=0).stop 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- 172.21.15.39:0/2442313530 shutdown_connections 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- 172.21.15.39:0/2442313530 >> v2:172.21.15.71:3300/0 conn(0x7f50b80b7250 0x7f50b80b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- 172.21.15.39:0/2442313530 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b815f500 0x7f50b80d27b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- 172.21.15.39:0/2442313530 >> 172.21.15.39:0/2442313530 conn(0x7f50b8068140 msgr2=0x7f50b8068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- 172.21.15.39:0/2442313530 shutdown_connections 2024-04-26T23:36:16.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- 172.21.15.39:0/2442313530 wait complete. 2024-04-26T23:36:16.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 Processor -- start 2024-04-26T23:36:16.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- start start 2024-04-26T23:36:16.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b80b7250 0x7f50b80cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815f500 0x7f50b81fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8163ac0 con 0x7f50b80b4b10 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8163940 con 0x7f50b815f500 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50c0400640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f50b816c2d0 con 0x7f50b80b7250 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33558/0 (socket says 172.21.15.39:33558) 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 -- 172.21.15.39:0/865133380 learned_addr learned my addr 172.21.15.39:0/865133380 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:16.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bd000640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b80b7250 0x7f50b80cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50be400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815f500 0x7f50b81fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 -- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b80b7250 msgr2=0x7f50b80cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b80b7250 0x7f50b80cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 -- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815f500 msgr2=0x7f50b81fb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815f500 0x7f50b81fb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 -- 172.21.15.39:0/865133380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b81626c0 con 0x7f50b80b4b10 2024-04-26T23:36:16.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.208+0000 7f50bda00640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ae040 tx=0x7f50ac0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:16.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0b0050 con 0x7f50b80b4b10 2024-04-26T23:36:16.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac0bc070 con 0x7f50b80b4b10 2024-04-26T23:36:16.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b80cab30 con 0x7f50b80b4b10 2024-04-26T23:36:16.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0b5a90 con 0x7f50b80b4b10 2024-04-26T23:36:16.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b80cb0f0 con 0x7f50b80b4b10 2024-04-26T23:36:16.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b8050740 con 0x7f50b80b4b10 2024-04-26T23:36:16.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f50ac0ab4c0 con 0x7f50b80b4b10 2024-04-26T23:36:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 0x7f509806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f50ac1210e0 con 0x7f50b80b4b10 2024-04-26T23:36:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.212+0000 7f50bd000640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 0x7f509806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.216+0000 7f50bd000640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 0x7f509806a960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50b80b8790 tx=0x7f50a4007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:16.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.216+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f50ac016150 con 0x7f50b80b4b10 2024-04-26T23:36:16.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.380+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50b8070f30 con 0x7f50980684a0 2024-04-26T23:36:16.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.380+0000 7f50b5600640 1 -- 172.21.15.39:0/865133380 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13475 (secure 0 0 0) 0x7f50b8070f30 con 0x7f50980684a0 2024-04-26T23:36:16.385 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:16.385 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:36:16.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 msgr2=0x7f509806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 0x7f509806a960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50b80b8790 tx=0x7f50a4007cf0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 msgr2=0x7f50b8156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ae040 tx=0x7f50ac0191e0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 shutdown_connections 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f50980684a0 0x7f509806a960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815f500 0x7f50b81fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f50b80b7250 0x7f50b80cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 --2- 172.21.15.39:0/865133380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50b80b4b10 0x7f50b8156550 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 >> 172.21.15.39:0/865133380 conn(0x7f50b8068140 msgr2=0x7f50b80cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:16.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 shutdown_connections 2024-04-26T23:36:16.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:16.384+0000 7f50c0400640 1 -- 172.21.15.39:0/865133380 wait complete. 2024-04-26T23:36:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-04-26T23:36:15.814173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252976,"kb_used_data":7688,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721744,"statfs":{"total":773094113280,"available":772835065856,"internally_reserved":0,"allocated":7872512,"data_stored":4040792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-130,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.736648"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T23:36:07.598854+0000","last_change":"2024-04-26T23:26:03.082462+0000","last_active":"2024-04-26T23:36:07.598854+0000","last_peered":"2024-04-26T23:36:07.598854+0000","last_clean":"2024-04-26T23:36:07.598854+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:36:07.598854+0000","last_undegraded":"2024-04-26T23:36:07.598854+0000","last_fullsized":"2024-04-26T23:36:07.598854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:26:01.991714+0000","last_clean_scrub_stamp":"2024-04-26T23:26:01.991714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:30.733054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":947875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":947875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:36:16.409 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T23:26:01.991714+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=26, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:36:16.409 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:36:36.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:36:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 Processor -- start 2024-04-26T23:36:36.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 -- start start 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f18bc0cd810 0x7f18bc0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 0x7f18bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18bc0d0550 con 0x7f18bc0cfe00 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f18bc0d0b10 con 0x7f18bc0cd810 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18c2600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f18bc06e970 con 0x7f18bc0cdbf0 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bb400640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f18bc0cd810 0x7f18bc0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18b2a00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f18bc0cfe00 0x7f18bc144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53016/0 (socket says 172.21.15.39:53016) 2024-04-26T23:36:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18b2a00640 1 -- 172.21.15.39:0/3290438023 learned_addr learned my addr 172.21.15.39:0/3290438023 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bb400640 1 -- 172.21.15.39:0/3290438023 >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 msgr2=0x7f18bc06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bbe00640 1 --2- 172.21.15.39:0/3290438023 >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 0x7f18bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bb400640 1 --2- 172.21.15.39:0/3290438023 >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 0x7f18bc06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bb400640 1 -- 172.21.15.39:0/3290438023 >> v1:172.21.15.39:6789/0 conn(0x7f18bc0cfe00 legacy=0x7f18bc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18baa00640 1 -- 172.21.15.39:0/3290438023 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381029355 0 0) 0x7f18bc0d0550 con 0x7f18bc0cfe00 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bb400640 1 -- 172.21.15.39:0/3290438023 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc0d0830 con 0x7f18bc0cd810 2024-04-26T23:36:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.560+0000 7f18bbe00640 1 --2- 172.21.15.39:0/3290438023 >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 0x7f18bc06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18bb400640 1 --2- 172.21.15.39:0/3290438023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cd810 0x7f18bc0742f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0719c0 tx=0x7f18ac01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5baf4fdb3a0250 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18baa00640 1 -- 172.21.15.39:0/3290438023 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0b0070 con 0x7f18bc0cd810 2024-04-26T23:36:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18baa00640 1 -- 172.21.15.39:0/3290438023 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0ab600 con 0x7f18bc0cd810 2024-04-26T23:36:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18baa00640 1 -- 172.21.15.39:0/3290438023 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0ab9d0 con 0x7f18bc0cd810 2024-04-26T23:36:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 -- 172.21.15.39:0/3290438023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cd810 msgr2=0x7f18bc0742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 --2- 172.21.15.39:0/3290438023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cd810 0x7f18bc0742f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0719c0 tx=0x7f18ac01c330 comp rx=0 tx=0).stop 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 -- 172.21.15.39:0/3290438023 shutdown_connections 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 --2- 172.21.15.39:0/3290438023 >> v2:172.21.15.71:3300/0 conn(0x7f18bc0cdbf0 0x7f18bc06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 --2- 172.21.15.39:0/3290438023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cd810 0x7f18bc0742f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 -- 172.21.15.39:0/3290438023 >> 172.21.15.39:0/3290438023 conn(0x7f18bc0b2af0 msgr2=0x7f18bc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 -- 172.21.15.39:0/3290438023 shutdown_connections 2024-04-26T23:36:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.564+0000 7f18c2600640 1 -- 172.21.15.39:0/3290438023 wait complete. 2024-04-26T23:36:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 Processor -- start 2024-04-26T23:36:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- start start 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18bc0cd810 0x7f18bc162250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18bc0cdbf0 0x7f18bc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc143d30 con 0x7f18bc0cfe00 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc143bb0 con 0x7f18bc0cd810 2024-04-26T23:36:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18bc169ef0 con 0x7f18bc0cdbf0 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34640/0 (socket says 172.21.15.39:34640) 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 -- 172.21.15.39:0/1093674476 learned_addr learned my addr 172.21.15.39:0/1093674476 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bb400640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18bc0cd810 0x7f18bc162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18b2a00640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18bc0cdbf0 0x7f18bc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 -- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18bc0cdbf0 msgr2=0x7f18bc13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18bc0cdbf0 0x7f18bc13fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 -- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18bc0cd810 msgr2=0x7f18bc162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18bc0cd810 0x7f18bc162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 -- 172.21.15.39:0/1093674476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc1611b0 con 0x7f18bc0cfe00 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18bbe00640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f18b400cf20 tx=0x7f18b400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b401a070 con 0x7f18bc0cfe00 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b400d840 con 0x7f18bc0cfe00 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b400dc30 con 0x7f18bc0cfe00 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18bc161490 con 0x7f18bc0cfe00 2024-04-26T23:36:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.568+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18bc161a50 con 0x7f18bc0cfe00 2024-04-26T23:36:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18bc050740 con 0x7f18bc0cfe00 2024-04-26T23:36:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7f18b401d070 con 0x7f18bc0cfe00 2024-04-26T23:36:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18b3e00640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 0x7f189806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7f18b4086fe0 con 0x7f18bc0cfe00 2024-04-26T23:36:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18bb400640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 0x7f189806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.572+0000 7f18bb400640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 0x7f189806a960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0ad000 tx=0x7f18ac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.576+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18b4057190 con 0x7f18bc0cfe00 2024-04-26T23:36:36.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.736+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 --> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18bc074130 con 0x7f18980684a0 2024-04-26T23:36:36.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18b3e00640 1 -- 172.21.15.39:0/1093674476 <== mgr.4100 v2:172.21.15.71:6832/4212401484 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f18bc074130 con 0x7f18980684a0 2024-04-26T23:36:36.743 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:36.744 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-04-26T23:36:36.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 msgr2=0x7f189806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 0x7f189806a960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0ad000 tx=0x7f18ac0a6000 comp rx=0 tx=0).stop 2024-04-26T23:36:36.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 msgr2=0x7f18bc163ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f18b400cf20 tx=0x7f18b400a7d0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 shutdown_connections 2024-04-26T23:36:36.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7f18980684a0 0x7f189806a960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc0cfe00 0x7f18bc163ca0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18bc0cdbf0 0x7f18bc13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 --2- 172.21.15.39:0/1093674476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18bc0cd810 0x7f18bc162250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 >> 172.21.15.39:0/1093674476 conn(0x7f18bc0b2af0 msgr2=0x7f18bc142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:36.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 shutdown_connections 2024-04-26T23:36:36.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.740+0000 7f18c2600640 1 -- 172.21.15.39:0/1093674476 wait complete. 2024-04-26T23:36:36.765 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2024-04-26T23:36:35.818776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252960,"kb_used_data":7688,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721760,"statfs":{"total":773094113280,"available":772835082240,"internally_reserved":0,"allocated":7872512,"data_stored":4040792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002750"},"pg_stats":[{"pgid":"1.0","version":"68'119","reported_seq":275,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T23:36:16.913583+0000","last_change":"2024-04-26T23:36:16.913622+0000","last_active":"2024-04-26T23:36:16.913583+0000","last_peered":"2024-04-26T23:36:16.913583+0000","last_clean":"2024-04-26T23:36:16.913583+0000","last_became_active":"2024-04-26T23:26:03.081263+0000","last_became_peered":"2024-04-26T23:26:03.081263+0000","last_unstale":"2024-04-26T23:36:16.913583+0000","last_undegraded":"2024-04-26T23:36:16.913583+0000","last_fullsized":"2024-04-26T23:36:16.913583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'119","last_scrub_stamp":"2024-04-26T23:36:16.913492+0000","last_deep_scrub":"68'119","last_deep_scrub_stamp":"2024-04-26T23:36:16.913492+0000","last_clean_scrub_stamp":"2024-04-26T23:36:16.913492+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:35:45.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":947875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":947875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:36:36.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T23:36:36.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.900+0000 7ff9df000640 1 Processor -- start 2024-04-26T23:36:36.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 -- start start 2024-04-26T23:36:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d8140170 0x7ff9d815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 0x7ff9d80d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d806e500 con 0x7ff9d8161850 2024-04-26T23:36:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d806f110 con 0x7ff9d8140170 2024-04-26T23:36:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9df000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d806e7e0 con 0x7ff9d815e340 2024-04-26T23:36:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d8140170 0x7ff9d815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d8140170 0x7ff9d815de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34646/0 (socket says 172.21.15.39:34646) 2024-04-26T23:36:36.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2915380572 learned_addr learned my addr 172.21.15.39:0/2915380572 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2915380572 >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 msgr2=0x7ff9d80d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2915380572 >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 0x7ff9d80d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 --2- 172.21.15.39:0/2915380572 >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 0x7ff9d80d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2915380572 >> v1:172.21.15.71:6789/0 conn(0x7ff9d8161850 legacy=0x7ff9d8142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2915380572 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d806eac0 con 0x7ff9d8140170 2024-04-26T23:36:36.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.904+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2915380572 >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 0x7ff9d80d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9d7e00640 1 --2- 172.21.15.39:0/2915380572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d815de00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8072270 tx=0x7ff9c801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc542826211c63a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9d7400640 1 -- 172.21.15.39:0/2915380572 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80a56c0 con 0x7ff9d8140170 2024-04-26T23:36:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9d7400640 1 -- 172.21.15.39:0/2915380572 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c80a5860 con 0x7ff9d8140170 2024-04-26T23:36:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9d7400640 1 -- 172.21.15.39:0/2915380572 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80a5c30 con 0x7ff9d8140170 2024-04-26T23:36:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- 172.21.15.39:0/2915380572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 msgr2=0x7ff9d815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 --2- 172.21.15.39:0/2915380572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d815de00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8072270 tx=0x7ff9c801c8f0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- 172.21.15.39:0/2915380572 shutdown_connections 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 --2- 172.21.15.39:0/2915380572 >> v2:172.21.15.71:3300/0 conn(0x7ff9d815e340 0x7ff9d80d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 --2- 172.21.15.39:0/2915380572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d815de00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- 172.21.15.39:0/2915380572 >> 172.21.15.39:0/2915380572 conn(0x7ff9d806c7d0 msgr2=0x7ff9d806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- 172.21.15.39:0/2915380572 shutdown_connections 2024-04-26T23:36:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- 172.21.15.39:0/2915380572 wait complete. 2024-04-26T23:36:36.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 Processor -- start 2024-04-26T23:36:36.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.908+0000 7ff9df000640 1 -- start start 2024-04-26T23:36:36.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 0x7ff9d8072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d8161850 0x7ff9d81411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d816a340 con 0x7ff9d8140170 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d816a1c0 con 0x7ff9d8161850 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d816a4c0 con 0x7ff9d815e340 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34654/0 (socket says 172.21.15.39:34654) 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2443756970 learned_addr learned my addr 172.21.15.39:0/2443756970 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 0x7ff9d8072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9dd000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d8161850 0x7ff9d81411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 msgr2=0x7ff9d8072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 0x7ff9d8072a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d8161850 msgr2=0x7ff9d81411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d8161850 0x7ff9d81411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 -- 172.21.15.39:0/2443756970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d8069d80 con 0x7ff9d8140170 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 0x7ff9d8072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:36:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d7e00640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80af040 tx=0x7ff9c8019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80bc020 con 0x7ff9d8140170 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c80b88a0 con 0x7ff9d8140170 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80b8c90 con 0x7ff9d8140170 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d8073390 con 0x7ff9d8140170 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d8073950 con 0x7ff9d8140170 2024-04-26T23:36:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.912+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d806a720 con 0x7ff9d8140170 2024-04-26T23:36:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.916+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7ff9c80bf020 con 0x7ff9d8140170 2024-04-26T23:36:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.916+0000 7ff9d4c00640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 0x7ff9b406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.916+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7ff9c8121c70 con 0x7ff9d8140170 2024-04-26T23:36:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.916+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 0x7ff9b406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.916+0000 7ff9cf400640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 0x7ff9b406a960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0006fd0 tx=0x7ff9c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:36.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:36.920+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff9c80c6030 con 0x7ff9d8140170 2024-04-26T23:36:37.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.084+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff9d81570e0 con 0x7ff9d8140170 2024-04-26T23:36:37.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7ff9d80d1b30 con 0x7ff9d8140170 2024-04-26T23:36:37.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9d4c00640 1 -- 172.21.15.39:0/2443756970 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff9c80ace40 con 0x7ff9d8140170 2024-04-26T23:36:37.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 msgr2=0x7ff9b406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 0x7ff9b406a960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0006fd0 tx=0x7ff9c0008040 comp rx=0 tx=0).stop 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 msgr2=0x7ff9d8156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80af040 tx=0x7ff9c8019690 comp rx=0 tx=0).stop 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 shutdown_connections 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7ff9b40684a0 0x7ff9b406a960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d8161850 0x7ff9d81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff9d815e340 0x7ff9d8072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 --2- 172.21.15.39:0/2443756970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d8140170 0x7ff9d8156ba0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 >> 172.21.15.39:0/2443756970 conn(0x7ff9d806c7d0 msgr2=0x7ff9d815e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:37.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 shutdown_connections 2024-04-26T23:36:37.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.088+0000 7ff9df000640 1 -- 172.21.15.39:0/2443756970 wait complete. 2024-04-26T23:36:37.114 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:36:37.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:36:37.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 Processor -- start 2024-04-26T23:36:37.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 -- start start 2024-04-26T23:36:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe69c0742f0 0x7fe69c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69c074750 con 0x7fe69c0cd810 2024-04-26T23:36:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69c0d0550 con 0x7fe69c0cdbf0 2024-04-26T23:36:37.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a4800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe69c0d0b10 con 0x7fe69c0742f0 2024-04-26T23:36:37.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a1e00640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe69c0cd810 0x7fe69c144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:53030/0 (socket says 172.21.15.39:53030) 2024-04-26T23:36:37.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a1e00640 1 -- 172.21.15.39:0/3650333077 learned_addr learned my addr 172.21.15.39:0/3650333077 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-04-26T23:36:37.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a1400640 1 --2- 172.21.15.39:0/3650333077 >> v2:172.21.15.71:3300/0 conn(0x7fe69c0742f0 0x7fe69c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649809851 0 0) 0x7fe69c074750 con 0x7fe69c0cd810 2024-04-26T23:36:37.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.252+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe684003530 con 0x7fe69c0cd810 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2297774222 0 0) 0x7fe684003530 con 0x7fe69c0cd810 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 >> v2:172.21.15.71:3300/0 conn(0x7fe69c0742f0 msgr2=0x7fe69c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 --2- 172.21.15.39:0/3650333077 >> v2:172.21.15.71:3300/0 conn(0x7fe69c0742f0 0x7fe69c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 >> v1:172.21.15.71:6789/0 conn(0x7fe69c0cdbf0 legacy=0x7fe69c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c0d0830 con 0x7fe69c0cd810 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2509701244 0 0) 0x7fe690001680 con 0x7fe69c0cd810 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 >> v1:172.21.15.39:6789/0 conn(0x7fe69c0cd810 legacy=0x7fe69c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 0x7fe684003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840043c0 0x7fe684004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe684005130 0x7fe68400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c0d0b10 con 0x7fe684005130 2024-04-26T23:36:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe68400c070 con 0x7fe6840039c0 2024-04-26T23:36:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe68400c270 con 0x7fe6840043c0 2024-04-26T23:36:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 0x7fe684003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a2800640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe684005130 0x7fe68400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1400640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840043c0 0x7fe684004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 -- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840043c0 msgr2=0x7fe684004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840043c0 0x7fe684004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 -- 172.21.15.39:0/3650333077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe684005130 msgr2=0x7fe68400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:36:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe684005130 0x7fe68400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a1e00640 1 -- 172.21.15.39:0/3650333077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe684003530 con 0x7fe6840039c0 2024-04-26T23:36:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a2800640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe684005130 0x7fe68400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:36:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.256+0000 7fe6a2800640 1 -- 172.21.15.39:0/3650333077 reap_dead start 2024-04-26T23:36:37.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 0x7fe684003da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c210 tx=0x7fe69001cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311531d608a19f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:37.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690007cf0 con 0x7fe6840039c0 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe6900a9070 con 0x7fe6840039c0 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a0a00640 1 -- 172.21.15.39:0/3650333077 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690005da0 con 0x7fe6840039c0 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 msgr2=0x7fe684003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 0x7fe684003da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c210 tx=0x7fe69001cc40 comp rx=0 tx=0).stop 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- 172.21.15.39:0/3650333077 shutdown_connections 2024-04-26T23:36:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 --2- 172.21.15.39:0/3650333077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6840039c0 0x7fe684003da0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- 172.21.15.39:0/3650333077 >> 172.21.15.39:0/3650333077 conn(0x7fe69c0b2af0 msgr2=0x7fe69c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- 172.21.15.39:0/3650333077 shutdown_connections 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- 172.21.15.39:0/3650333077 wait complete. 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 Processor -- start 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 -- start start 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 0x7fe69c0aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 0x7fe69c1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.260+0000 7fe6a4800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c0ce180 con 0x7fe69c140b30 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c0ce000 con 0x7fe69c1406b0 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe69c143bb0 con 0x7fe6840039c0 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34672/0 (socket says 172.21.15.39:34672) 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 -- 172.21.15.39:0/402218375 learned_addr learned my addr 172.21.15.39:0/402218375 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a1400640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 0x7fe69c1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 0x7fe69c0aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 -- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 msgr2=0x7fe69c0aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 0x7fe69c0aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 -- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 msgr2=0x7fe69c1416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 0x7fe69c1416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 -- 172.21.15.39:0/402218375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c15a260 con 0x7fe69c140b30 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a1400640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 0x7fe69c1416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 0x7fe69c0aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:36:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a2800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe698007fd0 tx=0x7fe69800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698001c10 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe698018070 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69c15a540 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69800dd70 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69c15ade0 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69c15a930 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.264+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 88089+0+0 (secure 0 0 0) 0x7fe698003980 con 0x7fe69c140b30 2024-04-26T23:36:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.268+0000 7fe696000640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 0x7fe68006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:36:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.268+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4943+0+0 (secure 0 0 0) 0x7fe698086a10 con 0x7fe69c140b30 2024-04-26T23:36:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.268+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 0x7fe68006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:36:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.268+0000 7fe6a1e00640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 0x7fe68006a960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ab000 tx=0x7fe6900a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:36:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.272+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe698057090 con 0x7fe69c140b30 2024-04-26T23:36:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe69c050740 con 0x7fe69c140b30 2024-04-26T23:36:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe696000640 1 -- 172.21.15.39:0/402218375 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3866 (secure 0 0 0) 0x7fe698056990 con 0x7fe69c140b30 2024-04-26T23:36:37.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-04-26T23:36:37.475 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/3386919908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3386919908},{"type":"v1","addr":"172.21.15.71:6836","nonce":3386919908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1060378514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":1060378514},{"type":"v1","addr":"172.21.15.71:6837","nonce":1060378514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/1358429136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1358429136},{"type":"v1","addr":"172.21.15.39:6834","nonce":1358429136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/159697921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":159697921},{"type":"v1","addr":"172.21.15.39:6835","nonce":159697921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-04-26T23:36:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 42 2024-04-26T23:36:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 msgr2=0x7fe68006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 0x7fe68006a960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ab000 tx=0x7fe6900a7070 comp rx=0 tx=0).stop 2024-04-26T23:36:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 msgr2=0x7fe69c141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe698007fd0 tx=0x7fe69800d520 comp rx=0 tx=0).stop 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 shutdown_connections 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:6832/4212401484,v1:172.21.15.71:6833/4212401484] conn(0x7fe6800684a0 0x7fe68006a960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c140b30 0x7fe69c141c00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe69c1406b0 0x7fe69c1416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 --2- 172.21.15.39:0/402218375 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe6840039c0 0x7fe69c0aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 >> 172.21.15.39:0/402218375 conn(0x7fe69c0b2af0 msgr2=0x7fe69c0733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:36:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 shutdown_connections 2024-04-26T23:36:37.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-04-26T23:36:37.472+0000 7fe6a4800640 1 -- 172.21.15.39:0/402218375 wait complete. 2024-04-26T23:36:37.497 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T23:36:37.498 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T23:36:37.498 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:36:37.498 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.510 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:36:37.511 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:36:37.511 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.568 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:36:37.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:36:37.569 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.583 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:36:37.583 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:36:37.584 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.638 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:36:37.638 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T23:36:37.639 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T23:36:37.639 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.723 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T23:36:37.723 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T23:36:37.724 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.799 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T23:36:37.799 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T23:36:37.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.886 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T23:36:37.886 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T23:36:37.886 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:37.970 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T23:36:37.970 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T23:36:37.970 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:38.066 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T23:36:38.066 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T23:36:38.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:38.165 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T23:36:38.165 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T23:36:38.165 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:38.245 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T23:36:38.245 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T23:36:38.245 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:40.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:40.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:43.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-26T23:36:44.347 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T23:36:44.347 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T23:36:44.348 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T23:36:44.348 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:44.406 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T23:36:44.407 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T23:36:44.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:44.467 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T23:36:44.467 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T23:36:44.467 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:36:44.468 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:44.487 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:36:44.487 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:36:44.487 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:44.503 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:36:44.503 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:36:44.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:36:44.560 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:36:44.560 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T23:36:44.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-04-26T23:36:44.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:36:44.598 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T23:36:44.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:36:44.893 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T23:36:45.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:36:45.047 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T23:36:45.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:36:45.319 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T23:36:45.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:36:45.488 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T23:36:45.866 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:36:45.866 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T23:36:46.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:36:46.043 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T23:36:46.201 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:36:46.202 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T23:36:46.390 INFO:tasks.ceph:Archiving mon data... 2024-04-26T23:36:46.392 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/data/mon.a.tgz 2024-04-26T23:36:46.392 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-04-26T23:36:46.401 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.3a4fXtn9Qw 2024-04-26T23:36:46.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3a4fXtn9Qw 2024-04-26T23:36:46.537 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.3a4fXtn9Qw 2024-04-26T23:36:46.615 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.3a4fXtn9Qw is 355KB 2024-04-26T23:36:46.680 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.3a4fXtn9Qw 2024-04-26T23:36:46.689 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/data/mon.b.tgz 2024-04-26T23:36:46.689 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-26T23:36:46.698 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.gbKdU8G9QF 2024-04-26T23:36:46.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.gbKdU8G9QF 2024-04-26T23:36:46.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.gbKdU8G9QF 2024-04-26T23:36:46.904 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.gbKdU8G9QF is 361KB 2024-04-26T23:36:46.970 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.gbKdU8G9QF 2024-04-26T23:36:46.978 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/data/mon.c.tgz 2024-04-26T23:36:46.978 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-26T23:36:47.031 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.0upBxforl0 2024-04-26T23:36:47.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0upBxforl0 2024-04-26T23:36:47.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.0upBxforl0 2024-04-26T23:36:47.231 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.0upBxforl0 is 361KB 2024-04-26T23:36:47.294 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.0upBxforl0 2024-04-26T23:36:47.302 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T23:36:47.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:36:47.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:36:47.378 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:36:47.411 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:36:47.411 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T23:36:47.414 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi039/crash 2024-04-26T23:36:47.415 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:36:47.447 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi071/crash 2024-04-26T23:36:47.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:36:47.469 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T23:36:47.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:47.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:47.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:47.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:47.598 INFO:tasks.ceph:Compressing logs... 2024-04-26T23:36:47.598 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:36:47.628 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:36:47.655 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36023.log 2024-04-26T23:36:47.656 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37520.log 2024-04-26T23:36:47.656 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39971.log 2024-04-26T23:36:47.657 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36023.log.gz 2024-04-26T23:36:47.658 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.37520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38950.log 2024-04-26T23:36:47.658 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37520.log.gz 2024-04-26T23:36:47.659 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-04-26T23:36:47.659 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39971.log.gz 2024-04-26T23:36:47.659 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-04-26T23:36:47.659 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38950.log.gz 2024-04-26T23:36:47.660 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51295.log 2024-04-26T23:36:47.660 INFO:teuthology.orchestra.run.smithi039.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-04-26T23:36:47.661 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38663.log 2024-04-26T23:36:47.661 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-04-26T23:36:47.661 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2024-04-26T23:36:47.662 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51295.log.gz 2024-04-26T23:36:47.663 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38631.log 2024-04-26T23:36:47.663 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38663.log.gz 2024-04-26T23:36:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27818.log 2024-04-26T23:36:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33469.log 2024-04-26T23:36:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27746.log 2024-04-26T23:36:47.667 INFO:teuthology.orchestra.run.smithi071.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27818.log.gz 2024-04-26T23:36:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.3.33469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27842.log 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33469.log.gz 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27746.log.gz 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27842.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27842.log.gz 2024-04-26T23:36:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27674.log 2024-04-26T23:36:47.670 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38728.log 2024-04-26T23:36:47.670 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2024-04-26T23:36:47.670 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33800.log 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38631.log.gz 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38728.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38728.log.gz 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34788.log 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33800.log.gz 2024-04-26T23:36:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37952.log 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35334.log 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34788.log.gz 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37952.log.gz 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39240.log 2024-04-26T23:36:47.672 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35334.log.gz 2024-04-26T23:36:47.673 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50252.log 2024-04-26T23:36:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33610.log 2024-04-26T23:36:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33846.log 2024-04-26T23:36:47.685 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27674.log.gz 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33610.log.gz 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33846.log.gz 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33474.log 2024-04-26T23:36:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27770.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.3.33474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33615.log 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33474.log.gz 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-04-26T23:36:47.687 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33615.log.gz 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33367.log 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27794.log 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33367.log.gz 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:36:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27794.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:36:47.689 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27794.log.gz 2024-04-26T23:36:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33851.log 2024-04-26T23:36:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T23:36:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33851.log.gz 2024-04-26T23:36:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.d.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:36:47.694 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T23:36:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T23:36:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T23:36:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39032.log 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39240.log.gz 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37817.log 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50252.log.gz 2024-04-26T23:36:47.698 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36447.log 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39032.log.gz 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51425.log 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37817.log.gz 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40814.log 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36447.log.gz 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51085.log 2024-04-26T23:36:47.699 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51425.log.gz 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50952.log 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40814.log.gz 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51085.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51085.log.gz 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39540.log 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50952.log.gz 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50353.log 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50900.log 2024-04-26T23:36:47.700 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39540.log.gz 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39110.log 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50353.log.gz 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37978.log 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50900.log.gz 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33432.log 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39110.log.gz 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27565.log 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37978.log.gz 2024-04-26T23:36:47.701 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33432.log.gz 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.27565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40680.log 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27565.log.gz 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38833.log 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35836.log 2024-04-26T23:36:47.702 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40680.log.gz 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40302.log 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38833.log.gz 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36962.log 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35836.log.gz 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34296.log 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40302.log.gz 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50698.log 2024-04-26T23:36:47.703 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36962.log.gz 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37094.log 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34296.log.gz 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50698.log.gz 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38494.log 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37094.log.gz 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36740.log 2024-04-26T23:36:47.704 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38494.log.gz 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50725.log 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36740.log.gz 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33877.log 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz 2024-04-26T23:36:47.705 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2024-04-26T23:36:47.706 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50725.log.gz 2024-04-26T23:36:47.706 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35360.log 2024-04-26T23:36:47.706 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33877.log.gz 2024-04-26T23:36:47.712 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33385.log 2024-04-26T23:36:47.712 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33721.log 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33385.log.gz 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33726.log 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33721.log.gz 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.33726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33726.log.gz 2024-04-26T23:36:47.713 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27698.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35360.log.gz 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38572.log 2024-04-26T23:36:47.725 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40276.log 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38572.log.gz 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37739.log 2024-04-26T23:36:47.726 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40276.log.gz 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37739.log.gz 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-04-26T23:36:47.727 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35256.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38414.log 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-04-26T23:36:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38414.log.gz 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34684.log 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37921.log 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34658.log 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34684.log.gz 2024-04-26T23:36:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37921.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37921.log.gz 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34762.log 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35997.log 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34658.log.gz 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34762.log.gz 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36856.log 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35997.log.gz 2024-04-26T23:36:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39266.log 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36856.log.gz 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40563.log 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39266.log.gz 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37345.log 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-04-26T23:36:47.731 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40563.log.gz 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34926.log 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37345.log.gz 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40762.log 2024-04-26T23:36:47.732 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34926.log.gz 2024-04-26T23:36:47.736 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50672.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T23:36:47.736 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2024-04-26T23:36:47.736 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40762.log.gz 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38889.log 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2024-04-26T23:36:47.737 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38754.log 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38889.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38889.log.gz 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.38754.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40732.log 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39462.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38754.log.gz 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-04-26T23:36:47.738 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22647.log 2024-04-26T23:36:47.739 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40732.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40732.log.gz 2024-04-26T23:36:47.739 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40419.log 2024-04-26T23:36:47.739 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-04-26T23:36:47.741 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.tmp-client.admin.22647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34502.log 2024-04-26T23:36:47.741 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22647.log.gz 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50327.log 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40419.log.gz 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38030.log 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34502.log.gz 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40485.log 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50327.log.gz 2024-04-26T23:36:47.742 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36265.log 2024-04-26T23:36:47.743 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2024-04-26T23:36:47.744 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51113.log 2024-04-26T23:36:47.744 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40485.log.gz 2024-04-26T23:36:47.744 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36208.log 2024-04-26T23:36:47.744 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36265.log.gz 2024-04-26T23:36:47.744 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50379.log 2024-04-26T23:36:47.746 INFO:teuthology.orchestra.run.smithi071.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T23:36:47.746 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51113.log: /var/log/ceph/ceph-client.admin.36208.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51113.log.gz 2024-04-26T23:36:47.747 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2024-04-26T23:36:47.747 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36208.log.gz 2024-04-26T23:36:47.747 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39188.log 2024-04-26T23:36:47.747 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50379.log.gz 2024-04-26T23:36:47.748 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-04-26T23:36:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50646.log: /var/log/ceph/ceph-client.admin.39188.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2024-04-26T23:36:47.749 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39188.log.gz 2024-04-26T23:36:47.749 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-04-26T23:36:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35542.log 2024-04-26T23:36:47.750 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33774.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-04-26T23:36:47.751 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40788.log 2024-04-26T23:36:47.751 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-04-26T23:36:47.752 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40706.log 2024-04-26T23:36:47.752 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35542.log.gz 2024-04-26T23:36:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38265.log 2024-04-26T23:36:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40788.log: /var/log/ceph/ceph-client.admin.40706.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40788.log.gz 2024-04-26T23:36:47.754 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-04-26T23:36:47.754 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40706.log.gz 2024-04-26T23:36:47.755 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2024-04-26T23:36:47.755 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38265.log.gz 2024-04-26T23:36:47.756 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51347.log 2024-04-26T23:36:47.756 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3%/var/log/ceph/ceph-client.admin.39058.log: -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-04-26T23:36:47.757 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39214.log 2024-04-26T23:36:47.757 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2024-04-26T23:36:47.758 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33351.log 2024-04-26T23:36:47.758 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51347.log.gz 2024-04-26T23:36:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40537.log 2024-04-26T23:36:47.759 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33351.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39214.log.gz 2024-04-26T23:36:47.760 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-04-26T23:36:47.760 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33351.log.gz 2024-04-26T23:36:47.761 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27456.log 2024-04-26T23:36:47.761 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40537.log.gz 2024-04-26T23:36:47.762 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40918.log 2024-04-26T23:36:47.762 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-04-26T23:36:47.763 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.27456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50567.log 2024-04-26T23:36:47.763 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27456.log.gz 2024-04-26T23:36:47.764 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2024-04-26T23:36:47.764 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40918.log.gz 2024-04-26T23:36:47.765 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50567.log: /var/log/ceph/ceph-client.admin.37644.log 2024-04-26T23:36:47.765 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50926.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50567.log.gz 2024-04-26T23:36:47.766 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-04-26T23:36:47.766 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39625.log 2024-04-26T23:36:47.767 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5/var/log/ceph/ceph-client.admin.37644.log: --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-04-26T23:36:47.768 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39625.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37644.log.gz 2024-04-26T23:36:47.768 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51399.log 2024-04-26T23:36:47.769 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39625.log.gz 2024-04-26T23:36:47.769 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2024-04-26T23:36:47.769 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-04-26T23:36:47.770 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-04-26T23:36:47.771 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51399.log.gz 2024-04-26T23:36:47.772 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-04-26T23:36:47.772 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2024-04-26T23:36:47.773 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36343.log 2024-04-26T23:36:47.773 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-04-26T23:36:47.773 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36395.log 2024-04-26T23:36:47.774 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36343.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 2024-04-26T23:36:47.775 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-04-26T23:36:47.775 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36343.log.gz 2024-04-26T23:36:47.776 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35802.log 2024-04-26T23:36:47.776 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36395.log.gz 2024-04-26T23:36:47.777 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38317.log 2024-04-26T23:36:47.777 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5%/var/log/ceph/ceph-client.admin.35802.log: -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-04-26T23:36:47.778 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35045.log 2024-04-26T23:36:47.778 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35802.log.gz 2024-04-26T23:36:47.779 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2024-04-26T23:36:47.779 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38317.log.gz 2024-04-26T23:36:47.780 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.35045.log: /var/log/ceph/ceph-osd.3.log 2024-04-26T23:36:47.780 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35045.log.gz 2024-04-26T23:36:47.781 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-04-26T23:36:47.781 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2024-04-26T23:36:47.782 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51243.log 2024-04-26T23:36:47.783 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39292.log 2024-04-26T23:36:47.784 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-04-26T23:36:47.785 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-04-26T23:36:47.785 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51243.log.gz 2024-04-26T23:36:47.786 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2024-04-26T23:36:47.786 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34580.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39292.log.gz 2024-04-26T23:36:47.787 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2024-04-26T23:36:47.787 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-04-26T23:36:47.788 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35173.log 2024-04-26T23:36:47.788 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz 2024-04-26T23:36:47.789 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-04-26T23:36:47.789 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2024-04-26T23:36:47.790 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.2.35173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36708.log 2024-04-26T23:36:47.790 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35173.log.gz 2024-04-26T23:36:47.791 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51451.log 2024-04-26T23:36:47.792 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-04-26T23:36:47.793 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-04-26T23:36:47.793 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36708.log.gz 2024-04-26T23:36:47.793 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-04-26T23:36:47.794 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51451.log.gz 2024-04-26T23:36:47.795 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51321.log 2024-04-26T23:36:47.795 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-04-26T23:36:47.796 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39436.log 2024-04-26T23:36:47.796 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-04-26T23:36:47.797 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41042.log 2024-04-26T23:36:47.797 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51321.log.gz 2024-04-26T23:36:47.798 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-04-26T23:36:47.798 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39436.log.gz 2024-04-26T23:36:47.799 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.41042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41042.log.gz 2024-04-26T23:36:47.799 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41047.log 2024-04-26T23:36:47.800 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-04-26T23:36:47.801 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz 2024-04-26T23:36:47.802 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.41047.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.41047.log.gz -5 2024-04-26T23:36:47.802 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-04-26T23:36:47.803 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-04-26T23:36:47.803 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-04-26T23:36:47.804 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50777.log 2024-04-26T23:36:47.804 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-04-26T23:36:47.805 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40172.log 2024-04-26T23:36:47.805 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-04-26T23:36:47.806 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38807.log 2024-04-26T23:36:47.806 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50777.log.gz 2024-04-26T23:36:47.807 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39573.log 2024-04-26T23:36:47.808 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40172.log.gz 2024-04-26T23:36:47.808 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35087.log 2024-04-26T23:36:47.809 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38807.log.gz 2024-04-26T23:36:47.810 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36499.log 2024-04-26T23:36:47.810 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39573.log.gz 2024-04-26T23:36:47.810 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38187.log 2024-04-26T23:36:47.811 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35087.log.gz 2024-04-26T23:36:47.811 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41140.log 2024-04-26T23:36:47.812 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36499.log.gz 2024-04-26T23:36:47.813 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51555.log 2024-04-26T23:36:47.813 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38187.log.gz 2024-04-26T23:36:47.814 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35386.log 2024-04-26T23:36:47.814 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41140.log.gz 2024-04-26T23:36:47.815 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log 2024-04-26T23:36:47.815 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51555.log.gz 2024-04-26T23:36:47.816 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-04-26T23:36:47.816 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35386.log.gz 2024-04-26T23:36:47.818 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51503.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51503.log.gz 2024-04-26T23:36:47.818 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38861.log 2024-04-26T23:36:47.819 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33748.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-04-26T23:36:47.819 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T23:36:47.821 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-04-26T23:36:47.821 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38861.log.gz 2024-04-26T23:36:47.821 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2024-04-26T23:36:47.823 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-04-26T23:36:47.824 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz 2024-04-26T23:36:47.824 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33865.log 2024-04-26T23:36:47.825 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T23:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-04-26T23:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34840.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-04-26T23:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35888.log 2024-04-26T23:36:47.827 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33865.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33865.log.gz 2024-04-26T23:36:47.827 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33484.log 2024-04-26T23:36:47.828 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51191.log 2024-04-26T23:36:47.828 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35888.log.gz 2024-04-26T23:36:47.829 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50488.log 2024-04-26T23:36:47.830 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33484.log.gz 2024-04-26T23:36:47.831 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36369.log 2024-04-26T23:36:47.831 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51191.log.gz 2024-04-26T23:36:47.832 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-04-26T23:36:47.832 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50488.log.gz 2024-04-26T23:36:47.833 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51373.log 2024-04-26T23:36:47.833 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36369.log.gz 2024-04-26T23:36:47.834 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40645.log 2024-04-26T23:36:47.835 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-04-26T23:36:47.836 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34268.log 2024-04-26T23:36:47.836 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51373.log.gz 2024-04-26T23:36:47.837 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37869.log 2024-04-26T23:36:47.837 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40645.log.gz 2024-04-26T23:36:47.838 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-04-26T23:36:47.838 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34268.log.gz 2024-04-26T23:36:47.839 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40354.log 2024-04-26T23:36:47.839 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37869.log.gz 2024-04-26T23:36:47.840 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39599.log 2024-04-26T23:36:47.841 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-04-26T23:36:47.842 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34866.log 2024-04-26T23:36:47.842 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40354.log.gz 2024-04-26T23:36:47.843 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39599.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39599.log.gz 2024-04-26T23:36:47.843 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2024-04-26T23:36:47.844 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2024-04-26T23:36:47.845 INFO:teuthology.orchestra.run.smithi039.stderr: 91.1%/var/log/ceph/ceph-client.admin.39734.log: -- replaced with /var/log/ceph/ceph-client.admin.34866.log.gz 2024-04-26T23:36:47.846 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2024-04-26T23:36:47.851 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2024-04-26T23:36:47.851 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51139.log 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34814.log 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51139.log.gz 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-04-26T23:36:47.852 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2024-04-26T23:36:47.853 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-04-26T23:36:47.854 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34814.log.gz 2024-04-26T23:36:47.854 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38369.log 2024-04-26T23:36:47.854 INFO:teuthology.orchestra.run.smithi039.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-04-26T23:36:47.855 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33878.log 2024-04-26T23:36:47.855 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-04-26T23:36:47.855 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38369.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38369.log.gz 2024-04-26T23:36:47.856 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36629.log 2024-04-26T23:36:47.857 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-04-26T23:36:47.857 INFO:teuthology.orchestra.run.smithi039.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33878.log.gz 2024-04-26T23:36:47.858 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33644.log 2024-04-26T23:36:47.858 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36629.log.gz 2024-04-26T23:36:47.860 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36182.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-04-26T23:36:47.860 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33644.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33644.log.gz 2024-04-26T23:36:47.861 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38520.log 2024-04-26T23:36:47.862 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-04-26T23:36:47.864 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40023.log 2024-04-26T23:36:47.864 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38520.log.gz 2024-04-26T23:36:47.865 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37241.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-04-26T23:36:47.865 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-04-26T23:36:47.866 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40023.log.gz 2024-04-26T23:36:47.866 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-04-26T23:36:47.868 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36421.log 2024-04-26T23:36:47.868 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-04-26T23:36:47.869 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33566.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:36:47.869 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-04-26T23:36:47.870 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36421.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36421.log.gz 2024-04-26T23:36:47.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2024-04-26T23:36:47.873 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34295.log 2024-04-26T23:36:47.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39136.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:36:47.874 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2024-04-26T23:36:47.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34295.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34295.log.gz 2024-04-26T23:36:47.875 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51606.log 2024-04-26T23:36:47.876 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-04-26T23:36:47.877 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36473.log 2024-04-26T23:36:47.878 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51606.log.gz 2024-04-26T23:36:47.879 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2024-04-26T23:36:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36473.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36473.log.gz 2024-04-26T23:36:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36291.log 2024-04-26T23:36:47.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51059.log 2024-04-26T23:36:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33260.log 2024-04-26T23:36:47.883 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36291.log.gz 2024-04-26T23:36:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51059.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51059.log.gz 2024-04-26T23:36:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33260.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33260.log.gz 2024-04-26T23:36:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-04-26T23:36:47.886 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50514.log 2024-04-26T23:36:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37040.log 2024-04-26T23:36:47.889 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 2024-04-26T23:36:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50514.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50514.log.gz 2024-04-26T23:36:47.890 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37040.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37040.log.gz 2024-04-26T23:36:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2024-04-26T23:36:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-04-26T23:36:47.893 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33879.log 2024-04-26T23:36:47.893 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2024-04-26T23:36:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 88.3% 2024-04-26T23:36:47.896 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-04-26T23:36:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34073.log 87.6% 2024-04-26T23:36:47.898 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-04-26T23:36:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51033.log 2024-04-26T23:36:47.899 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-04-26T23:36:47.901 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39162.log 2024-04-26T23:36:47.901 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34073.log.gz 2024-04-26T23:36:47.901 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51033.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51033.log.gz 2024-04-26T23:36:47.902 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38213.log 2024-04-26T23:36:47.902 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39162.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.50462.log 2024-04-26T23:36:47.902 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39162.log.gz 2024-04-26T23:36:47.903 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35914.log 2024-04-26T23:36:47.904 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38213.log.gz 2024-04-26T23:36:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50462.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50462.log.gz 2024-04-26T23:36:47.905 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35914.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35914.log.gz 2024-04-26T23:36:47.905 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37843.log 2024-04-26T23:36:47.906 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37540.log 2024-04-26T23:36:47.907 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39409.log 2024-04-26T23:36:47.908 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37843.log.gz 2024-04-26T23:36:47.908 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37540.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37540.log.gz 2024-04-26T23:36:47.909 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T23:36:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39409.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39409.log.gz 2024-04-26T23:36:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38780.log 2024-04-26T23:36:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-04-26T23:36:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34736.log 2024-04-26T23:36:47.913 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38780.log.gz 2024-04-26T23:36:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-04-26T23:36:47.913 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-04-26T23:36:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34736.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-04-26T23:36:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-04-26T23:36:47.916 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-04-26T23:36:47.916 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33826.log 2024-04-26T23:36:47.917 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35776.log 2024-04-26T23:36:47.918 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-04-26T23:36:47.919 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33826.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33826.log.gz 2024-04-26T23:36:47.920 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35776.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35776.log.gz 2024-04-26T23:36:47.920 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-04-26T23:36:47.921 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50540.log 2024-04-26T23:36:47.923 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38924.log 2024-04-26T23:36:47.923 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-04-26T23:36:47.924 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50540.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50540.log.gz 2024-04-26T23:36:47.925 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38924.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38924.log.gz 2024-04-26T23:36:47.926 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33512.log 2024-04-26T23:36:47.927 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38980.log 2024-04-26T23:36:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-04-26T23:36:47.929 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33512.log.gz 2024-04-26T23:36:47.929 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34606.log 2024-04-26T23:36:47.930 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38980.log.gz 2024-04-26T23:36:47.930 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-04-26T23:36:47.931 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-04-26T23:36:47.932 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2024-04-26T23:36:47.932 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34606.log.gz 2024-04-26T23:36:47.933 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51477.log 2024-04-26T23:36:47.933 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-04-26T23:36:47.935 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2024-04-26T23:36:47.936 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51477.log.gz 2024-04-26T23:36:47.936 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37765.log 2024-04-26T23:36:47.937 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39488.log 2024-04-26T23:36:47.938 INFO:teuthology.orchestra.run.smithi071.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T23:36:47.939 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38468.log 2024-04-26T23:36:47.939 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37765.log.gz 2024-04-26T23:36:47.939 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39488.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39488.log.gz 2024-04-26T23:36:47.940 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-04-26T23:36:47.941 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38468.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38468.log.gz 2024-04-26T23:36:47.941 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33458.log 2024-04-26T23:36:47.942 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37014.log 2024-04-26T23:36:47.942 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-04-26T23:36:47.944 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33458.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33458.log.gz 2024-04-26T23:36:47.945 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37014.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37014.log.gz 2024-04-26T23:36:47.945 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36239.log 2024-04-26T23:36:47.946 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33170.log 2024-04-26T23:36:47.948 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-04-26T23:36:47.948 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36239.log.gz 2024-04-26T23:36:47.949 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33170.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33170.log.gz 2024-04-26T23:36:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36130.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-04-26T23:36:47.951 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50619.log 2024-04-26T23:36:47.952 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35750.log 2024-04-26T23:36:47.953 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-04-26T23:36:47.954 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50619.log.gz 2024-04-26T23:36:47.954 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35750.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35750.log.gz 2024-04-26T23:36:47.955 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38546.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gz 2024-04-26T23:36:47.956 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-04-26T23:36:47.957 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37713.log 2024-04-26T23:36:47.958 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34081.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-04-26T23:36:47.959 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40866.log 2024-04-26T23:36:47.959 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz 2024-04-26T23:36:47.960 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37267.log 2024-04-26T23:36:47.961 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40224.log 2024-04-26T23:36:47.961 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40866.log.gz 2024-04-26T23:36:47.963 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37267.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37267.log.gz 2024-04-26T23:36:47.963 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-04-26T23:36:47.964 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40224.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40224.log.gz 2024-04-26T23:36:47.964 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:36:47.965 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50751.log 2024-04-26T23:36:47.966 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-04-26T23:36:47.968 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.50751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-04-26T23:36:47.968 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39389.log 2024-04-26T23:36:47.968 INFO:teuthology.orchestra.run.smithi039.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:36:47.970 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.39389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39389.log.gz 2024-04-26T23:36:47.971 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40511.log 2024-04-26T23:36:47.972 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T23:36:47.974 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38109.log 2024-04-26T23:36:47.974 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40511.log.gz 2024-04-26T23:36:47.975 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-04-26T23:36:47.976 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38109.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz 2024-04-26T23:36:47.977 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39786.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-04-26T23:36:47.978 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-04-26T23:36:47.979 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T23:36:47.981 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39839.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-04-26T23:36:47.986 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-04-26T23:36:47.987 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-04-26T23:36:47.989 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-04-26T23:36:47.990 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38239.log 2024-04-26T23:36:47.993 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37423.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-04-26T23:36:47.994 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-04-26T23:36:47.997 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34082.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50405.log 2024-04-26T23:36:47.997 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-04-26T23:36:47.999 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38239.log: gzip -5/var/log/ceph/ceph-client.admin.50405.log: --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-04-26T23:36:48.003 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4%/var/log/ceph/ceph-client.admin.35568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38239.log.gz 2024-04-26T23:36:48.003 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-04-26T23:36:48.004 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-04-26T23:36:48.004 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50405.log.gz 2024-04-26T23:36:48.007 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-04-26T23:36:48.008 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-04-26T23:36:48.010 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.36104.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40944.log 2024-04-26T23:36:48.014 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40944.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40944.log.gz 2024-04-26T23:36:48.014 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37397.log 2024-04-26T23:36:48.018 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-04-26T23:36:48.018 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37397.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37397.log.gz 2024-04-26T23:36:48.019 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51165.log 2024-04-26T23:36:48.021 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35971.log 2024-04-26T23:36:48.022 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51165.log.gz 2024-04-26T23:36:48.024 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-04-26T23:36:48.025 INFO:teuthology.orchestra.run.smithi039.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35971.log.gz 2024-04-26T23:36:48.027 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36317.log 2024-04-26T23:36:48.031 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36317.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36317.log.gz 2024-04-26T23:36:48.032 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-04-26T23:36:48.032 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-04-26T23:36:48.035 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36049.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gz 2024-04-26T23:36:48.035 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38004.log 2024-04-26T23:36:48.038 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-04-26T23:36:48.038 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38004.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38004.log.gz 2024-04-26T23:36:48.041 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36655.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-04-26T23:36:48.041 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-04-26T23:36:48.043 INFO:teuthology.orchestra.run.smithi039.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T23:36:48.043 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-04-26T23:36:48.044 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-04-26T23:36:48.046 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-04-26T23:36:48.047 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35282.log 2024-04-26T23:36:48.048 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2024-04-26T23:36:48.050 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35282.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35282.log.gz 2024-04-26T23:36:48.050 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37293.log 2024-04-26T23:36:48.051 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2024-04-26T23:36:48.051 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40994.log 2024-04-26T23:36:48.052 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37293.log.gz 2024-04-26T23:36:48.054 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41088.log 2024-04-26T23:36:48.055 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40994.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.40994.log.gz 2024-04-26T23:36:48.056 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2024-04-26T23:36:48.056 INFO:teuthology.orchestra.run.smithi039.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41088.log.gz 2024-04-26T23:36:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2024-04-26T23:36:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39514.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2024-04-26T23:36:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39917.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2024-04-26T23:36:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40589.log 2024-04-26T23:36:48.062 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34528.log 2024-04-26T23:36:48.063 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40589.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40589.log.gz 2024-04-26T23:36:48.064 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34528.log.gz 2024-04-26T23:36:48.064 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37066.log 2024-04-26T23:36:48.065 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-26T23:36:48.067 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37066.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37066.log.gz 2024-04-26T23:36:48.068 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35228.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-26T23:36:48.069 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34287.log 2024-04-26T23:36:48.070 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2024-04-26T23:36:48.072 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34287.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34287.log.gz 2024-04-26T23:36:48.072 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37592.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2024-04-26T23:36:48.073 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38161.log 2024-04-26T23:36:48.074 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40892.log 2024-04-26T23:36:48.076 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38161.log.gz 2024-04-26T23:36:48.077 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40892.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40892.log.gz 2024-04-26T23:36:48.077 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39812.log 2024-04-26T23:36:48.078 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38598.log 2024-04-26T23:36:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39812.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39812.log.gz 2024-04-26T23:36:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38598.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38598.log.gz 2024-04-26T23:36:48.081 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2024-04-26T23:36:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34292.log 2024-04-26T23:36:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36830.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2024-04-26T23:36:48.085 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34292.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34292.log.gz 2024-04-26T23:36:48.085 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50301.log 2024-04-26T23:36:48.087 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2024-04-26T23:36:48.088 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50301.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50301.log.gz 2024-04-26T23:36:48.089 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gz 2024-04-26T23:36:48.090 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40328.log 2024-04-26T23:36:48.091 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-04-26T23:36:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40328.log.gz 2024-04-26T23:36:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39084.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2024-04-26T23:36:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-26T23:36:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39997.log 2024-04-26T23:36:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34080.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-04-26T23:36:48.097 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39997.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39997.log.gz 2024-04-26T23:36:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-04-26T23:36:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51217.log 2024-04-26T23:36:48.100 INFO:teuthology.orchestra.run.smithi071.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T23:36:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36988.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-04-26T23:36:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51217.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51217.log.gz 2024-04-26T23:36:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-04-26T23:36:48.103 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T23:36:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34086.log 2024-04-26T23:36:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33325.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-04-26T23:36:48.106 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34086.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34086.log.gz 2024-04-26T23:36:48.106 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-04-26T23:36:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39394.log 2024-04-26T23:36:48.108 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T23:36:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40840.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2024-04-26T23:36:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.39394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41114.log 2024-04-26T23:36:48.111 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39394.log.gz 2024-04-26T23:36:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41062.log 2024-04-26T23:36:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41114.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41114.log.gz 2024-04-26T23:36:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41062.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41062.log.gz 2024-04-26T23:36:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37124.log 2024-04-26T23:36:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-04-26T23:36:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.37124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37124.log.gz 2024-04-26T23:36:48.118 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36681.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-04-26T23:36:48.118 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40250.log 2024-04-26T23:36:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35063.log 2024-04-26T23:36:48.121 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40250.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40250.log.gz 2024-04-26T23:36:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.35063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35063.log.gz 2024-04-26T23:36:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-04-26T23:36:48.124 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2024-04-26T23:36:48.125 INFO:teuthology.orchestra.run.smithi039.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T23:36:48.125 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41166.log 2024-04-26T23:36:48.125 INFO:teuthology.orchestra.run.smithi039.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-04-26T23:36:48.126 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T23:36:48.127 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34276.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2024-04-26T23:36:48.127 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-04-26T23:36:48.128 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.41166.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41166.log.gz 2024-04-26T23:36:48.128 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2024-04-26T23:36:48.129 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-26T23:36:48.129 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m0.483s 2024-04-26T23:36:48.129 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m2.253s 2024-04-26T23:36:48.129 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.257s 2024-04-26T23:36:48.130 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-26T23:36:48.130 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38056.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T23:36:48.130 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-04-26T23:36:48.131 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37525.log 2024-04-26T23:36:48.131 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2024-04-26T23:36:48.132 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.27675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34710.log 2024-04-26T23:36:48.132 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-26T23:36:48.132 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.37525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35646.log 2024-04-26T23:36:48.133 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37525.log.gz 2024-04-26T23:36:48.134 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-04-26T23:36:48.134 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34710.log.gz 2024-04-26T23:36:48.134 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.35646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34088.log 2024-04-26T23:36:48.135 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35646.log.gz 2024-04-26T23:36:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.33618.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36804.log 2024-04-26T23:36:48.136 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-04-26T23:36:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-04-26T23:36:48.137 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34088.log.gz 2024-04-26T23:36:48.138 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36804.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36804.log.gz 2024-04-26T23:36:48.138 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40101.log 2024-04-26T23:36:48.139 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36910.log 2024-04-26T23:36:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36525.log: /var/log/ceph/ceph-client.admin.40101.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-04-26T23:36:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38135.log 2024-04-26T23:36:48.140 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40101.log.gz 2024-04-26T23:36:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.36910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2024-04-26T23:36:48.141 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-04-26T23:36:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35178.log 2024-04-26T23:36:48.143 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38135.log.gz 2024-04-26T23:36:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35620.log 2024-04-26T23:36:48.144 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2024-04-26T23:36:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.2.35178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35178.log.gz 2024-04-26T23:36:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-04-26T23:36:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.35620.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33670.log 2024-04-26T23:36:48.146 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35620.log.gz 2024-04-26T23:36:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.34554.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-04-26T23:36:48.147 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33670.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33670.log.gz 2024-04-26T23:36:48.232 INFO:teuthology.orchestra.run.smithi039.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T23:36:48.287 INFO:teuthology.orchestra.run.smithi039.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T23:36:48.312 INFO:teuthology.orchestra.run.smithi039.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T23:36:48.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-26T23:36:51.575 INFO:teuthology.orchestra.run.smithi039.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T23:36:51.577 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-04-26T23:36:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m3.946s 2024-04-26T23:36:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m6.008s 2024-04-26T23:36:51.578 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m1.023s 2024-04-26T23:36:51.579 INFO:tasks.ceph:Archiving logs... 2024-04-26T23:36:51.579 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi039/log 2024-04-26T23:36:51.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:36:52.563 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi071/log 2024-04-26T23:36:52.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:36:52.848 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T23:36:52.858 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T23:36:52.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:36:52.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:36:52.945 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T23:36:52.954 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T23:36:52.955 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:36:52.958 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.099 -5.099 2.139 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout:*hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.072 -3.755 2.085 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.092 +0.500 1.434 2024-04-26T23:36:52.970 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T23:36:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:36:52.973 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-04-26T23:36:52.974 INFO:teuthology.orchestra.run.smithi071.stdout:+hv01.front.sepi 67.205.162.81 3 u 15 64 377 0.072 -2.244 2.378 2024-04-26T23:36:52.974 INFO:teuthology.orchestra.run.smithi071.stdout:*hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.083 -1.507 1.870 2024-04-26T23:36:52.974 INFO:teuthology.orchestra.run.smithi071.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.071 -0.134 1.434 2024-04-26T23:36:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T23:36:52.975 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T23:36:52.991 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T23:36:52.992 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T23:36:53.006 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T23:36:53.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T23:36:53.031 INFO:teuthology.task.internal:Duration was 1346.356879 seconds 2024-04-26T23:36:53.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T23:36:53.045 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T23:36:53.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:36:53.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:36:53.153 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T23:36:53.154 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-04-26T23:36:53.154 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:36:53.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T23:36:53.175 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:36:53.195 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T23:36:53.195 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:36:53.220 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:36:53.273 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T23:36:53.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:36:53.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:36:53.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T23:36:53.394 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T23:36:53.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:36:53.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:36:53.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T23:36:53.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:36:53.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:36:53.475 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-04-26T23:36:53.496 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-04-26T23:36:53.514 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:36:53.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:36:53.549 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:36:53.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:36:53.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T23:36:53.576 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T23:36:53.577 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi039 2024-04-26T23:36:53.577 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:36:53.619 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292/remote/smithi071 2024-04-26T23:36:53.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:36:53.645 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T23:36:53.645 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:36:53.660 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:36:53.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T23:36:53.702 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T23:36:53.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T23:36:53.711 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T23:36:53.711 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:36:53.715 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:36:53.720 INFO:teuthology.orchestra.run.smithi039.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:36 /home/ubuntu/cephtest 2024-04-26T23:36:53.743 INFO:teuthology.orchestra.run.smithi071.stdout: 658121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:36 /home/ubuntu/cephtest 2024-04-26T23:36:53.745 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T23:36:53.756 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T23:36:53.776 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T23:36:53.802 DEBUG:teuthology.nuke:shortname: smithi039 2024-04-26T23:36:53.802 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:36:53.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:03:22.954867', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGaH69UcDfuzablpDvkEsJVoPJhBwFxPeT00M2bAFqc5k1GGqU8rE1e7NFisveRm/P3H7boohkJ6EN2BRI23/vs='} 2024-04-26T23:36:53.827 DEBUG:teuthology.nuke:shortname: smithi071 2024-04-26T23:36:53.827 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:36:53.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:03:22.956579', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGFIYNFT//qXwGsAYPsYXooTHX948SVI5BRrsPf/jY9TGfgE8WDVgCeR3GtArSJ2T56ZhB0opaY5GTRwFZZCFPQ='} 2024-04-26T23:36:53.870 INFO:teuthology.orchestra.console.smithi039:Power off 2024-04-26T23:36:53.870 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:36:53.895 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-04-26T23:36:53.895 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:36:53.912 INFO:teuthology.orchestra.console.smithi071:Power off 2024-04-26T23:36:53.913 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:36:53.927 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-04-26T23:36:53.940 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-04-26T23:36:53.940 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:36:53.963 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T23:36:57.929 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:36:57.964 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:36:58.040 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-04-26T23:36:58.077 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T23:37:02.043 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:37:02.078 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:37:02.154 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-04-26T23:37:02.190 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-26T23:37:02.256 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-04-26T23:37:02.291 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-04-26T23:37:02.400 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 1346.3568785190582 failure_reason: 'Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=78d817db466b4aaf9bd88d4857557e08 status: fail success: false 2024-04-26T23:37:02.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:37:02.485 INFO:teuthology.run:FAIL